Nov 06 16:56:42 devstack cinder-volume[75769]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 06 16:56:42 devstack cinder-volume[75769]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 06 16:56:42 devstack cinder-volume[75769]: we strongly recommend against using it for new projects.
Nov 06 16:56:42 devstack cinder-volume[75769]: If you are already using Eventlet, we recommend migrating to a different
Nov 06 16:56:42 devstack cinder-volume[75769]: framework.  For more detail see
Nov 06 16:56:42 devstack cinder-volume[75769]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 06 16:56:42 devstack cinder-volume[75769]:   import eventlet  # noqa
Nov 06 16:56:45 devstack cinder-volume[75769]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75769) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 06 16:56:45 devstack cinder-volume[75769]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75769) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 06 16:56:45 devstack cinder-volume[75769]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75769) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 06 16:56:46 devstack cinder-volume[75769]: INFO dbcounter [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] Registered counter for database cinder
Nov 06 16:56:46 devstack cinder-volume[75769]: DEBUG oslo_db.sqlalchemy.engines [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75769) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 06 16:56:46 devstack cinder-volume[75769]: DEBUG dbcounter [-] [75769] Writer thread running {{(pid=75769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 06 16:56:46 devstack cinder-volume[75769]: INFO cinder.rpc [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 06 16:56:46 devstack cinder-volume[75769]: INFO cinder.rpc [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 06 16:56:46 devstack cinder-volume[75769]: DEBUG oslo_db.sqlalchemy.engines [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75769) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 06 16:56:46 devstack cinder-volume[75769]: INFO cinder.volume.manager [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] Determined volume DB was empty at startup.
Nov 06 16:56:46 devstack cinder-volume[75769]: DEBUG cinder.volume.manager [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75769) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 06 16:56:46 devstack cinder-volume[75769]: INFO cinder.volume.manager [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 06 16:56:46 devstack cinder-volume[75769]: WARNING stevedore.named [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 06 16:56:46 devstack cinder-volume[75769]: WARNING castellan.key_manager [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 06 16:56:46 devstack cinder-volume[75769]: WARNING cinder.keymgr.conf_key_mgr [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 06 16:56:46 devstack cinder-volume[75769]: DEBUG cinder.volume.drivers.lvm [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75769) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Nov 06 16:56:46 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] CMD "cinder-rtstool verify" returned: 0 in 0.397s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_db.sqlalchemy.engines [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75769) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 06 16:56:47 devstack cinder-volume[75769]: INFO cinder.rpc [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Nov 06 16:56:47 devstack cinder-volume[75769]: INFO cinder.rpc [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Nov 06 16:56:47 devstack cinder-volume[75769]: WARNING stevedore.named [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 06 16:56:47 devstack cinder-volume[75769]: WARNING castellan.key_manager [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 06 16:56:47 devstack cinder-volume[75769]: INFO cinder.volume.manager [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_db.sqlalchemy.engines [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75769) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 06 16:56:47 devstack cinder-volume[75769]: INFO oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] Starting 1 workers
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] Started child 75920 {{(pid=75769) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] Full set of CONF: {{(pid=75769) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] ******************************************************************************** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] Configuration options gathered from: {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] ================================================================================ {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] allow_availability_zone_fallback = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75920]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1)
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] allow_compression_on_image_upload = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] allowed_direct_url_schemes     = [] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] api_rate_limit                 = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] auth_strategy                  = keystone {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] az_cache_duration              = 3600 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_availability_zone      = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_host                   = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_name                   = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_stats_polling_interval = 60 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backup_api_class               = cinder.backup.api.API {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backup_name_template           = backup-%s {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backup_use_same_host           = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backup_use_temp_snapshot       = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] chap_password                  = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] chap_username                  =  {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cinder_internal_tenant_project_id = 608b360473534ab0ba5d4d55f557d676 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cinder_internal_tenant_user_id = 5a905badb8824f72856bf9fd231afb51 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cloned_volume_same_az          = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cluster                        = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] compression_format             = gzip {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] compute_api_class              = cinder.compute.nova.API {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] config_dir                     = [] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] config_source                  = [] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] control_exchange               = openstack {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] debug                          = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] default_availability_zone      = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] default_group_type             = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] default_volume_type            = lvmdriver-1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] disk_geometry                  = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] driver_client_cert             = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] driver_client_cert_key         = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] driver_data_namespace          = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] driver_ssl_cert_path           = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] driver_ssl_cert_verify         = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] driver_use_ssl                 = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] enable_force_upload            = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] enable_new_services            = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] enable_unsupported_driver      = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] enforce_multipath_for_image_xfer = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] filter_function                = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] glance_api_insecure            = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] glance_api_servers             = ['http://192.168.122.155/image'] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] glance_api_ssl_compression     = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] glance_ca_certificates_file    = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] glance_catalog_info            = image:glance:publicURL {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] glance_certfile                = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] glance_keyfile                 = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] glance_num_retries             = 3 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] glance_request_timeout         = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] goodness_function              = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] graceful_shutdown_timeout      = 5 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] group_api_class                = cinder.group.api.API {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] host                           = devstack {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] image_compress_on_upload       = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] image_conversion_address_space_limit = 1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] image_conversion_cpu_limit     = 60 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] image_conversion_disable       = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] image_introspection_address_space_limit = 1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] image_introspection_cpu_limit  = 60 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] image_upload_use_cinder_backend = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] image_upload_use_internal_tenant = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] image_volume_cache_enabled     = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] image_volume_cache_max_count   = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] image_volume_cache_max_size_gb = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] init_host_max_objects_retrieval = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] iscsi_target_flags             =  {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] iscsi_write_cache              = on {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] iser_helper                    = tgtadm {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] iser_ip_address                = 192.168.122.155 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] iser_port                      = 3260 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] log_color                      = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] log_config_append              = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] log_dir                        = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] log_file                       = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] log_options                    = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75920]: INFO cinder.volume.manager [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Nov 06 16:56:47 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] log_rotate_interval            = 1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] log_rotate_interval_type       = days {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] log_rotation_type              = none {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] max_age                        = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] max_logfile_count              = 30 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] max_logfile_size_mb            = 200 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] max_over_subscription_ratio    = 20.0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] message_reap_interval          = 86400 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] message_ttl                    = 2592000 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] migration_create_volume_timeout_secs = 300 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] monkey_patch                   = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] monkey_patch_modules           = [] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] my_ip                          = 192.168.122.155 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] no_snapshot_gb_quota           = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] num_iser_scan_tries            = 3 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] num_shell_tries                = 3 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] num_volume_device_scan_tries   = 3 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] nvmeof_conn_info_version       = 1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] nvmet_ns_id                    = 10 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] nvmet_port_id                  = 1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] osapi_max_limit                = 1000 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] osapi_volume_ext_list          = [] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:56:47 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] osapi_volume_listen_port       = 8776 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] osapi_volume_use_ssl           = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] osapi_volume_workers           = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] per_volume_size_limit          = -1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] periodic_fuzzy_delay           = 60 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] periodic_interval              = 60 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] public_endpoint                = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] publish_errors                 = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] quota_backup_gigabytes         = 1000 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] quota_backups                  = 10 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] quota_gigabytes                = 1000 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] quota_groups                   = 10 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] quota_snapshots                = 10 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] quota_volumes                  = 10 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] rate_limit_burst               = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] rate_limit_except_level        = CRITICAL {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] rate_limit_interval            = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] reinit_driver_count            = 3 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] replication_device             = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] report_discard_supported       = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] report_interval                = 120 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] reservation_clean_interval     = 86400 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] reservation_expire             = 86400 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] reserved_image_namespaces      = [] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] reserved_percentage            = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] rpc_response_timeout           = 120 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] run_external_periodic_tasks    = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] scst_target_driver             = iscsi {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] scst_target_iqn_name           = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] service_down_time              = 720 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] shell_completion               = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] snapshot_name_template         = snapshot-%s {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] snapshot_same_host             = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] split_loggers                  = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] state_path                     = /opt/stack/data/cinder {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] storage_availability_zone      = nova {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] storage_protocol               = iSCSI {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] syslog_log_facility            = LOG_USER {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] target_helper                  = lioadm {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] target_ip_address              = 192.168.122.155 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] target_port                    = 3260 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] target_protocol                = iscsi {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] target_secondary_ip_addresses  = [] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] trace_flags                    = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack sudo[75924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] transport_url                  = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack sudo[75924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] until_refresh                  = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] use_chap_auth                  = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] use_default_quota_class        = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] use_journal                    = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] use_json                       = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] use_multipath_for_image_xfer   = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] use_stderr                     = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] use_syslog                     = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] verify_glance_signatures       = enabled {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] volume_api_class               = cinder.volume.api.API {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] volume_backend_name            = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] volume_clear                   = zero {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] volume_clear_ionice            = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] volume_clear_size              = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] volume_copy_bps_limit          = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] volume_dd_blocksize            = 1M {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] volume_name_template           = volume-%s {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] volume_service_inithost_offload = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] volume_usage_audit_period      = month {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] zoning_mode                    = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_concurrency.disable_process_locking = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] keystone_authtoken.auth_section = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] keystone_authtoken.auth_type   = password {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] keystone_authtoken.auth_version = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] keystone_authtoken.cache       = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] keystone_authtoken.certfile    = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] keystone_authtoken.include_service_catalog = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] keystone_authtoken.insecure    = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] keystone_authtoken.interface   = public {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] keystone_authtoken.keyfile     = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] keystone_authtoken.memcache_password = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] keystone_authtoken.memcache_username = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] keystone_authtoken.region_name = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] keystone_authtoken.service_type = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.155/identity {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cache.backend                  = dogpile.cache.null {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cache.backend_argument         = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cache.backend_expiration_time  = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cache.config_prefix            = cache.oslo {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cache.debug_cache_backend      = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cache.enable_retry_client      = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cache.enable_socket_keepalive  = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cache.enabled                  = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cache.expiration_time          = 600 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cache.hashclient_retry_attempts = 2 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cache.memcache_dead_retry      = 300 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cache.memcache_sasl_enabled    = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cache.password                 = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cache.proxies                  = [] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cache.redis_db                 = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cache.redis_server             = localhost:6379 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cache.retry_attempts           = 2 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cache.retry_delay              = 0.0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cache.socket_keepalive_count   = 1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cache.socket_keepalive_idle    = 1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cache.socket_keepalive_interval = 1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cache.socket_timeout           = 1.0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cache.tls_allowed_ciphers      = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cache.tls_cafile               = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cache.tls_certfile             = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cache.tls_enabled              = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cache.tls_keyfile              = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cache.username                 = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] coordination.backend_url       = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] database.asyncio_connection    = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] database.asyncio_slave_connection = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] database.backend               = sqlalchemy {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] database.connection            = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] database.connection_debug      = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] database.connection_parameters =  {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] database.connection_recycle_time = 3600 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] database.connection_trace      = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] database.db_inc_retry_interval = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] database.db_max_retries        = 20 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] database.db_max_retry_interval = 10 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] database.db_retry_interval     = 1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] database.max_overflow          = 50 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] database.max_pool_size         = 5 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] database.max_retries           = 10 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] database.mysql_wsrep_sync_wait = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] database.pool_timeout          = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] database.retry_interval        = 10 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] database.slave_connection      = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] database.sqlite_synchronous    = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] database.synchronous_reader    = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] database.use_db_reconnect      = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_tracing.insecure = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] profiler.connection_string     = messaging:// {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] profiler.enabled               = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] profiler.es_doc_type           = notification {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] profiler.es_scroll_size        = 10000 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] profiler.es_scroll_time        = 2m {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] profiler.filter_error_trace    = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] profiler.hmac_keys             = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] profiler.sentinel_service_name = mymaster {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] profiler.socket_timeout        = 0.1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] profiler.trace_requests        = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] profiler.trace_sqlalchemy      = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] profiler_jaeger.process_tags   = {} {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] profiler_jaeger.service_name_prefix = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] profiler_otlp.service_name_prefix = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_policy.enforce_new_defaults = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_policy.policy_default_rule = default {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] privsep_osbrick.group          = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] privsep_osbrick.helper_command = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] privsep_osbrick.user           = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cinder_sys_admin.group         = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cinder_sys_admin.helper_command = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] cinder_sys_admin.user          = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] service_user.auth_section      = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] service_user.auth_type         = password {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] service_user.cafile            = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] service_user.certfile          = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] service_user.collect_timing    = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] service_user.insecure          = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] service_user.keyfile           = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] service_user.send_service_user_token = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] service_user.split_loggers     = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] service_user.timeout           = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] service_user.tls_ciphers       = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] service_user.tls_min_version   = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] glance.auth_section            = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] glance.auth_type               = password {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] glance.certfile                = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] glance.collect_timing          = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] glance.insecure                = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] glance.keyfile                 = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] glance.region_name             = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] glance.split_loggers           = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] glance.timeout                 = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] glance.tls_ciphers             = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] glance.tls_min_version         = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.backend_availability_zone = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.chap_password = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.chap_username =  {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.disk_geometry = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.driver_client_cert = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.driver_client_cert_key = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.driver_data_namespace = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.driver_use_ssl = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.extra_capabilities = {} {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.filter_function = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.goodness_function = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.iscsi_target_flags =  {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.iscsi_write_cache = on {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.iser_helper   = tgtadm {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.iser_ip_address = 192.168.122.155 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.iser_port     = 3260 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.lvm_share_target = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.lvm_type      = auto {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.num_shell_tries = 3 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.replication_device = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.report_discard_supported = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.reserved_percentage = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.target_helper = tgtadm {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.target_ip_address = 192.168.122.155 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.target_port   = 3260 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.target_protocol = iscsi {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.trace_flags   = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.unique_fqdn_network = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.use_chap_auth = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.volume_backend_name = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.volume_clear  = zero {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.volume_clear_ionice = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.volume_clear_size = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_reports.file_event_handler = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_reports.log_dir           = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.backend_host       = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.chap_password      = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.chap_username      = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.disk_geometry      = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.driver_client_cert = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.extra_capabilities = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.filter_function    = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.goodness_function  = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.iser_helper        = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.iser_ip_address    = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.iser_port          = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.lvm_share_target   = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.lvm_type           = auto {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.num_shell_tries    = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.replication_device = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.report_discard_supported = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.reserved_percentage = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.scst_target_driver = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.storage_protocol   = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.target_helper      = lioadm {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.target_ip_address  = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.target_port        = 3260 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.trace_flags        = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.use_chap_auth      = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.volume_clear       = zero {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.volume_clear_size  = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] lvmdriver-1.volumes_dir        = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_notifications.driver = [] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_notifications.retry = -1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] key_manager.fixed_key          = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] barbican.barbican_api_version  = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] barbican.barbican_endpoint     = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] barbican.barbican_endpoint_type = public {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] barbican.barbican_region_name  = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] barbican.cafile                = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] barbican.certfile              = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] barbican.collect_timing        = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] barbican.insecure              = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] barbican.keyfile               = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] barbican.number_of_retries     = 60 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] barbican.retry_delay           = 1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] barbican.send_service_user_token = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] barbican.split_loggers         = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] barbican.timeout               = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] barbican.tls_ciphers           = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] barbican.tls_min_version       = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] barbican.verify_ssl            = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] barbican.verify_ssl_path       = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] barbican_service_user.auth_section = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] barbican_service_user.auth_type = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] barbican_service_user.cafile   = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] barbican_service_user.certfile = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] barbican_service_user.collect_timing = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] barbican_service_user.insecure = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] barbican_service_user.keyfile  = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] barbican_service_user.split_loggers = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] barbican_service_user.timeout  = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] barbican_service_user.tls_ciphers = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] barbican_service_user.tls_min_version = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] vault.approle_role_id          = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] vault.approle_secret_id        = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] vault.auth_method              = approle {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] vault.auth_path                = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] vault.kv_mountpoint            = secret {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] vault.kv_path                  = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] vault.kv_version               = 2 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] vault.namespace                = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] vault.root_token_id            = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] vault.ssl_ca_crt_file          = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] vault.timeout                  = 60.0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] vault.token_file               = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] vault.token_role               = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] vault.use_ssl                  = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 16:56:47 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] ******************************************************************************** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 06 16:56:47 devstack sudo[75924]: pam_unix(sudo:session): session closed for user root
Nov 06 16:56:47 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.329s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:56:47 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:56:47 devstack sudo[75929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 06 16:56:47 devstack sudo[75929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 16:56:48 devstack sudo[75929]: pam_unix(sudo:session): session closed for user root
Nov 06 16:56:48 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.366s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:56:48 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 16:56:48 devstack cinder-volume[75920]: INFO cinder.brick.local_dev.lvm [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Nov 06 16:56:48 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:56:48 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:56:48 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:56:48 devstack sudo[76028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 06 16:56:48 devstack sudo[76028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 16:56:48 devstack sudo[76028]: pam_unix(sudo:session): session closed for user root
Nov 06 16:56:48 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:56:48 devstack cinder-volume[75920]: DEBUG cinder.brick.local_dev.lvm [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75920) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Nov 06 16:56:48 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:56:48 devstack sudo[76136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 06 16:56:48 devstack sudo[76136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 16:56:48 devstack sudo[76136]: pam_unix(sudo:session): session closed for user root
Nov 06 16:56:48 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.515s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:56:48 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:56:48 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:56:49 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:56:49 devstack sudo[76330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 06 16:56:49 devstack sudo[76330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 16:56:49 devstack sudo[76330]: pam_unix(sudo:session): session closed for user root
Nov 06 16:56:49 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:56:49 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:56:49 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:56:49 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:56:49 devstack sudo[76421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Nov 06 16:56:49 devstack sudo[76421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 16:56:49 devstack sudo[76421]: pam_unix(sudo:session): session closed for user root
Nov 06 16:56:49 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.258s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:56:49 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:56:49 devstack sudo[76516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 06 16:56:49 devstack sudo[76516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 16:56:49 devstack sudo[76516]: pam_unix(sudo:session): session closed for user root
Nov 06 16:56:49 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:56:49 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:56:49 devstack sudo[76544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 06 16:56:49 devstack sudo[76544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 16:56:50 devstack sudo[76544]: pam_unix(sudo:session): session closed for user root
Nov 06 16:56:50 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:56:50 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:56:50 devstack sudo[76597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 16:56:50 devstack sudo[76597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 16:56:50 devstack sudo[76597]: pam_unix(sudo:session): session closed for user root
Nov 06 16:56:50 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.303s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:56:50 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:56:50 devstack sudo[76633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 06 16:56:50 devstack sudo[76633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 16:56:50 devstack sudo[76633]: pam_unix(sudo:session): session closed for user root
Nov 06 16:56:50 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:56:50 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:56:50 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:56:50 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:56:50 devstack sudo[76643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 06 16:56:50 devstack sudo[76643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 16:56:51 devstack sudo[76643]: pam_unix(sudo:session): session closed for user root
Nov 06 16:56:51 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.296s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:56:51 devstack cinder-volume[75920]: INFO cinder.volume.drivers.lvm [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Nov 06 16:56:51 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:56:51 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:56:51 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:56:51 devstack sudo[76727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 06 16:56:51 devstack sudo[76727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 16:56:51 devstack sudo[76727]: pam_unix(sudo:session): session closed for user root
Nov 06 16:56:51 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.328s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:56:51 devstack cinder-volume[75920]: DEBUG cinder.volume.drivers.lvm [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Updating volume stats {{(pid=75920) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 06 16:56:51 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:56:51 devstack sudo[76730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 06 16:56:51 devstack sudo[76730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 16:56:51 devstack sudo[76730]: pam_unix(sudo:session): session closed for user root
Nov 06 16:56:51 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:56:51 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:56:51 devstack sudo[76739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 16:56:51 devstack sudo[76739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 16:56:51 devstack sudo[76739]: pam_unix(sudo:session): session closed for user root
Nov 06 16:56:51 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:56:51 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:56:51 devstack sudo[76742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 06 16:56:51 devstack sudo[76742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 16:56:52 devstack sudo[76742]: pam_unix(sudo:session): session closed for user root
Nov 06 16:56:52 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.319s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:56:52 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:56:52 devstack sudo[76745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 16:56:52 devstack sudo[76745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 16:56:52 devstack sudo[76745]: pam_unix(sudo:session): session closed for user root
Nov 06 16:56:52 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:56:52 devstack cinder-volume[75920]: INFO cinder.volume.driver [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Driver hasn't implemented _init_vendor_properties()
Nov 06 16:56:52 devstack cinder-volume[75920]: DEBUG cinder.volume.driver [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75920) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 06 16:56:52 devstack cinder-volume[75920]: DEBUG oslo_db.sqlalchemy.engines [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75920) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 06 16:56:52 devstack cinder-volume[75920]: DEBUG dbcounter [-] [75920] Writer thread running {{(pid=75920) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 06 16:56:52 devstack cinder-volume[75920]: DEBUG cinder.db.api [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Building query based on filter {{(pid=75920) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Nov 06 16:56:52 devstack cinder-volume[75920]: DEBUG cinder.image.image_utils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75920) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 06 16:56:52 devstack cinder-volume[75920]: INFO cinder.keymgr.migration [None req-a37ea5c3-af59-420c-ba08-1438fd8fa97a None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 06 16:56:52 devstack cinder-volume[75920]: DEBUG cinder.volume.drivers.lvm [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Updating volume stats {{(pid=75920) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 06 16:56:52 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:56:52 devstack sudo[76749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 06 16:56:52 devstack sudo[76749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 16:56:52 devstack sudo[76749]: pam_unix(sudo:session): session closed for user root
Nov 06 16:56:52 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:56:52 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:56:52 devstack sudo[76752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 16:56:52 devstack sudo[76752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 16:56:53 devstack sudo[76752]: pam_unix(sudo:session): session closed for user root
Nov 06 16:56:53 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:56:53 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:56:53 devstack sudo[76757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 06 16:56:53 devstack sudo[76757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 16:56:53 devstack sudo[76757]: pam_unix(sudo:session): session closed for user root
Nov 06 16:56:53 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:56:53 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:56:53 devstack sudo[76761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 16:56:53 devstack sudo[76761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 16:56:53 devstack sudo[76761]: pam_unix(sudo:session): session closed for user root
Nov 06 16:56:53 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:56:53 devstack cinder-volume[75920]: DEBUG cinder.manager [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Notifying Schedulers of capabilities ... {{(pid=75920) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 16:56:53 devstack cinder-volume[75920]: INFO cinder.volume.manager [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Driver initialization completed successfully.
Nov 06 16:56:53 devstack cinder-volume[75920]: INFO cinder.manager [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Initiating service 2 cleanup
Nov 06 16:56:53 devstack cinder-volume[75920]: INFO cinder.manager [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Service 2 cleanup completed.
Nov 06 16:56:53 devstack cinder-volume[75920]: DEBUG cinder.service [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Creating RPC server for service cinder-volume {{(pid=75920) start /opt/stack/cinder/cinder/service.py:231}}
Nov 06 16:56:53 devstack cinder-volume[75920]: DEBUG cinder.service [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75920) start /opt/stack/cinder/cinder/service.py:237}}
Nov 06 16:56:54 devstack cinder-volume[75920]: INFO cinder.volume.manager [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Nov 06 16:56:54 devstack cinder-volume[75920]: DEBUG cinder.volume.drivers.lvm [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Updating volume stats {{(pid=75920) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 06 16:56:54 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:56:54 devstack sudo[76764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 06 16:56:54 devstack sudo[76764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 16:56:54 devstack sudo[76764]: pam_unix(sudo:session): session closed for user root
Nov 06 16:56:54 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:56:54 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:56:54 devstack sudo[76769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 16:56:54 devstack sudo[76769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 16:56:54 devstack sudo[76769]: pam_unix(sudo:session): session closed for user root
Nov 06 16:56:54 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.300s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:56:54 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:56:54 devstack sudo[76772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 06 16:56:54 devstack sudo[76772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 16:56:54 devstack sudo[76772]: pam_unix(sudo:session): session closed for user root
Nov 06 16:56:54 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:56:54 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:56:54 devstack sudo[76778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 16:56:54 devstack sudo[76778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 16:56:55 devstack sudo[76778]: pam_unix(sudo:session): session closed for user root
Nov 06 16:56:55 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:56:55 devstack cinder-volume[75920]: INFO cinder.volume.manager [None req-0f1b021e-3fc5-48da-914c-8fa761af4887 None None] Driver post RPC initialization completed successfully.
Nov 06 16:56:57 devstack cinder-volume[75769]: DEBUG dbcounter [-] [75769] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 16:56:58 devstack cinder-volume[75920]: DEBUG oslo_service.periodic_task [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] Running periodic task VolumeManager._thread_info {{(pid=75920) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 16:56:58 devstack cinder-volume[75920]: DEBUG cinder.volume.manager [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] thread count: 6 {{(pid=75920) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 16:56:58 devstack cinder-volume[75920]: DEBUG cinder.volume.manager [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] thread info: [<_MainThread(MainThread, started 126737532465280)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126737420844032)>, <Thread(Thread-3 (stat_writer), started daemon 126737416311936)>, <Thread(Rabbit-heartbeat, started daemon 126737416866496)>, <Thread(Thread-5 (_runner), started daemon 126737416916800)>, <Thread(Thread-7 (_runner), started daemon 126737414979712)>] {{(pid=75920) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 16:57:02 devstack cinder-volume[75920]: DEBUG dbcounter [-] [75920] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75920) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 16:57:05 devstack cinder-volume[75920]: DEBUG dbcounter [-] [75920] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=75920) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 16:57:58 devstack cinder-volume[75920]: DEBUG oslo_service.periodic_task [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75920) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 16:57:58 devstack cinder-volume[75920]: DEBUG cinder.volume.drivers.lvm [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] Updating volume stats {{(pid=75920) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 06 16:57:58 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:57:58 devstack sudo[78736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 06 16:57:58 devstack sudo[78736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 16:57:58 devstack sudo[78736]: pam_unix(sudo:session): session closed for user root
Nov 06 16:57:58 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:57:58 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:57:58 devstack sudo[78739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 16:57:58 devstack sudo[78739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 16:57:58 devstack sudo[78739]: pam_unix(sudo:session): session closed for user root
Nov 06 16:57:58 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:57:58 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:57:58 devstack sudo[78840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 06 16:57:58 devstack sudo[78840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 16:57:58 devstack sudo[78840]: pam_unix(sudo:session): session closed for user root
Nov 06 16:57:58 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:57:58 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:57:58 devstack sudo[78843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 16:57:58 devstack sudo[78843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 16:57:59 devstack sudo[78843]: pam_unix(sudo:session): session closed for user root
Nov 06 16:57:59 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:57:59 devstack cinder-volume[75920]: DEBUG cinder.manager [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] Notifying Schedulers of capabilities ... {{(pid=75920) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 16:57:59 devstack cinder-volume[75920]: DEBUG oslo_service.periodic_task [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] Running periodic task VolumeManager._thread_info {{(pid=75920) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 16:57:59 devstack cinder-volume[75920]: DEBUG cinder.volume.manager [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] thread count: 6 {{(pid=75920) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 16:57:59 devstack cinder-volume[75920]: DEBUG cinder.volume.manager [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] thread info: [<_MainThread(MainThread, started 126737532465280)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126737420844032)>, <Thread(Thread-3 (stat_writer), started daemon 126737416311936)>, <Thread(Rabbit-heartbeat, started daemon 126737416866496)>, <Thread(Thread-5 (_runner), started daemon 126737416916800)>, <Thread(Thread-7 (_runner), started daemon 126737414979712)>] {{(pid=75920) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 16:58:58 devstack cinder-volume[75920]: DEBUG oslo_service.periodic_task [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75920) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 16:58:58 devstack cinder-volume[75920]: DEBUG cinder.volume.drivers.lvm [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] Updating volume stats {{(pid=75920) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 06 16:58:58 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:58:58 devstack sudo[82135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 06 16:58:58 devstack sudo[82135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 16:58:58 devstack sudo[82135]: pam_unix(sudo:session): session closed for user root
Nov 06 16:58:58 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:58:58 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:58:58 devstack sudo[82154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 16:58:58 devstack sudo[82154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 16:58:58 devstack sudo[82154]: pam_unix(sudo:session): session closed for user root
Nov 06 16:58:58 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:58:58 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:58:58 devstack sudo[82157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 06 16:58:58 devstack sudo[82157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 16:58:58 devstack sudo[82157]: pam_unix(sudo:session): session closed for user root
Nov 06 16:58:58 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:58:58 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:58:58 devstack sudo[82160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 16:58:58 devstack sudo[82160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 16:58:59 devstack sudo[82160]: pam_unix(sudo:session): session closed for user root
Nov 06 16:58:59 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:58:59 devstack cinder-volume[75920]: DEBUG cinder.manager [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] Notifying Schedulers of capabilities ... {{(pid=75920) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 16:58:59 devstack cinder-volume[75920]: DEBUG oslo_service.periodic_task [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] Running periodic task VolumeManager._thread_info {{(pid=75920) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 16:58:59 devstack cinder-volume[75920]: DEBUG cinder.volume.manager [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] thread count: 6 {{(pid=75920) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 16:58:59 devstack cinder-volume[75920]: DEBUG cinder.volume.manager [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] thread info: [<_MainThread(MainThread, started 126737532465280)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126737420844032)>, <Thread(Thread-3 (stat_writer), started daemon 126737416311936)>, <Thread(Rabbit-heartbeat, started daemon 126737416866496)>, <Thread(Thread-5 (_runner), started daemon 126737416916800)>, <Thread(Thread-7 (_runner), started daemon 126737414979712)>] {{(pid=75920) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 16:59:05 devstack cinder-volume[75920]: DEBUG dbcounter [-] [75920] Writing DB stats cinder:SELECT=1 {{(pid=75920) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 16:59:05 devstack cinder-volume[75920]: DEBUG dbcounter [-] [75920] Writing DB stats cinder:UPDATE=1 {{(pid=75920) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 16:59:58 devstack cinder-volume[75920]: DEBUG oslo_service.periodic_task [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75920) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 16:59:58 devstack cinder-volume[75920]: DEBUG cinder.volume.drivers.lvm [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] Updating volume stats {{(pid=75920) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 06 16:59:58 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:59:58 devstack sudo[84304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 06 16:59:58 devstack sudo[84304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 16:59:58 devstack sudo[84304]: pam_unix(sudo:session): session closed for user root
Nov 06 16:59:58 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:59:58 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:59:58 devstack sudo[84308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 16:59:58 devstack sudo[84308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 16:59:58 devstack sudo[84308]: pam_unix(sudo:session): session closed for user root
Nov 06 16:59:58 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:59:58 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:59:58 devstack sudo[84311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 06 16:59:58 devstack sudo[84311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 16:59:58 devstack sudo[84311]: pam_unix(sudo:session): session closed for user root
Nov 06 16:59:58 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:59:58 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 16:59:59 devstack sudo[84329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 16:59:59 devstack sudo[84329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 16:59:59 devstack sudo[84329]: pam_unix(sudo:session): session closed for user root
Nov 06 16:59:59 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 16:59:59 devstack cinder-volume[75920]: DEBUG cinder.manager [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] Notifying Schedulers of capabilities ... {{(pid=75920) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 16:59:59 devstack cinder-volume[75920]: DEBUG oslo_service.periodic_task [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] Running periodic task VolumeManager._thread_info {{(pid=75920) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 16:59:59 devstack cinder-volume[75920]: DEBUG cinder.volume.manager [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] thread count: 6 {{(pid=75920) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 16:59:59 devstack cinder-volume[75920]: DEBUG cinder.volume.manager [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] thread info: [<_MainThread(MainThread, started 126737532465280)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126737420844032)>, <Thread(Thread-3 (stat_writer), started daemon 126737416311936)>, <Thread(Rabbit-heartbeat, started daemon 126737416866496)>, <Thread(Thread-5 (_runner), started daemon 126737416916800)>, <Thread(Thread-7 (_runner), started daemon 126737414979712)>] {{(pid=75920) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 17:00:58 devstack cinder-volume[75920]: DEBUG oslo_service.periodic_task [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75920) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:00:58 devstack cinder-volume[75920]: DEBUG cinder.volume.drivers.lvm [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] Updating volume stats {{(pid=75920) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 06 17:00:58 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:00:58 devstack sudo[85556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 06 17:00:58 devstack sudo[85556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:00:58 devstack sudo[85556]: pam_unix(sudo:session): session closed for user root
Nov 06 17:00:58 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:00:58 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:00:58 devstack sudo[85559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 17:00:58 devstack sudo[85559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:00:58 devstack sudo[85559]: pam_unix(sudo:session): session closed for user root
Nov 06 17:00:58 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:00:58 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:00:58 devstack sudo[85563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 06 17:00:58 devstack sudo[85563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:00:58 devstack sudo[85563]: pam_unix(sudo:session): session closed for user root
Nov 06 17:00:58 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:00:58 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:00:59 devstack sudo[85566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 17:00:59 devstack sudo[85566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:00:59 devstack sudo[85566]: pam_unix(sudo:session): session closed for user root
Nov 06 17:00:59 devstack cinder-volume[75920]: DEBUG oslo_concurrency.processutils [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75920) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:00:59 devstack cinder-volume[75920]: DEBUG cinder.manager [None req-74f957c4-01dd-41ee-8859-8086571625c2 None None] Notifying Schedulers of capabilities ... {{(pid=75920) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:01:05 devstack cinder-volume[75920]: DEBUG dbcounter [-] [75920] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75920) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:01:11 devstack cinder-volume[75769]: INFO oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] Caught SIGTERM, stopping children
Nov 06 17:01:11 devstack cinder-volume[75769]: DEBUG oslo_concurrency.lockutils [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] Acquiring lock "singleton_lock" {{(pid=75769) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 06 17:01:11 devstack cinder-volume[75769]: DEBUG oslo_concurrency.lockutils [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] Acquired lock "singleton_lock" {{(pid=75769) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 06 17:01:11 devstack cinder-volume[75769]: DEBUG oslo_concurrency.lockutils [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] Releasing lock "singleton_lock" {{(pid=75769) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 06 17:01:11 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] Stop services. {{(pid=75769) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 06 17:01:11 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] Killing children. {{(pid=75769) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 06 17:01:11 devstack cinder-volume[75769]: INFO oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] Waiting on 1 children to exit
Nov 06 17:01:13 devstack cinder-volume[75920]: DEBUG oslo_concurrency.lockutils [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] Acquiring lock "singleton_lock" {{(pid=75920) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 06 17:01:13 devstack cinder-volume[75920]: DEBUG oslo_concurrency.lockutils [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] Acquired lock "singleton_lock" {{(pid=75920) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 06 17:01:13 devstack cinder-volume[75920]: DEBUG oslo_concurrency.lockutils [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] Releasing lock "singleton_lock" {{(pid=75920) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 06 17:01:14 devstack cinder-volume[75920]: WARNING amqp [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 06 17:01:14 devstack cinder-volume[75920]: WARNING amqp [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 06 17:01:14 devstack cinder-volume[75769]: INFO oslo_service.backend._eventlet.service [None req-cd58dba3-2639-4dfc-9e08-87d603b13041 None None] Child 75920 exited with status 0
Nov 06 17:01:14 devstack cinder-volume[85975]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 06 17:01:14 devstack cinder-volume[85975]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 06 17:01:14 devstack cinder-volume[85975]: we strongly recommend against using it for new projects.
Nov 06 17:01:14 devstack cinder-volume[85975]: If you are already using Eventlet, we recommend migrating to a different
Nov 06 17:01:14 devstack cinder-volume[85975]: framework.  For more detail see
Nov 06 17:01:14 devstack cinder-volume[85975]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 06 17:01:14 devstack cinder-volume[85975]:   import eventlet  # noqa
Nov 06 17:01:16 devstack cinder-volume[85975]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85975) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 06 17:01:16 devstack cinder-volume[85975]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85975) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 06 17:01:16 devstack cinder-volume[85975]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85975) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 06 17:01:17 devstack cinder-volume[85975]: INFO dbcounter [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] Registered counter for database cinder
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_db.sqlalchemy.engines [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85975) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG dbcounter [-] [85975] Writer thread running {{(pid=85975) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 06 17:01:17 devstack cinder-volume[85975]: INFO cinder.rpc [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 06 17:01:17 devstack cinder-volume[85975]: INFO cinder.rpc [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_db.sqlalchemy.engines [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85975) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 06 17:01:17 devstack cinder-volume[85975]: INFO cinder.volume.manager [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] Determined volume DB was empty at startup.
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG cinder.volume.manager [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85975) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 06 17:01:17 devstack cinder-volume[85975]: INFO cinder.volume.manager [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 06 17:01:17 devstack cinder-volume[85975]: WARNING stevedore.named [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 06 17:01:17 devstack cinder-volume[85975]: WARNING castellan.key_manager [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 06 17:01:17 devstack cinder-volume[85975]: WARNING cinder.keymgr.conf_key_mgr [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 06 17:01:17 devstack cinder-volume[85975]: INFO cinder.volume.manager [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_db.sqlalchemy.engines [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85975) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 06 17:01:17 devstack cinder-volume[85975]: INFO oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] Starting 1 workers
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] Started child 86193 {{(pid=85975) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] Full set of CONF: {{(pid=85975) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] ******************************************************************************** {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] Configuration options gathered from: {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] ================================================================================ {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] allow_availability_zone_fallback = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] allow_compression_on_image_upload = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] allowed_direct_url_schemes     = [] {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] api_rate_limit                 = True {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] auth_strategy                  = keystone {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_availability_zone      = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_host                   = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_name                   = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_stats_polling_interval = 60 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backup_api_class               = cinder.backup.api.API {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backup_name_template           = backup-%s {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backup_use_same_host           = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backup_use_temp_snapshot       = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] chap_password                  = **** {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] chap_username                  =  {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[86193]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1)
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cinder_internal_tenant_project_id = 608b360473534ab0ba5d4d55f557d676 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cinder_internal_tenant_user_id = 5a905badb8824f72856bf9fd231afb51 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cluster                        = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] compression_format             = gzip {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] compute_api_class              = cinder.compute.nova.API {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] config_dir                     = [] {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] config_source                  = [] {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] control_exchange               = openstack {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] debug                          = True {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] default_availability_zone      = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] default_group_type             = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] default_volume_type            = QuobyteHD {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] disk_geometry                  = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] driver_client_cert             = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] driver_client_cert_key         = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] driver_data_namespace          = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] driver_ssl_cert_path           = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] driver_ssl_cert_verify         = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] driver_use_ssl                 = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] enable_new_services            = True {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] enable_unsupported_driver      = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] enabled_backends               = ['QuobyteHD'] {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] enforce_multipath_for_image_xfer = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] filter_function                = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] glance_api_insecure            = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] glance_api_servers             = ['http://192.168.122.155/image'] {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] glance_api_ssl_compression     = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] glance_ca_certificates_file    = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] glance_catalog_info            = image:glance:publicURL {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] glance_certfile                = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] glance_keyfile                 = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] glance_num_retries             = 3 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] glance_request_timeout         = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] goodness_function              = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] graceful_shutdown_timeout      = 5 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] group_api_class                = cinder.group.api.API {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] host                           = devstack {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] image_compress_on_upload       = True {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] image_conversion_address_space_limit = 1 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] image_conversion_cpu_limit     = 60 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] image_conversion_disable       = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] image_introspection_address_space_limit = 1 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] image_introspection_cpu_limit  = 60 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] image_upload_use_cinder_backend = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] image_upload_use_internal_tenant = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] image_volume_cache_enabled     = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] image_volume_cache_max_count   = 0 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] image_volume_cache_max_size_gb = 0 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] init_host_max_objects_retrieval = 0 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] instance_format                = [instance: %(uuid)s]  {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] iscsi_target_flags             =  {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] iscsi_write_cache              = on {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] iser_helper                    = tgtadm {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] iser_ip_address                = 192.168.122.155 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] iser_port                      = 3260 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] log_color                      = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] log_config_append              = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] log_dir                        = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] log_file                       = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] log_options                    = True {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] log_rotate_interval            = 1 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] log_rotate_interval_type       = days {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] log_rotation_type              = none {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] max_age                        = 0 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] max_logfile_count              = 30 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] max_logfile_size_mb            = 200 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] max_over_subscription_ratio    = 20.0 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] message_reap_interval          = 86400 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] message_ttl                    = 2592000 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] migration_create_volume_timeout_secs = 300 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] monkey_patch                   = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] Starting volume driver QuobyteDriver (1.2.1)
Nov 06 17:01:17 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86193) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] monkey_patch_modules           = [] {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] my_ip                          = 192.168.122.155 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] no_snapshot_gb_quota           = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] num_iser_scan_tries            = 3 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] num_shell_tries                = 3 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] num_volume_device_scan_tries   = 3 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] nvmeof_conn_info_version       = 1 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] nvmet_ns_id                    = 10 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] nvmet_port_id                  = 1 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] osapi_max_limit                = 1000 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] osapi_volume_ext_list          = [] {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] osapi_volume_listen_port       = 8776 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] osapi_volume_use_ssl           = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] osapi_volume_workers           = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] per_volume_size_limit          = -1 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] periodic_fuzzy_delay           = 60 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] periodic_interval              = 60 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] public_endpoint                = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] publish_errors                 = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] quota_backup_gigabytes         = 1000 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] quota_backups                  = 10 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] quota_gigabytes                = 1000 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] quota_groups                   = 10 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] quota_snapshots                = 10 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] quota_volumes                  = 10 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] rate_limit_burst               = 0 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] rate_limit_except_level        = CRITICAL {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] rate_limit_interval            = 0 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] reinit_driver_count            = 3 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] replication_device             = **** {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] report_discard_supported       = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] report_interval                = 120 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] reservation_clean_interval     = 86400 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] reservation_expire             = 86400 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] reserved_image_namespaces      = [] {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] reserved_percentage            = 0 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] rpc_response_timeout           = 120 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] run_external_periodic_tasks    = True {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] scst_target_driver             = iscsi {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] scst_target_iqn_name           = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] service_down_time              = 720 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] shell_completion               = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] snapshot_name_template         = snapshot-%s {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] split_loggers                  = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] state_path                     = /opt/stack/data/cinder {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] storage_availability_zone      = nova {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] storage_protocol               = iSCSI {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] syslog_log_facility            = LOG_USER {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] target_helper                  = lioadm {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] target_ip_address              = 192.168.122.155 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] target_port                    = 3260 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] target_protocol                = iscsi {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] target_secondary_ip_addresses  = [] {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] trace_flags                    = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] transport_url                  = **** {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] until_refresh                  = 0 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] use_chap_auth                  = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] use_default_quota_class        = True {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] use_journal                    = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] use_json                       = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] use_multipath_for_image_xfer   = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] use_stderr                     = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] use_syslog                     = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] verify_glance_signatures       = enabled {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] volume_api_class               = cinder.volume.api.API {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] volume_backend_name            = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] volume_clear                   = zero {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] volume_clear_ionice            = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] volume_clear_size              = 0 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] volume_copy_bps_limit          = 0 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] volume_dd_blocksize            = 1M {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:17 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] volume_name_template           = volume-%s {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] volume_service_inithost_offload = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] volume_usage_audit_period      = month {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] zoning_mode                    = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_concurrency.disable_process_locking = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] keystone_authtoken.auth_section = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] keystone_authtoken.auth_type   = password {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] keystone_authtoken.auth_version = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] keystone_authtoken.cache       = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] keystone_authtoken.certfile    = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] keystone_authtoken.include_service_catalog = True {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] keystone_authtoken.insecure    = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] keystone_authtoken.interface   = public {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] keystone_authtoken.keyfile     = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] keystone_authtoken.memcache_password = **** {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] keystone_authtoken.memcache_username = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] keystone_authtoken.region_name = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] keystone_authtoken.service_type = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.155/identity {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cache.backend                  = dogpile.cache.null {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cache.backend_argument         = **** {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cache.backend_expiration_time  = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cache.config_prefix            = cache.oslo {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cache.debug_cache_backend      = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cache.enable_retry_client      = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cache.enable_socket_keepalive  = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cache.enabled                  = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cache.expiration_time          = 600 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cache.hashclient_retry_attempts = 2 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cache.memcache_dead_retry      = 300 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cache.memcache_pool_maxsize    = 10 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cache.memcache_sasl_enabled    = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cache.password                 = **** {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cache.proxies                  = [] {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cache.redis_db                 = 0 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cache.redis_server             = localhost:6379 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cache.retry_attempts           = 2 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cache.retry_delay              = 0.0 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cache.socket_keepalive_count   = 1 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cache.socket_keepalive_idle    = 1 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cache.socket_keepalive_interval = 1 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cache.socket_timeout           = 1.0 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cache.tls_allowed_ciphers      = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cache.tls_cafile               = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cache.tls_certfile             = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cache.tls_enabled              = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cache.tls_keyfile              = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86193) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 06 17:01:18 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.quobyte [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 06 17:01:18 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.quobyte [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cache.username                 = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] coordination.backend_url       = **** {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] database.asyncio_connection    = **** {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] database.asyncio_slave_connection = **** {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] database.backend               = sqlalchemy {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] database.connection            = **** {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] Running cmd (subprocess): mount.quobyte {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] database.connection_debug      = 0 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] database.connection_parameters =  {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] database.connection_recycle_time = 3600 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] database.connection_trace      = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] database.db_inc_retry_interval = True {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] database.db_max_retries        = 20 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] database.db_max_retry_interval = 10 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] database.db_retry_interval     = 1 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] database.max_overflow          = 50 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] database.max_pool_size         = 5 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] database.max_retries           = 10 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] database.mysql_wsrep_sync_wait = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] database.pool_timeout          = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] database.retry_interval        = 10 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] database.slave_connection      = **** {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] database.sqlite_synchronous    = True {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] database.synchronous_reader    = True {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] database.use_db_reconnect      = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_tracing.insecure = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] profiler.connection_string     = messaging:// {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] profiler.enabled               = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] profiler.es_doc_type           = notification {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] profiler.es_scroll_size        = 10000 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] profiler.es_scroll_time        = 2m {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] profiler.filter_error_trace    = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] profiler.hmac_keys             = **** {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] profiler.sentinel_service_name = mymaster {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] profiler.socket_timeout        = 0.1 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] profiler.trace_requests        = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] profiler.trace_sqlalchemy      = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] profiler_jaeger.process_tags   = {} {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] profiler_jaeger.service_name_prefix = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] profiler_otlp.service_name_prefix = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_policy.enforce_new_defaults = True {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_policy.policy_default_rule = default {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_policy.policy_file        = policy.yaml {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] privsep_osbrick.group          = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] privsep_osbrick.helper_command = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] privsep_osbrick.user           = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cinder_sys_admin.group         = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cinder_sys_admin.helper_command = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] cinder_sys_admin.user          = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] service_user.auth_section      = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] service_user.auth_type         = password {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] service_user.cafile            = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] service_user.certfile          = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] service_user.collect_timing    = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] service_user.insecure          = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] service_user.keyfile           = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] service_user.send_service_user_token = True {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] service_user.split_loggers     = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] service_user.timeout           = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] service_user.tls_ciphers       = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] service_user.tls_min_version   = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] glance.auth_section            = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] glance.auth_type               = password {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] glance.certfile                = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] glance.collect_timing          = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] glance.insecure                = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] glance.keyfile                 = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] glance.region_name             = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] glance.split_loggers           = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] glance.timeout                 = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] glance.tls_ciphers             = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] glance.tls_min_version         = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.backend_availability_zone = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.chap_password = **** {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.chap_username =  {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.disk_geometry = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.driver_client_cert = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.driver_client_cert_key = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.driver_data_namespace = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.driver_use_ssl = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.extra_capabilities = {} {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.filter_function = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.goodness_function = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.iscsi_target_flags =  {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.iscsi_write_cache = on {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.iser_helper   = tgtadm {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.iser_ip_address = 192.168.122.155 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.iser_port     = 3260 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.nas_host      =  {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.nas_login     = admin {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.nas_mount_options = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.nas_password  = **** {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.nas_private_key =  {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.nas_share_path =  {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.num_shell_tries = 3 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.quobyte_volume_url = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.replication_device = **** {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.report_discard_supported = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.reserved_percentage = 0 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.target_helper = tgtadm {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.target_ip_address = 192.168.122.155 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.target_port   = 3260 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.target_protocol = iscsi {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.trace_flags   = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.unique_fqdn_network = True {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.use_chap_auth = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.volume_backend_name = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.volume_clear  = zero {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.volume_clear_ionice = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.volume_clear_size = 0 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_reports.file_event_handler = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_reports.log_dir           = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.backend_availability_zone = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.backend_host         = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.chap_password        = **** {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.chap_username        = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.chiscsi_conf         = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.disk_geometry        = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.driver_client_cert   = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.driver_data_namespace = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.driver_use_ssl       = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack quobyte-client[86196]: Reading configuration file: /etc/quobyte/client.cfg
Nov 06 17:01:18 devstack quobyte-client[86196]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.extra_capabilities   = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.filter_function      = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] CMD "mount.quobyte" returned: 1 in 0.146s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.goodness_function    = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:01:18 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:01:18 devstack cinder-volume[86193]: INFO cinder.volume.drivers.quobyte [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 ...
Nov 06 17:01:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f -c /etc/quobyte/client-cinder.cfg {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.iser_helper          = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.iser_ip_address      = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.iser_port            = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.iser_target_prefix   = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.nas_host             = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.nas_login            = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.nas_mount_options    = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.nas_password         = **** {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.nas_private_key      = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.nas_share_path       = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.nas_ssh_port         = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.num_shell_tries      = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.nvmet_port_id        = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.replication_device   = **** {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.report_discard_supported = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.reserved_percentage  = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.scst_target_driver   = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.storage_protocol     = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.target_helper        = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.target_ip_address    = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.target_port          = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.target_prefix        = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.target_protocol      = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.trace_flags          = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.use_chap_auth        = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.volume_clear         = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.volume_clear_size    = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack sudo[86199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f -c /etc/quobyte/client-cinder.cfg
Nov 06 17:01:18 devstack sudo[86199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] QuobyteHD.volumes_dir          = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_rabbit.ssl      = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_notifications.driver = [] {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_notifications.retry = -1 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] key_manager.fixed_key          = **** {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] barbican.barbican_api_version  = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] barbican.barbican_endpoint     = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] barbican.barbican_endpoint_type = public {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] barbican.barbican_region_name  = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] barbican.cafile                = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] barbican.certfile              = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] barbican.collect_timing        = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] barbican.insecure              = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] barbican.keyfile               = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] barbican.number_of_retries     = 60 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] barbican.retry_delay           = 1 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] barbican.send_service_user_token = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] barbican.split_loggers         = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] barbican.timeout               = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] barbican.tls_ciphers           = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] barbican.tls_min_version       = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] barbican.verify_ssl            = True {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] barbican.verify_ssl_path       = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] barbican_service_user.auth_section = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] barbican_service_user.auth_type = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] barbican_service_user.cafile   = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] barbican_service_user.certfile = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] barbican_service_user.collect_timing = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] barbican_service_user.insecure = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] barbican_service_user.keyfile  = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] barbican_service_user.split_loggers = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] barbican_service_user.timeout  = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] barbican_service_user.tls_ciphers = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] barbican_service_user.tls_min_version = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] vault.approle_role_id          = **** {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] vault.approle_secret_id        = **** {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] vault.auth_method              = approle {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] vault.auth_path                = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] vault.kv_mountpoint            = secret {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] vault.kv_path                  = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] vault.kv_version               = 2 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] vault.namespace                = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] vault.root_token_id            = **** {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] vault.ssl_ca_crt_file          = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] vault.timeout                  = 60.0 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] vault.token_file               = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] vault.token_role               = None {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] vault.use_ssl                  = False {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:18 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] ******************************************************************************** {{(pid=85975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 06 17:01:18 devstack sudo[86199]: pam_unix(sudo:session): session closed for user root
Nov 06 17:01:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.400s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:01:18 devstack cinder-volume[86193]: INFO cinder.volume.drivers.quobyte [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 succeeded
Nov 06 17:01:18 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:01:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.411s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:01:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:01:18 devstack sudo[86301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:01:18 devstack sudo[86301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:01:18 devstack sudo[86301]: pam_unix(sudo:session): session closed for user root
Nov 06 17:01:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.227s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:01:18 devstack cinder-volume[86193]: INFO cinder.volume.driver [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] Driver hasn't implemented _init_vendor_properties()
Nov 06 17:01:18 devstack cinder-volume[86193]: DEBUG cinder.volume.driver [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7606391906738, 'free_capacity_gb': 1773.7606391906738, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86193) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 06 17:01:18 devstack cinder-volume[86193]: DEBUG oslo_db.sqlalchemy.engines [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86193) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 06 17:01:18 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writer thread running {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 06 17:01:18 devstack cinder-volume[86193]: DEBUG cinder.db.api [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] Building query based on filter {{(pid=86193) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Nov 06 17:01:18 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86193) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 06 17:01:19 devstack cinder-volume[86193]: INFO cinder.keymgr.migration [None req-4baa70cb-79e4-4ef1-8956-c213bc45c56c None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 06 17:01:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:01:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:01:19 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:01:19 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:01:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:01:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:01:19 devstack sudo[86305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:01:19 devstack sudo[86305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:01:19 devstack sudo[86305]: pam_unix(sudo:session): session closed for user root
Nov 06 17:01:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.229s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:01:19 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:01:19 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] Driver initialization completed successfully.
Nov 06 17:01:19 devstack cinder-volume[86193]: INFO cinder.manager [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] Initiating service 3 cleanup
Nov 06 17:01:19 devstack cinder-volume[86193]: INFO cinder.manager [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] Service 3 cleanup completed.
Nov 06 17:01:19 devstack cinder-volume[86193]: DEBUG cinder.service [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] Creating RPC server for service cinder-volume {{(pid=86193) start /opt/stack/cinder/cinder/service.py:231}}
Nov 06 17:01:19 devstack cinder-volume[86193]: DEBUG cinder.service [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86193) start /opt/stack/cinder/cinder/service.py:237}}
Nov 06 17:01:19 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Nov 06 17:01:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:01:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:01:19 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:01:19 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:01:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:01:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:01:19 devstack sudo[86308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:01:19 devstack sudo[86308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:01:19 devstack sudo[86308]: pam_unix(sudo:session): session closed for user root
Nov 06 17:01:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.261s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:01:19 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-3551db45-3d86-47e8-80b5-8a02690ae98d None None] Driver post RPC initialization completed successfully.
Nov 06 17:01:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3193c626-09bd-4145-9864-934b184b15e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:01:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3193c626-09bd-4145-9864-934b184b15e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:01:24 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3193c626-09bd-4145-9864-934b184b15e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:01:24 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3193c626-09bd-4145-9864-934b184b15e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:01:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3193c626-09bd-4145-9864-934b184b15e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:01:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3193c626-09bd-4145-9864-934b184b15e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:01:24 devstack sudo[86458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:01:24 devstack sudo[86458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:01:24 devstack cinder-volume[85975]: INFO oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] Caught SIGTERM, stopping children
Nov 06 17:01:24 devstack cinder-volume[85975]: DEBUG oslo_concurrency.lockutils [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] Acquiring lock "singleton_lock" {{(pid=85975) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 06 17:01:24 devstack cinder-volume[85975]: DEBUG oslo_concurrency.lockutils [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] Acquired lock "singleton_lock" {{(pid=85975) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 06 17:01:24 devstack cinder-volume[85975]: DEBUG oslo_concurrency.lockutils [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] Releasing lock "singleton_lock" {{(pid=85975) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 06 17:01:24 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] Stop services. {{(pid=85975) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 06 17:01:24 devstack cinder-volume[85975]: DEBUG oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] Killing children. {{(pid=85975) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 06 17:01:24 devstack cinder-volume[85975]: INFO oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] Waiting on 1 children to exit
Nov 06 17:01:24 devstack sudo[86458]: pam_unix(sudo:session): session closed for user root
Nov 06 17:01:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3193c626-09bd-4145-9864-934b184b15e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.264s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:01:24 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-3193c626-09bd-4145-9864-934b184b15e2 None None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3193c626-09bd-4145-9864-934b184b15e2 None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3193c626-09bd-4145-9864-934b184b15e2 None None] Unable to connect to AMQP server on 192.168.122.155:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server [None req-3193c626-09bd-4145-9864-934b184b15e2 None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.155:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1109, in ensure
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server     ret, channel = autoretry_method()
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server                    ^^^^^^^^^^^^^^^^^^
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server     return fun(*args, **kwargs)
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server     return fun(*args, channel=channels[0], **kwargs), channels[0]
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1098, in execute_method
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server     method()
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1575, in _publish
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server     self._producer.publish(
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server     return _publish(
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server     return channel.basic_publish(
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server     self.wait([spec.Basic.Ack, spec.Basic.Nack],
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server     self.connection.drain_events(timeout=timeout)
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server     while not self.blocking_read(timeout):
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server               ^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server     return self.on_inbound_frame(frame)
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server     callback(channel, method_sig, buf, None)
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server     return self.channels[channel_id].dispatch_method(
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server     listener(*args)
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server     raise error_for_code(
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server 
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server 
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 176, in _process_incoming
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server     self._publish_service_capabilities(context)
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/manager.py", line 220, in _publish_service_capabilities
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server     self.scheduler_rpcapi.update_service_capabilities(
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server     cctxt.cast(ctxt, 'update_service_capabilities', **msg_args)
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 161, in cast
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server     self.transport._send(
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server     return self._driver.send(target, ctxt, message,
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 824, in send
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server     return self._send(target, ctxt, message, wait_for_reply, timeout,
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 799, in _send
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server     conn.fanout_send(target.topic, msg, retry=retry)
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1694, in fanout_send
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server     self._ensure_publishing(self._publish, exchange, msg, retry=retry)
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1524, in _ensure_publishing
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server     self.ensure(method, retry=retry, error_callback=_error_callback)
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1135, in ensure
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server     raise exceptions.MessageDeliveryFailure(msg)
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.155:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Nov 06 17:01:24 devstack cinder-volume[86193]: ERROR oslo_messaging.rpc.server 
Nov 06 17:01:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] Acquiring lock "singleton_lock" {{(pid=86193) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 06 17:01:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] Acquired lock "singleton_lock" {{(pid=86193) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 06 17:01:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] Releasing lock "singleton_lock" {{(pid=86193) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 06 17:01:27 devstack cinder-volume[86193]: WARNING amqp [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 06 17:01:27 devstack cinder-volume[86193]: WARNING amqp [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 06 17:01:27 devstack cinder-volume[85975]: INFO oslo_service.backend._eventlet.service [None req-08b3a97c-b1a7-4539-9f80-f321aa8ec595 None None] Child 86193 exited with status 0
Nov 06 17:01:28 devstack cinder-volume[86512]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 06 17:01:28 devstack cinder-volume[86512]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 06 17:01:28 devstack cinder-volume[86512]: we strongly recommend against using it for new projects.
Nov 06 17:01:28 devstack cinder-volume[86512]: If you are already using Eventlet, we recommend migrating to a different
Nov 06 17:01:28 devstack cinder-volume[86512]: framework.  For more detail see
Nov 06 17:01:28 devstack cinder-volume[86512]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 06 17:01:28 devstack cinder-volume[86512]:   import eventlet  # noqa
Nov 06 17:01:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86512) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 06 17:01:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86512) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 06 17:01:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86512) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 06 17:01:32 devstack cinder-volume[86512]: INFO dbcounter [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] Registered counter for database cinder
Nov 06 17:01:32 devstack cinder-volume[86512]: DEBUG oslo_db.sqlalchemy.engines [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86512) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 06 17:01:32 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writer thread running {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 06 17:01:32 devstack cinder-volume[86512]: INFO cinder.rpc [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 06 17:01:32 devstack cinder-volume[86512]: INFO cinder.rpc [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 06 17:01:32 devstack cinder-volume[86512]: DEBUG oslo_db.sqlalchemy.engines [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86512) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 06 17:01:32 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] Determined volume DB was empty at startup.
Nov 06 17:01:32 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86512) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 06 17:01:32 devstack cinder-volume[86512]: WARNING stevedore.named [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 06 17:01:32 devstack cinder-volume[86512]: WARNING castellan.key_manager [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 06 17:01:32 devstack cinder-volume[86512]: WARNING cinder.keymgr.conf_key_mgr [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 06 17:01:32 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_db.sqlalchemy.engines [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86512) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 06 17:01:33 devstack cinder-volume[86512]: INFO oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] Starting 1 workers
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] Started child 86856 {{(pid=86512) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] Full set of CONF: {{(pid=86512) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] ******************************************************************************** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] Configuration options gathered from: {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] ================================================================================ {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 06 17:01:33 devstack cinder-volume[86856]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1)
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] allow_availability_zone_fallback = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] allow_compression_on_image_upload = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] allowed_direct_url_schemes     = [] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] api_rate_limit                 = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] auth_strategy                  = keystone {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_availability_zone      = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_host                   = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_name                   = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_stats_polling_interval = 60 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backup_api_class               = cinder.backup.api.API {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backup_name_template           = backup-%s {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backup_use_same_host           = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backup_use_temp_snapshot       = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] chap_password                  = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] chap_username                  =  {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cinder_internal_tenant_project_id = 608b360473534ab0ba5d4d55f557d676 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cinder_internal_tenant_user_id = 5a905badb8824f72856bf9fd231afb51 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cluster                        = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] compression_format             = gzip {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] config_dir                     = [] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] config_source                  = [] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] control_exchange               = openstack {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] debug                          = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] default_availability_zone      = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] default_group_type             = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] default_volume_type            = QuobyteHD {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] disk_geometry                  = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] driver_client_cert             = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] driver_client_cert_key         = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] driver_data_namespace          = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] driver_ssl_cert_path           = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] driver_ssl_cert_verify         = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] driver_use_ssl                 = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] enable_new_services            = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] enable_unsupported_driver      = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] enforce_multipath_for_image_xfer = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] filter_function                = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] glance_api_insecure            = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] glance_api_servers             = ['http://192.168.122.155/image'] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] glance_api_ssl_compression     = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] glance_ca_certificates_file    = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] glance_certfile                = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] glance_keyfile                 = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] glance_num_retries             = 3 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] glance_request_timeout         = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] goodness_function              = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] graceful_shutdown_timeout      = 5 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] group_api_class                = cinder.group.api.API {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] host                           = devstack {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] image_compress_on_upload       = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] image_conversion_address_space_limit = 1 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] image_conversion_cpu_limit     = 60 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] image_conversion_disable       = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] image_introspection_address_space_limit = 1 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] image_introspection_cpu_limit  = 60 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] image_upload_use_cinder_backend = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] image_upload_use_internal_tenant = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] image_volume_cache_enabled     = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] image_volume_cache_max_count   = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] image_volume_cache_max_size_gb = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] init_host_max_objects_retrieval = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] iscsi_target_flags             =  {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] iscsi_write_cache              = on {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] iser_helper                    = tgtadm {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] iser_ip_address                = 192.168.122.155 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] iser_port                      = 3260 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] log_color                      = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] log_config_append              = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] log_dir                        = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] log_file                       = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] log_options                    = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] log_rotate_interval            = 1 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] log_rotate_interval_type       = days {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] log_rotation_type              = none {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] max_age                        = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] max_logfile_count              = 30 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] max_logfile_size_mb            = 200 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] max_over_subscription_ratio    = 20.0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] message_reap_interval          = 86400 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] message_ttl                    = 2592000 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] migration_create_volume_timeout_secs = 300 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] monkey_patch                   = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] monkey_patch_modules           = [] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] my_ip                          = 192.168.122.155 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] no_snapshot_gb_quota           = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] num_iser_scan_tries            = 3 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] num_shell_tries                = 3 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] num_volume_device_scan_tries   = 3 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] nvmeof_conn_info_version       = 1 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] nvmet_ns_id                    = 10 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] nvmet_port_id                  = 1 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] osapi_max_limit                = 1000 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] osapi_volume_ext_list          = [] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] Starting volume driver QuobyteDriver (1.2.1)
Nov 06 17:01:33 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86856) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] osapi_volume_listen_port       = 8776 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] osapi_volume_use_ssl           = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] osapi_volume_workers           = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] per_volume_size_limit          = -1 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] periodic_fuzzy_delay           = 60 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] periodic_interval              = 60 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] public_endpoint                = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] publish_errors                 = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] quota_backup_gigabytes         = 1000 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] quota_backups                  = 10 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] quota_gigabytes                = 1000 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] quota_groups                   = 10 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] quota_snapshots                = 10 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] quota_volumes                  = 10 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] rate_limit_burst               = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] rate_limit_except_level        = CRITICAL {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] rate_limit_interval            = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] reinit_driver_count            = 3 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] replication_device             = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] report_discard_supported       = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] report_interval                = 120 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] reservation_clean_interval     = 86400 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] reservation_expire             = 86400 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] reserved_image_namespaces      = [] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] reserved_percentage            = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] rpc_response_timeout           = 120 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] run_external_periodic_tasks    = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] scst_target_driver             = iscsi {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] scst_target_iqn_name           = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] service_down_time              = 720 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] shell_completion               = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] snapshot_name_template         = snapshot-%s {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] split_loggers                  = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] state_path                     = /opt/stack/data/cinder {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] storage_availability_zone      = nova {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] storage_protocol               = iSCSI {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] syslog_log_facility            = LOG_USER {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] target_helper                  = lioadm {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] target_ip_address              = 192.168.122.155 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] target_port                    = 3260 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] target_protocol                = iscsi {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] target_secondary_ip_addresses  = [] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] trace_flags                    = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] transport_url                  = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] until_refresh                  = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] use_chap_auth                  = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] use_default_quota_class        = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] use_journal                    = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] use_json                       = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] use_multipath_for_image_xfer   = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] use_stderr                     = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] use_syslog                     = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] verify_glance_signatures       = enabled {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] volume_api_class               = cinder.volume.api.API {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] volume_backend_name            = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] volume_clear                   = zero {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] volume_clear_ionice            = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] volume_clear_size              = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] volume_copy_bps_limit          = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] volume_dd_blocksize            = 1M {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] volume_name_template           = volume-%s {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] volume_service_inithost_offload = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] volume_usage_audit_period      = month {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] zoning_mode                    = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_concurrency.disable_process_locking = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] keystone_authtoken.auth_section = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] keystone_authtoken.auth_type   = password {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] keystone_authtoken.auth_version = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] keystone_authtoken.cache       = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] keystone_authtoken.certfile    = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] keystone_authtoken.include_service_catalog = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] keystone_authtoken.insecure    = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] keystone_authtoken.interface   = public {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] keystone_authtoken.keyfile     = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] keystone_authtoken.memcache_password = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] keystone_authtoken.memcache_username = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] keystone_authtoken.region_name = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] keystone_authtoken.service_type = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.155/identity {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cache.backend                  = dogpile.cache.null {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cache.backend_argument         = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86856) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 06 17:01:33 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.quobyte [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 06 17:01:33 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.quobyte [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cache.backend_expiration_time  = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cache.config_prefix            = cache.oslo {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cache.debug_cache_backend      = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cache.enable_retry_client      = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cache.enable_socket_keepalive  = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cache.enabled                  = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cache.expiration_time          = 600 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] Running cmd (subprocess): mount.quobyte {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cache.hashclient_retry_attempts = 2 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cache.memcache_dead_retry      = 300 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cache.memcache_sasl_enabled    = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cache.password                 = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cache.proxies                  = [] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cache.redis_db                 = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cache.redis_server             = localhost:6379 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cache.retry_attempts           = 2 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cache.retry_delay              = 0.0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cache.socket_keepalive_count   = 1 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cache.socket_keepalive_idle    = 1 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cache.socket_keepalive_interval = 1 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cache.socket_timeout           = 1.0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cache.tls_allowed_ciphers      = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cache.tls_cafile               = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cache.tls_certfile             = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cache.tls_enabled              = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cache.tls_keyfile              = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cache.username                 = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] coordination.backend_url       = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] database.asyncio_connection    = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] database.asyncio_slave_connection = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] database.backend               = sqlalchemy {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] database.connection            = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] database.connection_debug      = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] database.connection_parameters =  {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] database.connection_recycle_time = 3600 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] database.connection_trace      = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] database.db_inc_retry_interval = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] database.db_max_retries        = 20 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] database.db_max_retry_interval = 10 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] database.db_retry_interval     = 1 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] database.max_overflow          = 50 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] database.max_pool_size         = 5 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] database.max_retries           = 10 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] database.mysql_wsrep_sync_wait = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] database.pool_timeout          = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] database.retry_interval        = 10 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] database.slave_connection      = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] database.sqlite_synchronous    = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] database.synchronous_reader    = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] database.use_db_reconnect      = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_tracing.insecure = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] profiler.connection_string     = messaging:// {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] profiler.enabled               = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] profiler.es_doc_type           = notification {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] profiler.es_scroll_size        = 10000 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] profiler.es_scroll_time        = 2m {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] profiler.filter_error_trace    = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] profiler.hmac_keys             = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] profiler.sentinel_service_name = mymaster {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] profiler.socket_timeout        = 0.1 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] profiler.trace_requests        = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] profiler.trace_sqlalchemy      = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] profiler_jaeger.process_tags   = {} {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] profiler_jaeger.service_name_prefix = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] profiler_otlp.service_name_prefix = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_policy.enforce_new_defaults = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_policy.policy_default_rule = default {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] privsep_osbrick.group          = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] privsep_osbrick.helper_command = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] privsep_osbrick.user           = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cinder_sys_admin.group         = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cinder_sys_admin.helper_command = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack quobyte-client[86857]: Reading configuration file: /etc/quobyte/client.cfg
Nov 06 17:01:33 devstack quobyte-client[86857]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] cinder_sys_admin.user          = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] service_user.auth_section      = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] service_user.auth_type         = password {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] service_user.cafile            = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] service_user.certfile          = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] service_user.collect_timing    = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] service_user.insecure          = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] CMD "mount.quobyte" returned: 1 in 0.069s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] service_user.keyfile           = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] service_user.send_service_user_token = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] service_user.split_loggers     = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] service_user.timeout           = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] service_user.tls_ciphers       = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] service_user.tls_min_version   = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] glance.auth_section            = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] glance.auth_type               = password {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] glance.certfile                = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] glance.collect_timing          = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] glance.insecure                = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] glance.keyfile                 = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] glance.region_name             = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] glance.split_loggers           = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] glance.timeout                 = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] glance.tls_ciphers             = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] glance.tls_min_version         = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.backend_availability_zone = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.chap_password = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.chap_username =  {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.disk_geometry = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.driver_client_cert = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.driver_client_cert_key = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.driver_data_namespace = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.driver_use_ssl = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.extra_capabilities = {} {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.filter_function = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.goodness_function = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.iscsi_target_flags =  {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.iscsi_write_cache = on {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.iser_ip_address = 192.168.122.155 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.iser_port     = 3260 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.nas_host      =  {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.nas_login     = admin {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.nas_mount_options = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.nas_password  = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.nas_private_key =  {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.nas_share_path =  {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.num_shell_tries = 3 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.quobyte_volume_url = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.replication_device = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.report_discard_supported = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.reserved_percentage = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.target_helper = tgtadm {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.target_ip_address = 192.168.122.155 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.target_port   = 3260 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.target_protocol = iscsi {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.trace_flags   = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.unique_fqdn_network = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.use_chap_auth = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.volume_backend_name = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.volume_clear  = zero {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.volume_clear_ionice = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.volume_clear_size = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_reports.file_event_handler = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_reports.log_dir           = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.backend_availability_zone = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.backend_host         = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.chap_password        = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.chap_username        = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.disk_geometry        = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.driver_client_cert   = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.driver_data_namespace = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack sudo[86859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.extra_capabilities   = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.filter_function      = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.goodness_function    = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack sudo[86859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.iser_helper          = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.iser_ip_address      = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.iser_port            = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.nas_host             = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.nas_login            = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.nas_mount_options    = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.nas_password         = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.nas_private_key      = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.nas_share_path       = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.num_shell_tries      = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.replication_device   = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.report_discard_supported = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.reserved_percentage  = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.scst_target_driver   = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.storage_protocol     = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.target_helper        = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.target_ip_address    = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.target_port          = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.target_prefix        = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.target_protocol      = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.trace_flags          = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.use_chap_auth        = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.volume_clear         = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.volume_clear_size    = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] QuobyteHD.volumes_dir          = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_notifications.driver = [] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_notifications.retry = -1 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] key_manager.fixed_key          = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] barbican.barbican_api_version  = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] barbican.barbican_endpoint     = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] barbican.barbican_endpoint_type = public {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] barbican.barbican_region_name  = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] barbican.cafile                = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] barbican.certfile              = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] barbican.collect_timing        = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] barbican.insecure              = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] barbican.keyfile               = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] barbican.number_of_retries     = 60 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] barbican.retry_delay           = 1 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] barbican.send_service_user_token = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] barbican.split_loggers         = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] barbican.timeout               = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] barbican.tls_ciphers           = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] barbican.tls_min_version       = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] barbican.verify_ssl            = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] barbican.verify_ssl_path       = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] barbican_service_user.auth_section = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] barbican_service_user.auth_type = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] barbican_service_user.cafile   = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] barbican_service_user.certfile = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] barbican_service_user.collect_timing = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] barbican_service_user.insecure = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] barbican_service_user.keyfile  = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] barbican_service_user.split_loggers = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] barbican_service_user.timeout  = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] barbican_service_user.tls_ciphers = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] barbican_service_user.tls_min_version = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] vault.approle_role_id          = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] vault.approle_secret_id        = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] vault.auth_method              = approle {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] vault.auth_path                = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] vault.kv_mountpoint            = secret {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] vault.kv_path                  = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] vault.kv_version               = 2 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] vault.namespace                = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] vault.root_token_id            = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] vault.ssl_ca_crt_file          = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] vault.timeout                  = 60.0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] vault.token_file               = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] vault.token_role               = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] vault.use_ssl                  = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 17:01:33 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c8447dad-5421-4338-bc20-5f16348da527 None None] ******************************************************************************** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 06 17:01:33 devstack sudo[86859]: pam_unix(sudo:session): session closed for user root
Nov 06 17:01:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.294s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:01:33 devstack cinder-volume[86856]: INFO cinder.volume.driver [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] Driver hasn't implemented _init_vendor_properties()
Nov 06 17:01:33 devstack cinder-volume[86856]: DEBUG cinder.volume.driver [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7657089233398, 'free_capacity_gb': 1773.7657089233398, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86856) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 06 17:01:33 devstack cinder-volume[86856]: DEBUG oslo_db.sqlalchemy.engines [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86856) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 06 17:01:33 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writer thread running {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 06 17:01:33 devstack cinder-volume[86856]: DEBUG cinder.db.api [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] Building query based on filter {{(pid=86856) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Nov 06 17:01:33 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86856) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 06 17:01:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:01:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:01:33 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:01:33 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:01:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:01:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:01:33 devstack cinder-volume[86856]: INFO cinder.keymgr.migration [None req-28d4962e-33a7-47fc-a567-a1ac4985f142 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 06 17:01:33 devstack sudo[86872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:01:33 devstack sudo[86872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:01:34 devstack sudo[86872]: pam_unix(sudo:session): session closed for user root
Nov 06 17:01:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.236s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:01:34 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:01:34 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] Driver initialization completed successfully.
Nov 06 17:01:34 devstack cinder-volume[86856]: INFO cinder.manager [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] Initiating service 3 cleanup
Nov 06 17:01:34 devstack cinder-volume[86856]: INFO cinder.manager [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] Service 3 cleanup completed.
Nov 06 17:01:34 devstack cinder-volume[86856]: DEBUG cinder.service [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] Creating RPC server for service cinder-volume {{(pid=86856) start /opt/stack/cinder/cinder/service.py:231}}
Nov 06 17:01:34 devstack cinder-volume[86856]: DEBUG cinder.service [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86856) start /opt/stack/cinder/cinder/service.py:237}}
Nov 06 17:01:34 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Nov 06 17:01:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:01:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:01:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:01:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:01:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:01:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:01:34 devstack sudo[86883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:01:34 devstack sudo[86883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:01:34 devstack sudo[86883]: pam_unix(sudo:session): session closed for user root
Nov 06 17:01:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.235s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:01:34 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-af2fea22-b78f-4064-b81d-26fc3cd1df88 None None] Driver post RPC initialization completed successfully.
Nov 06 17:01:42 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager._thread_info {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:01:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread count: 6 {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 17:01:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread info: [<_MainThread(MainThread, started 125183137599616)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125183027608256)>, <Thread(Thread-3 (stat_writer), started daemon 125183025243776)>, <Thread(Rabbit-heartbeat, started daemon 125183023512896)>, <Thread(Thread-5 (_runner), started daemon 125183023357120)>, <Thread(Thread-7 (_runner), started daemon 125183021306496)>] {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 17:01:43 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:01:44 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:01:44 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=3 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:02:42 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:02:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:02:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:02:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:02:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:02:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:02:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:02:42 devstack sudo[87656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:02:42 devstack sudo[87656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:02:43 devstack sudo[87656]: pam_unix(sudo:session): session closed for user root
Nov 06 17:02:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.829s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:02:43 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:02:43 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager._thread_info {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:02:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread count: 6 {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 17:02:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread info: [<_MainThread(MainThread, started 125183137599616)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125183027608256)>, <Thread(Thread-3 (stat_writer), started daemon 125183025243776)>, <Thread(Rabbit-heartbeat, started daemon 125183023512896)>, <Thread(Thread-5 (_runner), started daemon 125183023357120)>, <Thread(Thread-7 (_runner), started daemon 125183021306496)>] {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 17:03:02 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6f3e68d-f9b8-4c14-b6eb-1659bb2919c0 tempest-AttachVolumeShelveTestJSON-1273115812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:03:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e6f3e68d-f9b8-4c14-b6eb-1659bb2919c0 tempest-AttachVolumeShelveTestJSON-1273115812 None] Flow 'volume_create_manager' (48aca34e-7a6b-42e8-9e4c-df970bfc27bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:03:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e6f3e68d-f9b8-4c14-b6eb-1659bb2919c0 tempest-AttachVolumeShelveTestJSON-1273115812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d0dac3-e0ee-4895-ab15-5ecebad7bfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:03:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e6f3e68d-f9b8-4c14-b6eb-1659bb2919c0 tempest-AttachVolumeShelveTestJSON-1273115812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d0dac3-e0ee-4895-ab15-5ecebad7bfde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1598066173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d94064a-ba82-4e75-8eeb-eede11d89d9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e0bd52bd5344259aeef2f89ce7e5496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:03:02Z,use_quota=True,user_id='7472259f82944b13883ebb787e48e603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:03:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e6f3e68d-f9b8-4c14-b6eb-1659bb2919c0 tempest-AttachVolumeShelveTestJSON-1273115812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78873933-6f06-46b8-b921-909051abb9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:03:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e6f3e68d-f9b8-4c14-b6eb-1659bb2919c0 tempest-AttachVolumeShelveTestJSON-1273115812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78873933-6f06-46b8-b921-909051abb9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:03:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e6f3e68d-f9b8-4c14-b6eb-1659bb2919c0 tempest-AttachVolumeShelveTestJSON-1273115812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cc5c55b-9eb4-452e-b5c6-0b9b748fffea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:03:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e6f3e68d-f9b8-4c14-b6eb-1659bb2919c0 tempest-AttachVolumeShelveTestJSON-1273115812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cc5c55b-9eb4-452e-b5c6-0b9b748fffea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d94064a-ba82-4e75-8eeb-eede11d89d9f', 'volume_name': 'volume-5d94064a-ba82-4e75-8eeb-eede11d89d9f', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:03:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e6f3e68d-f9b8-4c14-b6eb-1659bb2919c0 tempest-AttachVolumeShelveTestJSON-1273115812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a589709e-fc65-411b-8297-88c09b3907cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:03:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e6f3e68d-f9b8-4c14-b6eb-1659bb2919c0 tempest-AttachVolumeShelveTestJSON-1273115812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a589709e-fc65-411b-8297-88c09b3907cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:03:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e6f3e68d-f9b8-4c14-b6eb-1659bb2919c0 tempest-AttachVolumeShelveTestJSON-1273115812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b34d710-7d57-424b-845f-387db94fe204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:03:02 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-e6f3e68d-f9b8-4c14-b6eb-1659bb2919c0 tempest-AttachVolumeShelveTestJSON-1273115812 None] Volume 5d94064a-ba82-4e75-8eeb-eede11d89d9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d94064a-ba82-4e75-8eeb-eede11d89d9f', 'volume_size': 1}
Nov 06 17:03:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e6f3e68d-f9b8-4c14-b6eb-1659bb2919c0 tempest-AttachVolumeShelveTestJSON-1273115812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:03:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e6f3e68d-f9b8-4c14-b6eb-1659bb2919c0 tempest-AttachVolumeShelveTestJSON-1273115812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:03:02 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e6f3e68d-f9b8-4c14-b6eb-1659bb2919c0 tempest-AttachVolumeShelveTestJSON-1273115812 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1598066173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d94064a-ba82-4e75-8eeb-eede11d89d9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e0bd52bd5344259aeef2f89ce7e5496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:03:02Z,use_quota=True,user_id='7472259f82944b13883ebb787e48e603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:03:02 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-e6f3e68d-f9b8-4c14-b6eb-1659bb2919c0 tempest-AttachVolumeShelveTestJSON-1273115812 None] Creating volume 5d94064a-ba82-4e75-8eeb-eede11d89d9f {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:03:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e6f3e68d-f9b8-4c14-b6eb-1659bb2919c0 tempest-AttachVolumeShelveTestJSON-1273115812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:03:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e6f3e68d-f9b8-4c14-b6eb-1659bb2919c0 tempest-AttachVolumeShelveTestJSON-1273115812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:03:02 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e6f3e68d-f9b8-4c14-b6eb-1659bb2919c0 tempest-AttachVolumeShelveTestJSON-1273115812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:03:02 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e6f3e68d-f9b8-4c14-b6eb-1659bb2919c0 tempest-AttachVolumeShelveTestJSON-1273115812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:03:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e6f3e68d-f9b8-4c14-b6eb-1659bb2919c0 tempest-AttachVolumeShelveTestJSON-1273115812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:03:02 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e6f3e68d-f9b8-4c14-b6eb-1659bb2919c0 tempest-AttachVolumeShelveTestJSON-1273115812 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:03:02 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-e6f3e68d-f9b8-4c14-b6eb-1659bb2919c0 tempest-AttachVolumeShelveTestJSON-1273115812 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:03:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e6f3e68d-f9b8-4c14-b6eb-1659bb2919c0 tempest-AttachVolumeShelveTestJSON-1273115812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d94064a-ba82-4e75-8eeb-eede11d89d9f 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:03:02 devstack sudo[87807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d94064a-ba82-4e75-8eeb-eede11d89d9f 1073741824
Nov 06 17:03:02 devstack sudo[87807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:03:03 devstack sudo[87807]: pam_unix(sudo:session): session closed for user root
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e6f3e68d-f9b8-4c14-b6eb-1659bb2919c0 tempest-AttachVolumeShelveTestJSON-1273115812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d94064a-ba82-4e75-8eeb-eede11d89d9f 1073741824" returned: 0 in 0.680s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e6f3e68d-f9b8-4c14-b6eb-1659bb2919c0 tempest-AttachVolumeShelveTestJSON-1273115812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d94064a-ba82-4e75-8eeb-eede11d89d9f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:03:03 devstack sudo[88127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d94064a-ba82-4e75-8eeb-eede11d89d9f
Nov 06 17:03:03 devstack sudo[88127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-08616f0a-e46e-4c2a-9c0d-6271e346daf8 tempest-AttachVolumeNegativeTest-706916992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-08616f0a-e46e-4c2a-9c0d-6271e346daf8 tempest-AttachVolumeNegativeTest-706916992 None] Flow 'volume_create_manager' (dfa838c8-fe4e-4d5b-b122-cff7aabe0234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-08616f0a-e46e-4c2a-9c0d-6271e346daf8 tempest-AttachVolumeNegativeTest-706916992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea58a1a-8012-4136-9b2a-da1f8fbd47ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-08616f0a-e46e-4c2a-9c0d-6271e346daf8 tempest-AttachVolumeNegativeTest-706916992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea58a1a-8012-4136-9b2a-da1f8fbd47ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-321744834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9a37bff-5d79-4ee5-8141-ba0b1791d010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a04a9285705648f4853ea8791a1f7679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:03:03Z,use_quota=True,user_id='ff1a8d854cb4480ba8aef514e49dc3a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-08616f0a-e46e-4c2a-9c0d-6271e346daf8 tempest-AttachVolumeNegativeTest-706916992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (388b99dc-ca14-4418-bd86-cded46079dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-08616f0a-e46e-4c2a-9c0d-6271e346daf8 tempest-AttachVolumeNegativeTest-706916992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (388b99dc-ca14-4418-bd86-cded46079dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-08616f0a-e46e-4c2a-9c0d-6271e346daf8 tempest-AttachVolumeNegativeTest-706916992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (044ebd72-5d55-4663-bc7f-fcc841d238ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-08616f0a-e46e-4c2a-9c0d-6271e346daf8 tempest-AttachVolumeNegativeTest-706916992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (044ebd72-5d55-4663-bc7f-fcc841d238ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9a37bff-5d79-4ee5-8141-ba0b1791d010', 'volume_name': 'volume-b9a37bff-5d79-4ee5-8141-ba0b1791d010', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-08616f0a-e46e-4c2a-9c0d-6271e346daf8 tempest-AttachVolumeNegativeTest-706916992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7dfc4e0-0f91-42db-984d-764e91668427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-08616f0a-e46e-4c2a-9c0d-6271e346daf8 tempest-AttachVolumeNegativeTest-706916992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7dfc4e0-0f91-42db-984d-764e91668427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-08616f0a-e46e-4c2a-9c0d-6271e346daf8 tempest-AttachVolumeNegativeTest-706916992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9164e3f-cc47-484f-93a3-5474d7a60158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:03:03 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-08616f0a-e46e-4c2a-9c0d-6271e346daf8 tempest-AttachVolumeNegativeTest-706916992 None] Volume b9a37bff-5d79-4ee5-8141-ba0b1791d010: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9a37bff-5d79-4ee5-8141-ba0b1791d010', 'volume_size': 1}
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-08616f0a-e46e-4c2a-9c0d-6271e346daf8 tempest-AttachVolumeNegativeTest-706916992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:03:03 devstack sudo[88127]: pam_unix(sudo:session): session closed for user root
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e6f3e68d-f9b8-4c14-b6eb-1659bb2919c0 tempest-AttachVolumeShelveTestJSON-1273115812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d94064a-ba82-4e75-8eeb-eede11d89d9f" returned: 0 in 0.299s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e6f3e68d-f9b8-4c14-b6eb-1659bb2919c0 tempest-AttachVolumeShelveTestJSON-1273115812 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e6f3e68d-f9b8-4c14-b6eb-1659bb2919c0 tempest-AttachVolumeShelveTestJSON-1273115812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-08616f0a-e46e-4c2a-9c0d-6271e346daf8 tempest-AttachVolumeNegativeTest-706916992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.072s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-08616f0a-e46e-4c2a-9c0d-6271e346daf8 tempest-AttachVolumeNegativeTest-706916992 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-321744834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9a37bff-5d79-4ee5-8141-ba0b1791d010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a04a9285705648f4853ea8791a1f7679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:03:03Z,use_quota=True,user_id='ff1a8d854cb4480ba8aef514e49dc3a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-08616f0a-e46e-4c2a-9c0d-6271e346daf8 tempest-AttachVolumeNegativeTest-706916992 None] Creating volume b9a37bff-5d79-4ee5-8141-ba0b1791d010 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-08616f0a-e46e-4c2a-9c0d-6271e346daf8 tempest-AttachVolumeNegativeTest-706916992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-08616f0a-e46e-4c2a-9c0d-6271e346daf8 tempest-AttachVolumeNegativeTest-706916992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-08616f0a-e46e-4c2a-9c0d-6271e346daf8 tempest-AttachVolumeNegativeTest-706916992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-08616f0a-e46e-4c2a-9c0d-6271e346daf8 tempest-AttachVolumeNegativeTest-706916992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-08616f0a-e46e-4c2a-9c0d-6271e346daf8 tempest-AttachVolumeNegativeTest-706916992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-08616f0a-e46e-4c2a-9c0d-6271e346daf8 tempest-AttachVolumeNegativeTest-706916992 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:03:03 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-08616f0a-e46e-4c2a-9c0d-6271e346daf8 tempest-AttachVolumeNegativeTest-706916992 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-08616f0a-e46e-4c2a-9c0d-6271e346daf8 tempest-AttachVolumeNegativeTest-706916992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b9a37bff-5d79-4ee5-8141-ba0b1791d010 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e6f3e68d-f9b8-4c14-b6eb-1659bb2919c0 tempest-AttachVolumeShelveTestJSON-1273115812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b34d710-7d57-424b-845f-387db94fe204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d94064a-ba82-4e75-8eeb-eede11d89d9f', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e6f3e68d-f9b8-4c14-b6eb-1659bb2919c0 tempest-AttachVolumeShelveTestJSON-1273115812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae2f1f10-0075-430b-84fe-111bf598a16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:03:03 devstack sudo[88130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b9a37bff-5d79-4ee5-8141-ba0b1791d010 1073741824
Nov 06 17:03:03 devstack sudo[88130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:03:03 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-e6f3e68d-f9b8-4c14-b6eb-1659bb2919c0 tempest-AttachVolumeShelveTestJSON-1273115812 None] Volume volume-5d94064a-ba82-4e75-8eeb-eede11d89d9f (5d94064a-ba82-4e75-8eeb-eede11d89d9f): created successfully
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e6f3e68d-f9b8-4c14-b6eb-1659bb2919c0 tempest-AttachVolumeShelveTestJSON-1273115812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae2f1f10-0075-430b-84fe-111bf598a16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e6f3e68d-f9b8-4c14-b6eb-1659bb2919c0 tempest-AttachVolumeShelveTestJSON-1273115812 None] Flow 'volume_create_manager' (48aca34e-7a6b-42e8-9e4c-df970bfc27bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:03:03 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-e6f3e68d-f9b8-4c14-b6eb-1659bb2919c0 tempest-AttachVolumeShelveTestJSON-1273115812 None] Created volume successfully.
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e49b339-a934-4877-9c37-4658467cf353 tempest-ServerActionsTestOtherA-1229582533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3e49b339-a934-4877-9c37-4658467cf353 tempest-ServerActionsTestOtherA-1229582533 None] Flow 'volume_create_manager' (f0aacf15-d81c-4d83-b253-03498232dcba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3e49b339-a934-4877-9c37-4658467cf353 tempest-ServerActionsTestOtherA-1229582533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31ea8beb-80d9-4311-ba08-15480617e8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3e49b339-a934-4877-9c37-4658467cf353 tempest-ServerActionsTestOtherA-1229582533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31ea8beb-80d9-4311-ba08-15480617e8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1699503147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08bf7294-f24f-417e-806c-bfbb6b23ef76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b545bcbead748a7a4fcb90497cb390a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:03:04Z,use_quota=True,user_id='3d05bf4fa8234864ba4781d35d5aa19d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3e49b339-a934-4877-9c37-4658467cf353 tempest-ServerActionsTestOtherA-1229582533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fdb44e9-b5dc-4eb4-b4a9-056d59bf7865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3e49b339-a934-4877-9c37-4658467cf353 tempest-ServerActionsTestOtherA-1229582533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fdb44e9-b5dc-4eb4-b4a9-056d59bf7865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3e49b339-a934-4877-9c37-4658467cf353 tempest-ServerActionsTestOtherA-1229582533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b70937e0-1237-415d-b3ab-cedeca479904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3e49b339-a934-4877-9c37-4658467cf353 tempest-ServerActionsTestOtherA-1229582533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b70937e0-1237-415d-b3ab-cedeca479904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08bf7294-f24f-417e-806c-bfbb6b23ef76', 'volume_name': 'volume-08bf7294-f24f-417e-806c-bfbb6b23ef76', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3e49b339-a934-4877-9c37-4658467cf353 tempest-ServerActionsTestOtherA-1229582533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb9ccdbd-8478-4b3a-bf0b-83531832999d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3e49b339-a934-4877-9c37-4658467cf353 tempest-ServerActionsTestOtherA-1229582533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb9ccdbd-8478-4b3a-bf0b-83531832999d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3e49b339-a934-4877-9c37-4658467cf353 tempest-ServerActionsTestOtherA-1229582533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9cc40b5-7981-4d04-9d00-1588e2c8c482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:03:03 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-3e49b339-a934-4877-9c37-4658467cf353 tempest-ServerActionsTestOtherA-1229582533 None] Volume 08bf7294-f24f-417e-806c-bfbb6b23ef76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08bf7294-f24f-417e-806c-bfbb6b23ef76', 'volume_size': 1}
Nov 06 17:03:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3e49b339-a934-4877-9c37-4658467cf353 tempest-ServerActionsTestOtherA-1229582533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:03:04 devstack sudo[88130]: pam_unix(sudo:session): session closed for user root
Nov 06 17:03:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-08616f0a-e46e-4c2a-9c0d-6271e346daf8 tempest-AttachVolumeNegativeTest-706916992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b9a37bff-5d79-4ee5-8141-ba0b1791d010 1073741824" returned: 0 in 0.693s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:03:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-08616f0a-e46e-4c2a-9c0d-6271e346daf8 tempest-AttachVolumeNegativeTest-706916992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b9a37bff-5d79-4ee5-8141-ba0b1791d010 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:03:04 devstack sudo[88141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b9a37bff-5d79-4ee5-8141-ba0b1791d010
Nov 06 17:03:04 devstack sudo[88141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:03:04 devstack sudo[88141]: pam_unix(sudo:session): session closed for user root
Nov 06 17:03:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-08616f0a-e46e-4c2a-9c0d-6271e346daf8 tempest-AttachVolumeNegativeTest-706916992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b9a37bff-5d79-4ee5-8141-ba0b1791d010" returned: 0 in 0.293s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:03:04 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-08616f0a-e46e-4c2a-9c0d-6271e346daf8 tempest-AttachVolumeNegativeTest-706916992 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:03:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-08616f0a-e46e-4c2a-9c0d-6271e346daf8 tempest-AttachVolumeNegativeTest-706916992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:03:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3e49b339-a934-4877-9c37-4658467cf353 tempest-ServerActionsTestOtherA-1229582533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.556s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:03:04 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3e49b339-a934-4877-9c37-4658467cf353 tempest-ServerActionsTestOtherA-1229582533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1699503147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08bf7294-f24f-417e-806c-bfbb6b23ef76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b545bcbead748a7a4fcb90497cb390a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:03:04Z,use_quota=True,user_id='3d05bf4fa8234864ba4781d35d5aa19d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:03:04 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-3e49b339-a934-4877-9c37-4658467cf353 tempest-ServerActionsTestOtherA-1229582533 None] Creating volume 08bf7294-f24f-417e-806c-bfbb6b23ef76 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:03:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3e49b339-a934-4877-9c37-4658467cf353 tempest-ServerActionsTestOtherA-1229582533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:03:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3e49b339-a934-4877-9c37-4658467cf353 tempest-ServerActionsTestOtherA-1229582533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:03:04 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3e49b339-a934-4877-9c37-4658467cf353 tempest-ServerActionsTestOtherA-1229582533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:03:04 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3e49b339-a934-4877-9c37-4658467cf353 tempest-ServerActionsTestOtherA-1229582533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:03:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3e49b339-a934-4877-9c37-4658467cf353 tempest-ServerActionsTestOtherA-1229582533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:03:04 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3e49b339-a934-4877-9c37-4658467cf353 tempest-ServerActionsTestOtherA-1229582533 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:03:04 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-3e49b339-a934-4877-9c37-4658467cf353 tempest-ServerActionsTestOtherA-1229582533 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:03:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3e49b339-a934-4877-9c37-4658467cf353 tempest-ServerActionsTestOtherA-1229582533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-08bf7294-f24f-417e-806c-bfbb6b23ef76 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:03:04 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-08616f0a-e46e-4c2a-9c0d-6271e346daf8 tempest-AttachVolumeNegativeTest-706916992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9164e3f-cc47-484f-93a3-5474d7a60158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9a37bff-5d79-4ee5-8141-ba0b1791d010', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:03:04 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-08616f0a-e46e-4c2a-9c0d-6271e346daf8 tempest-AttachVolumeNegativeTest-706916992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17844d25-b880-42ed-a8bb-b11201e89014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:03:04 devstack sudo[88144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-08bf7294-f24f-417e-806c-bfbb6b23ef76 1073741824
Nov 06 17:03:04 devstack sudo[88144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:03:04 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-08616f0a-e46e-4c2a-9c0d-6271e346daf8 tempest-AttachVolumeNegativeTest-706916992 None] Volume volume-b9a37bff-5d79-4ee5-8141-ba0b1791d010 (b9a37bff-5d79-4ee5-8141-ba0b1791d010): created successfully
Nov 06 17:03:04 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-08616f0a-e46e-4c2a-9c0d-6271e346daf8 tempest-AttachVolumeNegativeTest-706916992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17844d25-b880-42ed-a8bb-b11201e89014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:03:04 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-08616f0a-e46e-4c2a-9c0d-6271e346daf8 tempest-AttachVolumeNegativeTest-706916992 None] Flow 'volume_create_manager' (dfa838c8-fe4e-4d5b-b122-cff7aabe0234) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:03:04 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-08616f0a-e46e-4c2a-9c0d-6271e346daf8 tempest-AttachVolumeNegativeTest-706916992 None] Created volume successfully.
Nov 06 17:03:05 devstack sudo[88144]: pam_unix(sudo:session): session closed for user root
Nov 06 17:03:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3e49b339-a934-4877-9c37-4658467cf353 tempest-ServerActionsTestOtherA-1229582533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-08bf7294-f24f-417e-806c-bfbb6b23ef76 1073741824" returned: 0 in 0.647s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:03:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3e49b339-a934-4877-9c37-4658467cf353 tempest-ServerActionsTestOtherA-1229582533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-08bf7294-f24f-417e-806c-bfbb6b23ef76 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:03:05 devstack sudo[88153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-08bf7294-f24f-417e-806c-bfbb6b23ef76
Nov 06 17:03:05 devstack sudo[88153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:03:05 devstack sudo[88153]: pam_unix(sudo:session): session closed for user root
Nov 06 17:03:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3e49b339-a934-4877-9c37-4658467cf353 tempest-ServerActionsTestOtherA-1229582533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-08bf7294-f24f-417e-806c-bfbb6b23ef76" returned: 0 in 0.424s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:03:05 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3e49b339-a934-4877-9c37-4658467cf353 tempest-ServerActionsTestOtherA-1229582533 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:03:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3e49b339-a934-4877-9c37-4658467cf353 tempest-ServerActionsTestOtherA-1229582533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:03:05 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3e49b339-a934-4877-9c37-4658467cf353 tempest-ServerActionsTestOtherA-1229582533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9cc40b5-7981-4d04-9d00-1588e2c8c482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08bf7294-f24f-417e-806c-bfbb6b23ef76', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:03:05 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3e49b339-a934-4877-9c37-4658467cf353 tempest-ServerActionsTestOtherA-1229582533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bc1a087-c205-4a53-b8b0-e1ec24c9a2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:03:05 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-3e49b339-a934-4877-9c37-4658467cf353 tempest-ServerActionsTestOtherA-1229582533 None] Volume volume-08bf7294-f24f-417e-806c-bfbb6b23ef76 (08bf7294-f24f-417e-806c-bfbb6b23ef76): created successfully
Nov 06 17:03:05 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3e49b339-a934-4877-9c37-4658467cf353 tempest-ServerActionsTestOtherA-1229582533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bc1a087-c205-4a53-b8b0-e1ec24c9a2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:03:05 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3e49b339-a934-4877-9c37-4658467cf353 tempest-ServerActionsTestOtherA-1229582533 None] Flow 'volume_create_manager' (f0aacf15-d81c-4d83-b253-03498232dcba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:03:05 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-3e49b339-a934-4877-9c37-4658467cf353 tempest-ServerActionsTestOtherA-1229582533 None] Created volume successfully.
Nov 06 17:03:09 devstack cinder-volume[86856]: WARNING py.warnings [req-cd3f50f4-ed47-4a1c-8d29-ed9642a2b9e9 req-4d3e5bf7-f231-4077-aba7-03e0f604aad6 tempest-AttachVolumeNegativeTest-706916992 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Nov 06 17:03:09 devstack cinder-volume[86856]:   .first()
Nov 06 17:03:09 devstack cinder-volume[86856]: 
Nov 06 17:03:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-cd3f50f4-ed47-4a1c-8d29-ed9642a2b9e9 req-4d3e5bf7-f231-4077-aba7-03e0f604aad6 tempest-AttachVolumeNegativeTest-706916992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:03:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-cd3f50f4-ed47-4a1c-8d29-ed9642a2b9e9 req-4d3e5bf7-f231-4077-aba7-03e0f604aad6 tempest-AttachVolumeNegativeTest-706916992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:03:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-cd3f50f4-ed47-4a1c-8d29-ed9642a2b9e9 req-4d3e5bf7-f231-4077-aba7-03e0f604aad6 tempest-AttachVolumeNegativeTest-706916992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:03:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-cd3f50f4-ed47-4a1c-8d29-ed9642a2b9e9 req-4d3e5bf7-f231-4077-aba7-03e0f604aad6 tempest-AttachVolumeNegativeTest-706916992 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316', 'name': 'volume-b9a37bff-5d79-4ee5-8141-ba0b1791d010', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '80867495-8f8e-4f03-98cd-8df0e6996eba', 'enforce_multipath': True} {{(pid=86856) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 17:03:09 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-cd3f50f4-ed47-4a1c-8d29-ed9642a2b9e9 req-4d3e5bf7-f231-4077-aba7-03e0f604aad6 tempest-AttachVolumeNegativeTest-706916992 None] attachment_update completed successfully.
Nov 06 17:03:19 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=10,cinder:UPDATE=14,cinder:INSERT=3 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:03:19 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=15,cinder:UPDATE=7,cinder:DELETE=3 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:03:23 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-6729e747-9edc-4e6b-8a3d-d46ac9d54b9d req-750fe2a8-d6bb-4fe2-b8fd-03f1c0465637 tempest-AttachVolumeShelveTestJSON-1273115812 None] No connector for attachment 4c12fbec-3e8c-4b2f-90c2-9ce80095d688; skipping storage backend terminate_connection call. {{(pid=86856) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Nov 06 17:03:23 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-6729e747-9edc-4e6b-8a3d-d46ac9d54b9d req-750fe2a8-d6bb-4fe2-b8fd-03f1c0465637 tempest-AttachVolumeShelveTestJSON-1273115812 None] Deleting attachment 4c12fbec-3e8c-4b2f-90c2-9ce80095d688. {{(pid=86856) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 17:03:33 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=1 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:03:33 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=1 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:03:42 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:03:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:03:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:03:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:03:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:03:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:03:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:03:42 devstack sudo[88945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:03:42 devstack sudo[88945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:03:42 devstack sudo[88945]: pam_unix(sudo:session): session closed for user root
Nov 06 17:03:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.485s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:03:42 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:03:42 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager._thread_info {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:03:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread count: 6 {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 17:03:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread info: [<_MainThread(MainThread, started 125183137599616)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125183027608256)>, <Thread(Thread-3 (stat_writer), started daemon 125183025243776)>, <Thread(Rabbit-heartbeat, started daemon 125183023512896)>, <Thread(Thread-5 (_runner), started daemon 125183023357120)>, <Thread(Thread-7 (_runner), started daemon 125183021306496)>] {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 17:03:44 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=1 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:03:44 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:UPDATE=1 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:03:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-2549a4bb-0d78-4066-9efd-96d8ffdeff98 req-c74d011e-9df3-4ecd-99b0-c536faf22119 tempest-ServerActionsTestOtherA-1229582533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:03:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-2549a4bb-0d78-4066-9efd-96d8ffdeff98 req-c74d011e-9df3-4ecd-99b0-c536faf22119 tempest-ServerActionsTestOtherA-1229582533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:03:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-2549a4bb-0d78-4066-9efd-96d8ffdeff98 req-c74d011e-9df3-4ecd-99b0-c536faf22119 tempest-ServerActionsTestOtherA-1229582533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:03:46 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-2549a4bb-0d78-4066-9efd-96d8ffdeff98 req-c74d011e-9df3-4ecd-99b0-c536faf22119 tempest-ServerActionsTestOtherA-1229582533 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316', 'name': 'volume-08bf7294-f24f-417e-806c-bfbb6b23ef76', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b7b71af7-077e-431f-b00d-74b2d2669b00', 'enforce_multipath': True} {{(pid=86856) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 17:03:46 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-2549a4bb-0d78-4066-9efd-96d8ffdeff98 req-c74d011e-9df3-4ecd-99b0-c536faf22119 tempest-ServerActionsTestOtherA-1229582533 None] attachment_update completed successfully.
Nov 06 17:03:50 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-d81bfd27-d85a-417c-ac2c-b462b1d62270 req-01b1b017-8d9e-4dc4-94b9-ef7b830dd8fc tempest-ServerActionsTestOtherA-1229582533 None] Terminate volume connection completed successfully.
Nov 06 17:03:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-d81bfd27-d85a-417c-ac2c-b462b1d62270 req-01b1b017-8d9e-4dc4-94b9-ef7b830dd8fc tempest-ServerActionsTestOtherA-1229582533 None] Deleting attachment b7b71af7-077e-431f-b00d-74b2d2669b00. {{(pid=86856) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 17:03:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-d81bfd27-d85a-417c-ac2c-b462b1d62270 req-d8668525-5c0e-4538-8561-b3904c80342d tempest-ServerActionsTestOtherA-1229582533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:03:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-d81bfd27-d85a-417c-ac2c-b462b1d62270 req-d8668525-5c0e-4538-8561-b3904c80342d tempest-ServerActionsTestOtherA-1229582533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:03:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-d81bfd27-d85a-417c-ac2c-b462b1d62270 req-d8668525-5c0e-4538-8561-b3904c80342d tempest-ServerActionsTestOtherA-1229582533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:03:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-d81bfd27-d85a-417c-ac2c-b462b1d62270 req-d8668525-5c0e-4538-8561-b3904c80342d tempest-ServerActionsTestOtherA-1229582533 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316', 'name': 'volume-08bf7294-f24f-417e-806c-bfbb6b23ef76', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bccff001-f7e3-48d1-91f2-73ec047a70c4', 'enforce_multipath': True} {{(pid=86856) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 17:03:52 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-d81bfd27-d85a-417c-ac2c-b462b1d62270 req-d8668525-5c0e-4538-8561-b3904c80342d tempest-ServerActionsTestOtherA-1229582533 None] attachment_update completed successfully.
Nov 06 17:04:02 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=12,cinder:UPDATE=2 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:04:02 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=16,cinder:UPDATE=4 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:04:03 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeedda75-a27f-459d-ace2-00a65660ba67 tempest-VolumesAdminNegativeTest-1636633995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:04:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-aeedda75-a27f-459d-ace2-00a65660ba67 tempest-VolumesAdminNegativeTest-1636633995 None] Flow 'volume_create_manager' (77d89b84-e03d-4734-86fe-32305116b8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:04:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-aeedda75-a27f-459d-ace2-00a65660ba67 tempest-VolumesAdminNegativeTest-1636633995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dbd9614-c814-401f-a6fd-64a92415002a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:04:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-aeedda75-a27f-459d-ace2-00a65660ba67 tempest-VolumesAdminNegativeTest-1636633995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dbd9614-c814-401f-a6fd-64a92415002a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1067179290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12517e99-6f1c-4134-b784-b6f5b5bfcfa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f1a429077164949bb5d98c5b046c5f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:04:04Z,use_quota=True,user_id='08a5cb7e4164473d8a0395d34734a313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:04:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-aeedda75-a27f-459d-ace2-00a65660ba67 tempest-VolumesAdminNegativeTest-1636633995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (203ae5a5-4eb3-452f-89e9-ce03fa1c41ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:04:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-aeedda75-a27f-459d-ace2-00a65660ba67 tempest-VolumesAdminNegativeTest-1636633995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (203ae5a5-4eb3-452f-89e9-ce03fa1c41ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:04:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-aeedda75-a27f-459d-ace2-00a65660ba67 tempest-VolumesAdminNegativeTest-1636633995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73aa388c-96dc-4de1-9bfc-a0f33a89718d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:04:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-aeedda75-a27f-459d-ace2-00a65660ba67 tempest-VolumesAdminNegativeTest-1636633995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73aa388c-96dc-4de1-9bfc-a0f33a89718d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12517e99-6f1c-4134-b784-b6f5b5bfcfa6', 'volume_name': 'volume-12517e99-6f1c-4134-b784-b6f5b5bfcfa6', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:04:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-aeedda75-a27f-459d-ace2-00a65660ba67 tempest-VolumesAdminNegativeTest-1636633995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68cf9371-dae7-4cfd-9cb4-5cbfb7e1db2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:04:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-aeedda75-a27f-459d-ace2-00a65660ba67 tempest-VolumesAdminNegativeTest-1636633995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68cf9371-dae7-4cfd-9cb4-5cbfb7e1db2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:04:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-aeedda75-a27f-459d-ace2-00a65660ba67 tempest-VolumesAdminNegativeTest-1636633995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e87a589-83af-4326-a9f4-cc49e3adbc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:04:03 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-aeedda75-a27f-459d-ace2-00a65660ba67 tempest-VolumesAdminNegativeTest-1636633995 None] Volume 12517e99-6f1c-4134-b784-b6f5b5bfcfa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12517e99-6f1c-4134-b784-b6f5b5bfcfa6', 'volume_size': 1}
Nov 06 17:04:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-aeedda75-a27f-459d-ace2-00a65660ba67 tempest-VolumesAdminNegativeTest-1636633995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:04:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-aeedda75-a27f-459d-ace2-00a65660ba67 tempest-VolumesAdminNegativeTest-1636633995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:04:03 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-aeedda75-a27f-459d-ace2-00a65660ba67 tempest-VolumesAdminNegativeTest-1636633995 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1067179290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12517e99-6f1c-4134-b784-b6f5b5bfcfa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f1a429077164949bb5d98c5b046c5f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:04:04Z,use_quota=True,user_id='08a5cb7e4164473d8a0395d34734a313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:04:03 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-aeedda75-a27f-459d-ace2-00a65660ba67 tempest-VolumesAdminNegativeTest-1636633995 None] Creating volume 12517e99-6f1c-4134-b784-b6f5b5bfcfa6 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:04:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-aeedda75-a27f-459d-ace2-00a65660ba67 tempest-VolumesAdminNegativeTest-1636633995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:04:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-aeedda75-a27f-459d-ace2-00a65660ba67 tempest-VolumesAdminNegativeTest-1636633995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:04:03 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-aeedda75-a27f-459d-ace2-00a65660ba67 tempest-VolumesAdminNegativeTest-1636633995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:04:03 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-aeedda75-a27f-459d-ace2-00a65660ba67 tempest-VolumesAdminNegativeTest-1636633995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:04:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-aeedda75-a27f-459d-ace2-00a65660ba67 tempest-VolumesAdminNegativeTest-1636633995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:04:03 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-aeedda75-a27f-459d-ace2-00a65660ba67 tempest-VolumesAdminNegativeTest-1636633995 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:04:03 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-aeedda75-a27f-459d-ace2-00a65660ba67 tempest-VolumesAdminNegativeTest-1636633995 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:04:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-aeedda75-a27f-459d-ace2-00a65660ba67 tempest-VolumesAdminNegativeTest-1636633995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-12517e99-6f1c-4134-b784-b6f5b5bfcfa6 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:04:03 devstack sudo[89318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-12517e99-6f1c-4134-b784-b6f5b5bfcfa6 1073741824
Nov 06 17:04:03 devstack sudo[89318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:04:04 devstack sudo[89318]: pam_unix(sudo:session): session closed for user root
Nov 06 17:04:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-aeedda75-a27f-459d-ace2-00a65660ba67 tempest-VolumesAdminNegativeTest-1636633995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-12517e99-6f1c-4134-b784-b6f5b5bfcfa6 1073741824" returned: 0 in 0.580s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:04:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-aeedda75-a27f-459d-ace2-00a65660ba67 tempest-VolumesAdminNegativeTest-1636633995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-12517e99-6f1c-4134-b784-b6f5b5bfcfa6 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:04:04 devstack sudo[89324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-12517e99-6f1c-4134-b784-b6f5b5bfcfa6
Nov 06 17:04:04 devstack sudo[89324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:04:04 devstack sudo[89324]: pam_unix(sudo:session): session closed for user root
Nov 06 17:04:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-aeedda75-a27f-459d-ace2-00a65660ba67 tempest-VolumesAdminNegativeTest-1636633995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-12517e99-6f1c-4134-b784-b6f5b5bfcfa6" returned: 0 in 0.446s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:04:04 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-aeedda75-a27f-459d-ace2-00a65660ba67 tempest-VolumesAdminNegativeTest-1636633995 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:04:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-aeedda75-a27f-459d-ace2-00a65660ba67 tempest-VolumesAdminNegativeTest-1636633995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:04:05 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-aeedda75-a27f-459d-ace2-00a65660ba67 tempest-VolumesAdminNegativeTest-1636633995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e87a589-83af-4326-a9f4-cc49e3adbc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12517e99-6f1c-4134-b784-b6f5b5bfcfa6', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:04:05 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-aeedda75-a27f-459d-ace2-00a65660ba67 tempest-VolumesAdminNegativeTest-1636633995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a627c794-22ed-4320-af3e-450f520e17af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:04:05 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-aeedda75-a27f-459d-ace2-00a65660ba67 tempest-VolumesAdminNegativeTest-1636633995 None] Volume volume-12517e99-6f1c-4134-b784-b6f5b5bfcfa6 (12517e99-6f1c-4134-b784-b6f5b5bfcfa6): created successfully
Nov 06 17:04:05 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-aeedda75-a27f-459d-ace2-00a65660ba67 tempest-VolumesAdminNegativeTest-1636633995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a627c794-22ed-4320-af3e-450f520e17af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:04:05 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-aeedda75-a27f-459d-ace2-00a65660ba67 tempest-VolumesAdminNegativeTest-1636633995 None] Flow 'volume_create_manager' (77d89b84-e03d-4734-86fe-32305116b8c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:04:05 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-aeedda75-a27f-459d-ace2-00a65660ba67 tempest-VolumesAdminNegativeTest-1636633995 None] Created volume successfully.
Nov 06 17:04:06 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f2667bc5-7aef-4744-a899-a47b5b49cfc9 tempest-VolumesAdminNegativeTest-1636633995 None] Acquiring lock "cinder-12517e99-6f1c-4134-b784-b6f5b5bfcfa6-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:04:06 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f2667bc5-7aef-4744-a899-a47b5b49cfc9 tempest-VolumesAdminNegativeTest-1636633995 None] Lock "cinder-12517e99-6f1c-4134-b784-b6f5b5bfcfa6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:04:06 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f2667bc5-7aef-4744-a899-a47b5b49cfc9 tempest-VolumesAdminNegativeTest-1636633995 None] Acquiring lock "cinder-quobyte-12517e99-6f1c-4134-b784-b6f5b5bfcfa6" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:04:06 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f2667bc5-7aef-4744-a899-a47b5b49cfc9 tempest-VolumesAdminNegativeTest-1636633995 None] Lock "cinder-quobyte-12517e99-6f1c-4134-b784-b6f5b5bfcfa6" acquired by "delete_volume" :: waited 0.022s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:04:06 devstack cinder-volume[86856]: INFO oslo.privsep.daemon [None req-f2667bc5-7aef-4744-a899-a47b5b49cfc9 tempest-VolumesAdminNegativeTest-1636633995 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpqq1rtxna/privsep.sock']
Nov 06 17:04:06 devstack sudo[89328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpqq1rtxna/privsep.sock
Nov 06 17:04:06 devstack sudo[89328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:04:07 devstack cinder-volume[86856]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Nov 06 17:04:07 devstack cinder-volume[86856]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 06 17:04:07 devstack cinder-volume[86856]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Nov 06 17:04:07 devstack cinder-volume[86856]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 06 17:04:07 devstack cinder-volume[86856]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Nov 06 17:04:07 devstack cinder-volume[86856]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Nov 06 17:04:07 devstack cinder-volume[86856]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 06 17:04:07 devstack cinder-volume[86856]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 06 17:04:07 devstack cinder-volume[86856]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Nov 06 17:04:08 devstack sudo[89328]: pam_unix(sudo:session): session closed for user root
Nov 06 17:04:08 devstack cinder-volume[86856]: INFO oslo.privsep.daemon [None req-f2667bc5-7aef-4744-a899-a47b5b49cfc9 tempest-VolumesAdminNegativeTest-1636633995 None] Spawned new privsep daemon via rootwrap
Nov 06 17:04:08 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [None req-f2667bc5-7aef-4744-a899-a47b5b49cfc9 tempest-VolumesAdminNegativeTest-1636633995 None] Accepted privsep connection to /tmp/tmpqq1rtxna/privsep.sock {{(pid=86856) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Nov 06 17:04:08 devstack cinder-volume[86856]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 06 17:04:08 devstack cinder-volume[86856]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 06 17:04:08 devstack cinder-volume[86856]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 06 17:04:08 devstack cinder-volume[86856]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89335
Nov 06 17:04:08 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f82f02-2fe0-4bca-ab7a-95201d3800ea]: (2,) {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:04:08 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[98029729-7abb-4deb-81c5-28dc53b3631e]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:04:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f2667bc5-7aef-4744-a899-a47b5b49cfc9 tempest-VolumesAdminNegativeTest-1636633995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-12517e99-6f1c-4134-b784-b6f5b5bfcfa6 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:04:09 devstack sudo[89357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-12517e99-6f1c-4134-b784-b6f5b5bfcfa6
Nov 06 17:04:09 devstack sudo[89357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:04:09 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-eccfc88d-e2e3-4899-92b9-e590f082a7be req-5d96802a-d3c0-4db8-9e07-b375c382e2fd tempest-AttachVolumeNegativeTest-706916992 None] Terminate volume connection completed successfully.
Nov 06 17:04:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-eccfc88d-e2e3-4899-92b9-e590f082a7be req-5d96802a-d3c0-4db8-9e07-b375c382e2fd tempest-AttachVolumeNegativeTest-706916992 None] Deleting attachment 80867495-8f8e-4f03-98cd-8df0e6996eba. {{(pid=86856) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 17:04:10 devstack sudo[89357]: pam_unix(sudo:session): session closed for user root
Nov 06 17:04:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f2667bc5-7aef-4744-a899-a47b5b49cfc9 tempest-VolumesAdminNegativeTest-1636633995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-12517e99-6f1c-4134-b784-b6f5b5bfcfa6" returned: 0 in 1.265s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:04:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f2667bc5-7aef-4744-a899-a47b5b49cfc9 tempest-VolumesAdminNegativeTest-1636633995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-12517e99-6f1c-4134-b784-b6f5b5bfcfa6 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:04:10 devstack sudo[89368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-12517e99-6f1c-4134-b784-b6f5b5bfcfa6
Nov 06 17:04:10 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:04:10 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root
Nov 06 17:04:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f2667bc5-7aef-4744-a899-a47b5b49cfc9 tempest-VolumesAdminNegativeTest-1636633995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-12517e99-6f1c-4134-b784-b6f5b5bfcfa6" returned: 0 in 0.394s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:04:10 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f2667bc5-7aef-4744-a899-a47b5b49cfc9 tempest-VolumesAdminNegativeTest-1636633995 None] Lock "cinder-quobyte-12517e99-6f1c-4134-b784-b6f5b5bfcfa6" released by "delete_volume" :: held 4.186s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:04:10 devstack cinder-volume[86856]: WARNING cinder.quota [None req-f2667bc5-7aef-4744-a899-a47b5b49cfc9 tempest-VolumesAdminNegativeTest-1636633995 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 06 17:04:10 devstack cinder-volume[86856]: WARNING cinder.quota [None req-f2667bc5-7aef-4744-a899-a47b5b49cfc9 tempest-VolumesAdminNegativeTest-1636633995 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 06 17:04:10 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-f2667bc5-7aef-4744-a899-a47b5b49cfc9 tempest-VolumesAdminNegativeTest-1636633995 None] Created reservations ['ef281e76-37e2-4bc2-a29e-7b3762716067', '8192a1a5-0291-45b1-8148-72fc19bb4f21', '4bd2849a-4b90-469f-9917-9d6777eef35f', 'd3656286-7992-450f-915a-0006fa7c15f5'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:04:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f2667bc5-7aef-4744-a899-a47b5b49cfc9 tempest-VolumesAdminNegativeTest-1636633995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:04:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f2667bc5-7aef-4744-a899-a47b5b49cfc9 tempest-VolumesAdminNegativeTest-1636633995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:04:10 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-f2667bc5-7aef-4744-a899-a47b5b49cfc9 tempest-VolumesAdminNegativeTest-1636633995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:04:10 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-f2667bc5-7aef-4744-a899-a47b5b49cfc9 tempest-VolumesAdminNegativeTest-1636633995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:04:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f2667bc5-7aef-4744-a899-a47b5b49cfc9 tempest-VolumesAdminNegativeTest-1636633995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:04:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f2667bc5-7aef-4744-a899-a47b5b49cfc9 tempest-VolumesAdminNegativeTest-1636633995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:04:10 devstack sudo[89421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:04:10 devstack sudo[89421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:04:11 devstack sudo[89421]: pam_unix(sudo:session): session closed for user root
Nov 06 17:04:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f2667bc5-7aef-4744-a899-a47b5b49cfc9 tempest-VolumesAdminNegativeTest-1636633995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 1.064s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:04:12 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-f2667bc5-7aef-4744-a899-a47b5b49cfc9 tempest-VolumesAdminNegativeTest-1636633995 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:04:12 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-f2667bc5-7aef-4744-a899-a47b5b49cfc9 tempest-VolumesAdminNegativeTest-1636633995 None] Deleted volume successfully.
Nov 06 17:04:12 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f2667bc5-7aef-4744-a899-a47b5b49cfc9 tempest-VolumesAdminNegativeTest-1636633995 None] Lock "cinder-12517e99-6f1c-4134-b784-b6f5b5bfcfa6-delete_volume" released by "delete_volume" :: held 5.841s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:04:14 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bfac86cf-0adb-42e6-b804-7cdbe01b0852 tempest-AttachVolumeShelveTestJSON-1273115812 None] Acquiring lock "cinder-5d94064a-ba82-4e75-8eeb-eede11d89d9f-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:04:14 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bfac86cf-0adb-42e6-b804-7cdbe01b0852 tempest-AttachVolumeShelveTestJSON-1273115812 None] Lock "cinder-5d94064a-ba82-4e75-8eeb-eede11d89d9f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:04:14 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bfac86cf-0adb-42e6-b804-7cdbe01b0852 tempest-AttachVolumeShelveTestJSON-1273115812 None] Acquiring lock "cinder-quobyte-5d94064a-ba82-4e75-8eeb-eede11d89d9f" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:04:14 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bfac86cf-0adb-42e6-b804-7cdbe01b0852 tempest-AttachVolumeShelveTestJSON-1273115812 None] Lock "cinder-quobyte-5d94064a-ba82-4e75-8eeb-eede11d89d9f" acquired by "delete_volume" :: waited 0.014s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:04:14 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa2afb9-b862-46ad-9b37-fdbe6d11062e]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:04:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bfac86cf-0adb-42e6-b804-7cdbe01b0852 tempest-AttachVolumeShelveTestJSON-1273115812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d94064a-ba82-4e75-8eeb-eede11d89d9f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:04:14 devstack sudo[89469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d94064a-ba82-4e75-8eeb-eede11d89d9f
Nov 06 17:04:14 devstack sudo[89469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:04:14 devstack sudo[89469]: pam_unix(sudo:session): session closed for user root
Nov 06 17:04:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bfac86cf-0adb-42e6-b804-7cdbe01b0852 tempest-AttachVolumeShelveTestJSON-1273115812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d94064a-ba82-4e75-8eeb-eede11d89d9f" returned: 0 in 0.493s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:04:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bfac86cf-0adb-42e6-b804-7cdbe01b0852 tempest-AttachVolumeShelveTestJSON-1273115812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d94064a-ba82-4e75-8eeb-eede11d89d9f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:04:15 devstack sudo[89475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d94064a-ba82-4e75-8eeb-eede11d89d9f
Nov 06 17:04:15 devstack sudo[89475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:04:15 devstack sudo[89475]: pam_unix(sudo:session): session closed for user root
Nov 06 17:04:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bfac86cf-0adb-42e6-b804-7cdbe01b0852 tempest-AttachVolumeShelveTestJSON-1273115812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d94064a-ba82-4e75-8eeb-eede11d89d9f" returned: 0 in 0.279s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:04:15 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bfac86cf-0adb-42e6-b804-7cdbe01b0852 tempest-AttachVolumeShelveTestJSON-1273115812 None] Lock "cinder-quobyte-5d94064a-ba82-4e75-8eeb-eede11d89d9f" released by "delete_volume" :: held 0.824s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:04:15 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-bfac86cf-0adb-42e6-b804-7cdbe01b0852 tempest-AttachVolumeShelveTestJSON-1273115812 None] Created reservations ['810a2de8-0e8d-4ec8-828e-dcc7bccd3fbb', '4aa81ee1-4c71-45ff-b4e2-65b206298e8a', '0ea6490e-a0e7-42d8-9487-a7bdf10c8356', '36d26987-87a7-48c1-8b36-e84145eb8fd6'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:04:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bfac86cf-0adb-42e6-b804-7cdbe01b0852 tempest-AttachVolumeShelveTestJSON-1273115812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:04:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bfac86cf-0adb-42e6-b804-7cdbe01b0852 tempest-AttachVolumeShelveTestJSON-1273115812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:04:15 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bfac86cf-0adb-42e6-b804-7cdbe01b0852 tempest-AttachVolumeShelveTestJSON-1273115812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:04:15 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bfac86cf-0adb-42e6-b804-7cdbe01b0852 tempest-AttachVolumeShelveTestJSON-1273115812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:04:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bfac86cf-0adb-42e6-b804-7cdbe01b0852 tempest-AttachVolumeShelveTestJSON-1273115812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:04:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bfac86cf-0adb-42e6-b804-7cdbe01b0852 tempest-AttachVolumeShelveTestJSON-1273115812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:04:15 devstack sudo[89478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:04:15 devstack sudo[89478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:04:15 devstack sudo[89478]: pam_unix(sudo:session): session closed for user root
Nov 06 17:04:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bfac86cf-0adb-42e6-b804-7cdbe01b0852 tempest-AttachVolumeShelveTestJSON-1273115812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.259s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:04:15 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-bfac86cf-0adb-42e6-b804-7cdbe01b0852 tempest-AttachVolumeShelveTestJSON-1273115812 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:04:15 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-bfac86cf-0adb-42e6-b804-7cdbe01b0852 tempest-AttachVolumeShelveTestJSON-1273115812 None] Deleted volume successfully.
Nov 06 17:04:15 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bfac86cf-0adb-42e6-b804-7cdbe01b0852 tempest-AttachVolumeShelveTestJSON-1273115812 None] Lock "cinder-5d94064a-ba82-4e75-8eeb-eede11d89d9f-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:04:25 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=13,cinder:UPDATE=21,cinder:DELETE=2,cinder:INSERT=4 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:04:25 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=13,cinder:UPDATE=17,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:04:38 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-8f394bf5-c3bd-460f-8a18-d2b3d821a61d req-68bb7bd6-7e02-469d-96c4-019de32dd186 tempest-ServerActionsTestOtherA-1229582533 None] Terminate volume connection completed successfully.
Nov 06 17:04:38 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-8f394bf5-c3bd-460f-8a18-d2b3d821a61d req-68bb7bd6-7e02-469d-96c4-019de32dd186 tempest-ServerActionsTestOtherA-1229582533 None] Deleting attachment bccff001-f7e3-48d1-91f2-73ec047a70c4. {{(pid=86856) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 17:04:42 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:04:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:04:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:04:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:04:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:04:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:04:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:04:42 devstack sudo[89689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:04:42 devstack sudo[89689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:04:42 devstack sudo[89689]: pam_unix(sudo:session): session closed for user root
Nov 06 17:04:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.486s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:04:42 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:04:42 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager._thread_info {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:04:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread count: 8 {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 17:04:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread info: [<_MainThread(MainThread, started 125183137599616)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125183027608256)>, <Thread(Thread-3 (stat_writer), started daemon 125183025243776)>, <Thread(Rabbit-heartbeat, started daemon 125183023512896)>, <Thread(Thread-5 (_runner), started daemon 125183023357120)>, <Thread(Thread-7 (_runner), started daemon 125183021306496)>, <Thread(fd_logger, started daemon 125183018711616)>, <Thread(privsep_reader, started daemon 125183017484224)>] {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 17:04:48 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=1 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:04:48 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=1 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:04:48 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:04:48 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Flow 'volume_create_manager' (8df2192f-e9b5-43aa-ac60-27b876b1cbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:04:48 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (852140c4-3a28-4bfe-9520-b35b89d80787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:04:48 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (852140c4-3a28-4bfe-9520-b35b89d80787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-371265577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10a68d5c-f639-47cb-b05b-5df7a99e174d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b545bcbead748a7a4fcb90497cb390a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:04:48Z,use_quota=True,user_id='3d05bf4fa8234864ba4781d35d5aa19d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:04:48 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e9db69-c03f-417d-ba7f-364a7d910783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:04:48 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e9db69-c03f-417d-ba7f-364a7d910783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:04:48 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70392952-07aa-4cc1-a607-039ea2f4cea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:04:48 devstack cinder-volume[86856]: DEBUG cinder.image.glance [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Creating Keystone auth plugin from conf {{(pid=86856) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 06 17:04:48 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70392952-07aa-4cc1-a607-039ea2f4cea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '10a68d5c-f639-47cb-b05b-5df7a99e174d', 'volume_name': 'volume-10a68d5c-f639-47cb-b05b-5df7a99e174d', 'volume_size': 1, 'image_id': '420ae2ee-253a-40a6-ad62-b130f2314d4a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/420ae2ee-253a-40a6-ad62-b130f2314d4a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '805e2cf12fa14002ae5dfa994733f868', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '420ae2ee-253a-40a6-ad62-b130f2314d4a', 'created_at': datetime.datetime(2026, 11, 6, 15, 57, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 15, 57, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/420ae2ee-253a-40a6-ad62-b130f2314d4a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x71da7177b620>}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:04:48 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (812d9714-aa29-4357-8926-07c5d1e99c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:04:48 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (812d9714-aa29-4357-8926-07c5d1e99c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:04:48 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c1c1c5a-30fa-4abd-b84d-3f78f8008265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:04:48 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Volume 10a68d5c-f639-47cb-b05b-5df7a99e174d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-10a68d5c-f639-47cb-b05b-5df7a99e174d', 'volume_size': 1, 'image_id': '420ae2ee-253a-40a6-ad62-b130f2314d4a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/420ae2ee-253a-40a6-ad62-b130f2314d4a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '805e2cf12fa14002ae5dfa994733f868', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '420ae2ee-253a-40a6-ad62-b130f2314d4a', 'created_at': datetime.datetime(2026, 11, 6, 15, 57, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 15, 57, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/420ae2ee-253a-40a6-ad62-b130f2314d4a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x71da7177b620>}
Nov 06 17:04:48 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Trying to clone 10a68d5c-f639-47cb-b05b-5df7a99e174d from image 420ae2ee-253a-40a6-ad62-b130f2314d4a at location (None, [{'url': 'file:///opt/stack/data/glance/images/420ae2ee-253a-40a6-ad62-b130f2314d4a', 'metadata': {}}]). {{(pid=86856) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 06 17:04:49 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_a5c57r52devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86856) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 06 17:04:49 devstack cinder-volume[86856]: INFO cinder.image.image_utils [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Image download 20.69 MB at 20.69 MB/s
Nov 06 17:04:49 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeca8719-a578-4b55-ba3d-dc69f149ce9e]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:04:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_a5c57r52devstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:04:49 devstack sudo[89777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_a5c57r52devstack@QuobyteHD
Nov 06 17:04:49 devstack sudo[89777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:04:49 devstack sudo[89777]: pam_unix(sudo:session): session closed for user root
Nov 06 17:04:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_a5c57r52devstack@QuobyteHD" returned: 0 in 0.413s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:04:49 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Temporary image 420ae2ee-253a-40a6-ad62-b130f2314d4a is fetched for user 3d05bf4fa8234864ba4781d35d5aa19d. {{(pid=86856) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 06 17:04:49 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[e634e6d9-f176-43b9-a59c-a75aafe9bc1e]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:04:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_a5c57r52devstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:04:50 devstack sudo[89800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_a5c57r52devstack@QuobyteHD
Nov 06 17:04:50 devstack sudo[89800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:04:50 devstack sudo[89800]: pam_unix(sudo:session): session closed for user root
Nov 06 17:04:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_a5c57r52devstack@QuobyteHD" returned: 0 in 0.615s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:04:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:04:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:04:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-371265577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10a68d5c-f639-47cb-b05b-5df7a99e174d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b545bcbead748a7a4fcb90497cb390a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:04:48Z,use_quota=True,user_id='3d05bf4fa8234864ba4781d35d5aa19d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:04:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Creating volume 10a68d5c-f639-47cb-b05b-5df7a99e174d {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:04:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:04:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:04:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:04:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:04:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:04:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:04:50 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:04:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-10a68d5c-f639-47cb-b05b-5df7a99e174d 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:04:50 devstack sudo[89848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-10a68d5c-f639-47cb-b05b-5df7a99e174d 1073741824
Nov 06 17:04:50 devstack sudo[89848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:04:51 devstack sudo[89848]: pam_unix(sudo:session): session closed for user root
Nov 06 17:04:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-10a68d5c-f639-47cb-b05b-5df7a99e174d 1073741824" returned: 0 in 0.752s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:04:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-10a68d5c-f639-47cb-b05b-5df7a99e174d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:04:51 devstack sudo[89866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-10a68d5c-f639-47cb-b05b-5df7a99e174d
Nov 06 17:04:51 devstack sudo[89866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:04:51 devstack sudo[89866]: pam_unix(sudo:session): session closed for user root
Nov 06 17:04:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-10a68d5c-f639-47cb-b05b-5df7a99e174d" returned: 0 in 0.446s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:04:51 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] <== create_volume: return (1318ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:04:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:04:51 devstack cinder-volume[86856]: DEBUG cinder.volume.volume_utils [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Attempting download of 420ae2ee-253a-40a6-ad62-b130f2314d4a ((None, [{'url': 'file:///opt/stack/data/glance/images/420ae2ee-253a-40a6-ad62-b130f2314d4a', 'metadata': {}}])) to volume 10a68d5c-f639-47cb-b05b-5df7a99e174d. {{(pid=86856) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 06 17:04:51 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c1f7f6-6d6c-4711-804a-a05e8128ab87]: (4, 'raw') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:04:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_420ae2ee-253a-40a6-ad62-b130f2314d4a_7gjt5v05 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:04:52 devstack sudo[89870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_420ae2ee-253a-40a6-ad62-b130f2314d4a_7gjt5v05
Nov 06 17:04:52 devstack sudo[89870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:04:52 devstack sudo[89870]: pam_unix(sudo:session): session closed for user root
Nov 06 17:04:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_420ae2ee-253a-40a6-ad62-b130f2314d4a_7gjt5v05" returned: 0 in 0.349s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:04:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_420ae2ee-253a-40a6-ad62-b130f2314d4a_7gjt5v05 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:04:52 devstack sudo[89874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_420ae2ee-253a-40a6-ad62-b130f2314d4a_7gjt5v05
Nov 06 17:04:52 devstack sudo[89874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:04:52 devstack sudo[89874]: pam_unix(sudo:session): session closed for user root
Nov 06 17:04:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_420ae2ee-253a-40a6-ad62-b130f2314d4a_7gjt5v05" returned: 1 in 0.416s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:04:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_420ae2ee-253a-40a6-ad62-b130f2314d4a_7gjt5v05' failed. Not Retrying. {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 17:04:52 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aaf07b1-5053-475d-82a2-c4c6492bf30a]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:04:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_a5c57r52devstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:04:52 devstack sudo[89878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_a5c57r52devstack@QuobyteHD
Nov 06 17:04:52 devstack sudo[89878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:04:53 devstack sudo[89878]: pam_unix(sudo:session): session closed for user root
Nov 06 17:04:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_a5c57r52devstack@QuobyteHD" returned: 0 in 0.388s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:04:53 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] 420ae2ee-253a-40a6-ad62-b130f2314d4a was qcow2, converting to qcow2 {{(pid=86856) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 06 17:04:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_a5c57r52devstack@QuobyteHD /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-10a68d5c-f639-47cb-b05b-5df7a99e174d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:04:53 devstack sudo[89883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_a5c57r52devstack@QuobyteHD /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-10a68d5c-f639-47cb-b05b-5df7a99e174d
Nov 06 17:04:53 devstack sudo[89883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:04:55 devstack sudo[89883]: pam_unix(sudo:session): session closed for user root
Nov 06 17:04:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_a5c57r52devstack@QuobyteHD /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-10a68d5c-f639-47cb-b05b-5df7a99e174d" returned: 0 in 2.755s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:04:55 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_a5c57r52devstack@QuobyteHD, size 112.00 MB, duration 2.76 sec, destination /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-10a68d5c-f639-47cb-b05b-5df7a99e174d {{(pid=86856) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 17:04:55 devstack cinder-volume[86856]: INFO cinder.image.image_utils [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Converted 112.00 MB image at 40.63 MB/s
Nov 06 17:04:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-10a68d5c-f639-47cb-b05b-5df7a99e174d 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:04:55 devstack sudo[89895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-10a68d5c-f639-47cb-b05b-5df7a99e174d 1G
Nov 06 17:04:55 devstack sudo[89895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:04:56 devstack sudo[89895]: pam_unix(sudo:session): session closed for user root
Nov 06 17:04:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-10a68d5c-f639-47cb-b05b-5df7a99e174d 1G" returned: 0 in 0.679s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:04:56 devstack cinder-volume[86856]: DEBUG cinder.volume.volume_utils [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Downloaded image 420ae2ee-253a-40a6-ad62-b130f2314d4a ((None, [{'url': 'file:///opt/stack/data/glance/images/420ae2ee-253a-40a6-ad62-b130f2314d4a', 'metadata': {}}])) to volume 10a68d5c-f639-47cb-b05b-5df7a99e174d successfully. {{(pid=86856) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 06 17:04:56 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Temporary image 420ae2ee-253a-40a6-ad62-b130f2314d4a for user 3d05bf4fa8234864ba4781d35d5aa19d is deleted. {{(pid=86856) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 06 17:04:56 devstack cinder-volume[86856]: DEBUG cinder.volume.volume_utils [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Marking volume 10a68d5c-f639-47cb-b05b-5df7a99e174d as bootable. {{(pid=86856) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 06 17:04:56 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Copying metadata from image 420ae2ee-253a-40a6-ad62-b130f2314d4a to 10a68d5c-f639-47cb-b05b-5df7a99e174d. {{(pid=86856) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 06 17:04:56 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Creating volume glance metadata for volume 10a68d5c-f639-47cb-b05b-5df7a99e174d backed by image 420ae2ee-253a-40a6-ad62-b130f2314d4a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '420ae2ee-253a-40a6-ad62-b130f2314d4a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86856) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 06 17:04:56 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c1c1c5a-30fa-4abd-b84d-3f78f8008265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10a68d5c-f639-47cb-b05b-5df7a99e174d', 'volume_size': 1, 'image_id': '420ae2ee-253a-40a6-ad62-b130f2314d4a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/420ae2ee-253a-40a6-ad62-b130f2314d4a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '805e2cf12fa14002ae5dfa994733f868', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '420ae2ee-253a-40a6-ad62-b130f2314d4a', 'created_at': datetime.datetime(2026, 11, 6, 15, 57, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 15, 57, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/420ae2ee-253a-40a6-ad62-b130f2314d4a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x71da7177b620>}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:04:56 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c5d13a-e900-4fa3-b8f3-d00b41192c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:04:56 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Volume volume-10a68d5c-f639-47cb-b05b-5df7a99e174d (10a68d5c-f639-47cb-b05b-5df7a99e174d): created successfully
Nov 06 17:04:56 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c5d13a-e900-4fa3-b8f3-d00b41192c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:04:56 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Flow 'volume_create_manager' (8df2192f-e9b5-43aa-ac60-27b876b1cbc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:04:56 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-fcf439da-9620-4f3c-9ba1-1e7e7e5a0893 tempest-ServerActionsTestOtherA-1229582533 None] Created volume successfully.
Nov 06 17:05:02 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fcd4124-0d2d-4b71-91f2-d7cb26cf0faa tempest-AttachVolumeNegativeTest-706916992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:05:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3fcd4124-0d2d-4b71-91f2-d7cb26cf0faa tempest-AttachVolumeNegativeTest-706916992 None] Flow 'volume_create_manager' (48d4f273-0d0d-4e63-9d8e-26cdd4bfba87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:05:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3fcd4124-0d2d-4b71-91f2-d7cb26cf0faa tempest-AttachVolumeNegativeTest-706916992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad2aff0d-2fd9-438e-8768-e2cc8ccea284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:05:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3fcd4124-0d2d-4b71-91f2-d7cb26cf0faa tempest-AttachVolumeNegativeTest-706916992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad2aff0d-2fd9-438e-8768-e2cc8ccea284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-584203742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f531e27-5b35-4edd-9823-2c09514adf69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a04a9285705648f4853ea8791a1f7679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:05:02Z,use_quota=True,user_id='ff1a8d854cb4480ba8aef514e49dc3a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:05:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3fcd4124-0d2d-4b71-91f2-d7cb26cf0faa tempest-AttachVolumeNegativeTest-706916992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (253d240a-6d90-4ee8-83ba-c1d1ebffb2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:05:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3fcd4124-0d2d-4b71-91f2-d7cb26cf0faa tempest-AttachVolumeNegativeTest-706916992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (253d240a-6d90-4ee8-83ba-c1d1ebffb2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:05:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3fcd4124-0d2d-4b71-91f2-d7cb26cf0faa tempest-AttachVolumeNegativeTest-706916992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59ed2c1e-c575-4b90-858a-8d7603a086d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:05:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3fcd4124-0d2d-4b71-91f2-d7cb26cf0faa tempest-AttachVolumeNegativeTest-706916992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59ed2c1e-c575-4b90-858a-8d7603a086d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f531e27-5b35-4edd-9823-2c09514adf69', 'volume_name': 'volume-3f531e27-5b35-4edd-9823-2c09514adf69', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:05:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3fcd4124-0d2d-4b71-91f2-d7cb26cf0faa tempest-AttachVolumeNegativeTest-706916992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8762a941-3ca7-4616-9ce8-6d1674e87838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:05:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3fcd4124-0d2d-4b71-91f2-d7cb26cf0faa tempest-AttachVolumeNegativeTest-706916992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8762a941-3ca7-4616-9ce8-6d1674e87838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:05:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3fcd4124-0d2d-4b71-91f2-d7cb26cf0faa tempest-AttachVolumeNegativeTest-706916992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d73831a3-3f58-446f-9194-3fcb18129eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:05:02 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-3fcd4124-0d2d-4b71-91f2-d7cb26cf0faa tempest-AttachVolumeNegativeTest-706916992 None] Volume 3f531e27-5b35-4edd-9823-2c09514adf69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f531e27-5b35-4edd-9823-2c09514adf69', 'volume_size': 1}
Nov 06 17:05:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3fcd4124-0d2d-4b71-91f2-d7cb26cf0faa tempest-AttachVolumeNegativeTest-706916992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:05:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3fcd4124-0d2d-4b71-91f2-d7cb26cf0faa tempest-AttachVolumeNegativeTest-706916992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:05:02 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3fcd4124-0d2d-4b71-91f2-d7cb26cf0faa tempest-AttachVolumeNegativeTest-706916992 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-584203742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f531e27-5b35-4edd-9823-2c09514adf69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a04a9285705648f4853ea8791a1f7679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:05:02Z,use_quota=True,user_id='ff1a8d854cb4480ba8aef514e49dc3a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:05:02 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-3fcd4124-0d2d-4b71-91f2-d7cb26cf0faa tempest-AttachVolumeNegativeTest-706916992 None] Creating volume 3f531e27-5b35-4edd-9823-2c09514adf69 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:05:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3fcd4124-0d2d-4b71-91f2-d7cb26cf0faa tempest-AttachVolumeNegativeTest-706916992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:05:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3fcd4124-0d2d-4b71-91f2-d7cb26cf0faa tempest-AttachVolumeNegativeTest-706916992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:05:02 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3fcd4124-0d2d-4b71-91f2-d7cb26cf0faa tempest-AttachVolumeNegativeTest-706916992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:05:02 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3fcd4124-0d2d-4b71-91f2-d7cb26cf0faa tempest-AttachVolumeNegativeTest-706916992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:05:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3fcd4124-0d2d-4b71-91f2-d7cb26cf0faa tempest-AttachVolumeNegativeTest-706916992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:05:02 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3fcd4124-0d2d-4b71-91f2-d7cb26cf0faa tempest-AttachVolumeNegativeTest-706916992 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:05:02 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-3fcd4124-0d2d-4b71-91f2-d7cb26cf0faa tempest-AttachVolumeNegativeTest-706916992 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:05:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3fcd4124-0d2d-4b71-91f2-d7cb26cf0faa tempest-AttachVolumeNegativeTest-706916992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f531e27-5b35-4edd-9823-2c09514adf69 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:05:02 devstack sudo[89926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f531e27-5b35-4edd-9823-2c09514adf69 1073741824
Nov 06 17:05:02 devstack sudo[89926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:05:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-ee1621a7-4f87-4523-887e-e78f7627f86a req-ec8c108f-589a-4a32-88a3-fe532e8511dd tempest-ServerActionsTestOtherA-1229582533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:05:03 devstack sudo[89926]: pam_unix(sudo:session): session closed for user root
Nov 06 17:05:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3fcd4124-0d2d-4b71-91f2-d7cb26cf0faa tempest-AttachVolumeNegativeTest-706916992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f531e27-5b35-4edd-9823-2c09514adf69 1073741824" returned: 0 in 0.731s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:05:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3fcd4124-0d2d-4b71-91f2-d7cb26cf0faa tempest-AttachVolumeNegativeTest-706916992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f531e27-5b35-4edd-9823-2c09514adf69 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:05:03 devstack sudo[89932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f531e27-5b35-4edd-9823-2c09514adf69
Nov 06 17:05:03 devstack sudo[89932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:05:03 devstack sudo[89932]: pam_unix(sudo:session): session closed for user root
Nov 06 17:05:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3fcd4124-0d2d-4b71-91f2-d7cb26cf0faa tempest-AttachVolumeNegativeTest-706916992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f531e27-5b35-4edd-9823-2c09514adf69" returned: 0 in 0.455s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:05:03 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3fcd4124-0d2d-4b71-91f2-d7cb26cf0faa tempest-AttachVolumeNegativeTest-706916992 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:05:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3fcd4124-0d2d-4b71-91f2-d7cb26cf0faa tempest-AttachVolumeNegativeTest-706916992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:05:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-ee1621a7-4f87-4523-887e-e78f7627f86a req-ec8c108f-589a-4a32-88a3-fe532e8511dd tempest-ServerActionsTestOtherA-1229582533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.986s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:05:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3fcd4124-0d2d-4b71-91f2-d7cb26cf0faa tempest-AttachVolumeNegativeTest-706916992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d73831a3-3f58-446f-9194-3fcb18129eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f531e27-5b35-4edd-9823-2c09514adf69', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:05:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3fcd4124-0d2d-4b71-91f2-d7cb26cf0faa tempest-AttachVolumeNegativeTest-706916992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f06c9ce-895f-4daa-a9c8-b2ccb359d6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:05:03 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-3fcd4124-0d2d-4b71-91f2-d7cb26cf0faa tempest-AttachVolumeNegativeTest-706916992 None] Volume volume-3f531e27-5b35-4edd-9823-2c09514adf69 (3f531e27-5b35-4edd-9823-2c09514adf69): created successfully
Nov 06 17:05:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3fcd4124-0d2d-4b71-91f2-d7cb26cf0faa tempest-AttachVolumeNegativeTest-706916992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f06c9ce-895f-4daa-a9c8-b2ccb359d6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:05:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3fcd4124-0d2d-4b71-91f2-d7cb26cf0faa tempest-AttachVolumeNegativeTest-706916992 None] Flow 'volume_create_manager' (48d4f273-0d0d-4e63-9d8e-26cdd4bfba87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:05:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-ee1621a7-4f87-4523-887e-e78f7627f86a req-ec8c108f-589a-4a32-88a3-fe532e8511dd tempest-ServerActionsTestOtherA-1229582533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.216s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:05:03 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-3fcd4124-0d2d-4b71-91f2-d7cb26cf0faa tempest-AttachVolumeNegativeTest-706916992 None] Created volume successfully.
Nov 06 17:05:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-ee1621a7-4f87-4523-887e-e78f7627f86a req-ec8c108f-589a-4a32-88a3-fe532e8511dd tempest-ServerActionsTestOtherA-1229582533 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316', 'name': 'volume-10a68d5c-f639-47cb-b05b-5df7a99e174d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '517b0be7-a5fa-4030-852f-9a5fd90281d6', 'enforce_multipath': True} {{(pid=86856) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 17:05:03 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-ee1621a7-4f87-4523-887e-e78f7627f86a req-ec8c108f-589a-4a32-88a3-fe532e8511dd tempest-ServerActionsTestOtherA-1229582533 None] attachment_update completed successfully.
Nov 06 17:05:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-76c41005-4c8d-4841-b97f-faeeba57054b req-71000c5a-9960-4474-b3e2-77290c20a492 tempest-AttachVolumeNegativeTest-706916992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:05:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-76c41005-4c8d-4841-b97f-faeeba57054b req-71000c5a-9960-4474-b3e2-77290c20a492 tempest-AttachVolumeNegativeTest-706916992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:05:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-76c41005-4c8d-4841-b97f-faeeba57054b req-71000c5a-9960-4474-b3e2-77290c20a492 tempest-AttachVolumeNegativeTest-706916992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:05:05 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-76c41005-4c8d-4841-b97f-faeeba57054b req-71000c5a-9960-4474-b3e2-77290c20a492 tempest-AttachVolumeNegativeTest-706916992 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316', 'name': 'volume-3f531e27-5b35-4edd-9823-2c09514adf69', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6c54a49e-a65e-47b0-a3fe-aa12e9c1471f', 'enforce_multipath': True} {{(pid=86856) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 17:05:06 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-76c41005-4c8d-4841-b97f-faeeba57054b req-71000c5a-9960-4474-b3e2-77290c20a492 tempest-AttachVolumeNegativeTest-706916992 None] attachment_update completed successfully.
Nov 06 17:05:10 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-eb628ec2-31af-45fb-82e6-916f41a49856 req-a7a2dd18-bd04-450a-b028-4a6e64a577ca tempest-AttachVolumeNegativeTest-706916992 None] Terminate volume connection completed successfully.
Nov 06 17:05:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-eb628ec2-31af-45fb-82e6-916f41a49856 req-a7a2dd18-bd04-450a-b028-4a6e64a577ca tempest-AttachVolumeNegativeTest-706916992 None] Deleting attachment 6c54a49e-a65e-47b0-a3fe-aa12e9c1471f. {{(pid=86856) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 17:05:13 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-e650ac6f-a490-4f4d-a5f7-ae0b3579a4e3 tempest-DeleteServersTestJSON-1920525012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:05:13 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e650ac6f-a490-4f4d-a5f7-ae0b3579a4e3 tempest-DeleteServersTestJSON-1920525012 None] Flow 'volume_create_manager' (3fd9c05f-9ecc-449e-990a-12d36cdc655f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:05:13 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e650ac6f-a490-4f4d-a5f7-ae0b3579a4e3 tempest-DeleteServersTestJSON-1920525012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0adc8850-ec8f-4bcb-8495-ee06c281a967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:05:13 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e650ac6f-a490-4f4d-a5f7-ae0b3579a4e3 tempest-DeleteServersTestJSON-1920525012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0adc8850-ec8f-4bcb-8495-ee06c281a967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1751278113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3af8b8c-679e-4877-82c7-01a12bcc1f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527f33f5be7443619e0858d46154b71b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:05:14Z,use_quota=True,user_id='4d45f64a395341c9abfc24fc731b6d58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:05:13 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e650ac6f-a490-4f4d-a5f7-ae0b3579a4e3 tempest-DeleteServersTestJSON-1920525012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cad735e-85df-4668-b2f8-1b7c6bc7e6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:05:13 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e650ac6f-a490-4f4d-a5f7-ae0b3579a4e3 tempest-DeleteServersTestJSON-1920525012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cad735e-85df-4668-b2f8-1b7c6bc7e6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:05:13 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e650ac6f-a490-4f4d-a5f7-ae0b3579a4e3 tempest-DeleteServersTestJSON-1920525012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f6067f3-0c19-4069-ab8f-4334f931a3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:05:13 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e650ac6f-a490-4f4d-a5f7-ae0b3579a4e3 tempest-DeleteServersTestJSON-1920525012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f6067f3-0c19-4069-ab8f-4334f931a3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3af8b8c-679e-4877-82c7-01a12bcc1f3e', 'volume_name': 'volume-c3af8b8c-679e-4877-82c7-01a12bcc1f3e', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:05:13 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e650ac6f-a490-4f4d-a5f7-ae0b3579a4e3 tempest-DeleteServersTestJSON-1920525012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a9eb283-6546-48d4-8627-ec24b543cb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:05:14 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e650ac6f-a490-4f4d-a5f7-ae0b3579a4e3 tempest-DeleteServersTestJSON-1920525012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a9eb283-6546-48d4-8627-ec24b543cb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:05:14 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e650ac6f-a490-4f4d-a5f7-ae0b3579a4e3 tempest-DeleteServersTestJSON-1920525012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6516fe0a-a4a8-43d4-b351-0fdb0f15dde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:05:14 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-e650ac6f-a490-4f4d-a5f7-ae0b3579a4e3 tempest-DeleteServersTestJSON-1920525012 None] Volume c3af8b8c-679e-4877-82c7-01a12bcc1f3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3af8b8c-679e-4877-82c7-01a12bcc1f3e', 'volume_size': 1}
Nov 06 17:05:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e650ac6f-a490-4f4d-a5f7-ae0b3579a4e3 tempest-DeleteServersTestJSON-1920525012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:05:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e650ac6f-a490-4f4d-a5f7-ae0b3579a4e3 tempest-DeleteServersTestJSON-1920525012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:05:14 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e650ac6f-a490-4f4d-a5f7-ae0b3579a4e3 tempest-DeleteServersTestJSON-1920525012 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1751278113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3af8b8c-679e-4877-82c7-01a12bcc1f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527f33f5be7443619e0858d46154b71b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:05:14Z,use_quota=True,user_id='4d45f64a395341c9abfc24fc731b6d58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:05:14 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-e650ac6f-a490-4f4d-a5f7-ae0b3579a4e3 tempest-DeleteServersTestJSON-1920525012 None] Creating volume c3af8b8c-679e-4877-82c7-01a12bcc1f3e {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:05:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e650ac6f-a490-4f4d-a5f7-ae0b3579a4e3 tempest-DeleteServersTestJSON-1920525012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:05:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e650ac6f-a490-4f4d-a5f7-ae0b3579a4e3 tempest-DeleteServersTestJSON-1920525012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:05:14 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e650ac6f-a490-4f4d-a5f7-ae0b3579a4e3 tempest-DeleteServersTestJSON-1920525012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:05:14 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e650ac6f-a490-4f4d-a5f7-ae0b3579a4e3 tempest-DeleteServersTestJSON-1920525012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:05:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e650ac6f-a490-4f4d-a5f7-ae0b3579a4e3 tempest-DeleteServersTestJSON-1920525012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:05:14 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e650ac6f-a490-4f4d-a5f7-ae0b3579a4e3 tempest-DeleteServersTestJSON-1920525012 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:05:14 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-e650ac6f-a490-4f4d-a5f7-ae0b3579a4e3 tempest-DeleteServersTestJSON-1920525012 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:05:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e650ac6f-a490-4f4d-a5f7-ae0b3579a4e3 tempest-DeleteServersTestJSON-1920525012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c3af8b8c-679e-4877-82c7-01a12bcc1f3e 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:05:14 devstack sudo[90547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c3af8b8c-679e-4877-82c7-01a12bcc1f3e 1073741824
Nov 06 17:05:14 devstack sudo[90547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:05:15 devstack sudo[90547]: pam_unix(sudo:session): session closed for user root
Nov 06 17:05:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e650ac6f-a490-4f4d-a5f7-ae0b3579a4e3 tempest-DeleteServersTestJSON-1920525012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c3af8b8c-679e-4877-82c7-01a12bcc1f3e 1073741824" returned: 0 in 1.203s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:05:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e650ac6f-a490-4f4d-a5f7-ae0b3579a4e3 tempest-DeleteServersTestJSON-1920525012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c3af8b8c-679e-4877-82c7-01a12bcc1f3e {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:05:15 devstack sudo[90553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c3af8b8c-679e-4877-82c7-01a12bcc1f3e
Nov 06 17:05:15 devstack sudo[90553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:05:15 devstack sudo[90553]: pam_unix(sudo:session): session closed for user root
Nov 06 17:05:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e650ac6f-a490-4f4d-a5f7-ae0b3579a4e3 tempest-DeleteServersTestJSON-1920525012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c3af8b8c-679e-4877-82c7-01a12bcc1f3e" returned: 0 in 0.437s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:05:15 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e650ac6f-a490-4f4d-a5f7-ae0b3579a4e3 tempest-DeleteServersTestJSON-1920525012 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:05:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e650ac6f-a490-4f4d-a5f7-ae0b3579a4e3 tempest-DeleteServersTestJSON-1920525012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:05:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e650ac6f-a490-4f4d-a5f7-ae0b3579a4e3 tempest-DeleteServersTestJSON-1920525012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6516fe0a-a4a8-43d4-b351-0fdb0f15dde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3af8b8c-679e-4877-82c7-01a12bcc1f3e', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:05:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e650ac6f-a490-4f4d-a5f7-ae0b3579a4e3 tempest-DeleteServersTestJSON-1920525012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (753dcbc6-f044-422e-8f79-4f615553af56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:05:15 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-e650ac6f-a490-4f4d-a5f7-ae0b3579a4e3 tempest-DeleteServersTestJSON-1920525012 None] Volume volume-c3af8b8c-679e-4877-82c7-01a12bcc1f3e (c3af8b8c-679e-4877-82c7-01a12bcc1f3e): created successfully
Nov 06 17:05:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e650ac6f-a490-4f4d-a5f7-ae0b3579a4e3 tempest-DeleteServersTestJSON-1920525012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (753dcbc6-f044-422e-8f79-4f615553af56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:05:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e650ac6f-a490-4f4d-a5f7-ae0b3579a4e3 tempest-DeleteServersTestJSON-1920525012 None] Flow 'volume_create_manager' (3fd9c05f-9ecc-449e-990a-12d36cdc655f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:05:15 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-e650ac6f-a490-4f4d-a5f7-ae0b3579a4e3 tempest-DeleteServersTestJSON-1920525012 None] Created volume successfully.
Nov 06 17:05:17 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffe3d6ff-876e-4ba3-b69c-3772c6f1681b tempest-AttachVolumeTestJSON-951913559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:05:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ffe3d6ff-876e-4ba3-b69c-3772c6f1681b tempest-AttachVolumeTestJSON-951913559 None] Flow 'volume_create_manager' (53e05fc2-3491-49dc-bb61-9a88fc14249a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:05:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ffe3d6ff-876e-4ba3-b69c-3772c6f1681b tempest-AttachVolumeTestJSON-951913559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ed92856-d5e8-4fcf-9ee2-9c640a0c22e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:05:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ffe3d6ff-876e-4ba3-b69c-3772c6f1681b tempest-AttachVolumeTestJSON-951913559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ed92856-d5e8-4fcf-9ee2-9c640a0c22e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1146490008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4e15061-0c11-42ef-8e93-d3c3045dd38a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='958cd8b6170a4a698f40d7c517400c17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:05:17Z,use_quota=True,user_id='2af7ef660aa94c85acf5bff05ce43754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:05:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ffe3d6ff-876e-4ba3-b69c-3772c6f1681b tempest-AttachVolumeTestJSON-951913559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8d9b840-67c4-4d2e-8e54-3feb51335f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:05:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ffe3d6ff-876e-4ba3-b69c-3772c6f1681b tempest-AttachVolumeTestJSON-951913559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8d9b840-67c4-4d2e-8e54-3feb51335f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:05:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ffe3d6ff-876e-4ba3-b69c-3772c6f1681b tempest-AttachVolumeTestJSON-951913559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fe0b79a-91e2-436c-881e-13b9c5986ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:05:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ffe3d6ff-876e-4ba3-b69c-3772c6f1681b tempest-AttachVolumeTestJSON-951913559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fe0b79a-91e2-436c-881e-13b9c5986ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4e15061-0c11-42ef-8e93-d3c3045dd38a', 'volume_name': 'volume-e4e15061-0c11-42ef-8e93-d3c3045dd38a', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:05:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ffe3d6ff-876e-4ba3-b69c-3772c6f1681b tempest-AttachVolumeTestJSON-951913559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee9d6a9e-da9b-434a-9b4a-2cb78c38e1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:05:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ffe3d6ff-876e-4ba3-b69c-3772c6f1681b tempest-AttachVolumeTestJSON-951913559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee9d6a9e-da9b-434a-9b4a-2cb78c38e1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:05:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ffe3d6ff-876e-4ba3-b69c-3772c6f1681b tempest-AttachVolumeTestJSON-951913559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dafd85eb-d26e-4591-b002-9df8c19edfff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:05:17 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-ffe3d6ff-876e-4ba3-b69c-3772c6f1681b tempest-AttachVolumeTestJSON-951913559 None] Volume e4e15061-0c11-42ef-8e93-d3c3045dd38a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4e15061-0c11-42ef-8e93-d3c3045dd38a', 'volume_size': 1}
Nov 06 17:05:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ffe3d6ff-876e-4ba3-b69c-3772c6f1681b tempest-AttachVolumeTestJSON-951913559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:05:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ffe3d6ff-876e-4ba3-b69c-3772c6f1681b tempest-AttachVolumeTestJSON-951913559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:05:17 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ffe3d6ff-876e-4ba3-b69c-3772c6f1681b tempest-AttachVolumeTestJSON-951913559 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1146490008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4e15061-0c11-42ef-8e93-d3c3045dd38a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='958cd8b6170a4a698f40d7c517400c17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:05:17Z,use_quota=True,user_id='2af7ef660aa94c85acf5bff05ce43754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:05:17 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-ffe3d6ff-876e-4ba3-b69c-3772c6f1681b tempest-AttachVolumeTestJSON-951913559 None] Creating volume e4e15061-0c11-42ef-8e93-d3c3045dd38a {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:05:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ffe3d6ff-876e-4ba3-b69c-3772c6f1681b tempest-AttachVolumeTestJSON-951913559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:05:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ffe3d6ff-876e-4ba3-b69c-3772c6f1681b tempest-AttachVolumeTestJSON-951913559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:05:17 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ffe3d6ff-876e-4ba3-b69c-3772c6f1681b tempest-AttachVolumeTestJSON-951913559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:05:17 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ffe3d6ff-876e-4ba3-b69c-3772c6f1681b tempest-AttachVolumeTestJSON-951913559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:05:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ffe3d6ff-876e-4ba3-b69c-3772c6f1681b tempest-AttachVolumeTestJSON-951913559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:05:17 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ffe3d6ff-876e-4ba3-b69c-3772c6f1681b tempest-AttachVolumeTestJSON-951913559 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:05:17 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-ffe3d6ff-876e-4ba3-b69c-3772c6f1681b tempest-AttachVolumeTestJSON-951913559 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:05:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ffe3d6ff-876e-4ba3-b69c-3772c6f1681b tempest-AttachVolumeTestJSON-951913559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e4e15061-0c11-42ef-8e93-d3c3045dd38a 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:05:17 devstack sudo[90571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e4e15061-0c11-42ef-8e93-d3c3045dd38a 1073741824
Nov 06 17:05:17 devstack sudo[90571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:05:18 devstack sudo[90571]: pam_unix(sudo:session): session closed for user root
Nov 06 17:05:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ffe3d6ff-876e-4ba3-b69c-3772c6f1681b tempest-AttachVolumeTestJSON-951913559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e4e15061-0c11-42ef-8e93-d3c3045dd38a 1073741824" returned: 0 in 1.138s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:05:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ffe3d6ff-876e-4ba3-b69c-3772c6f1681b tempest-AttachVolumeTestJSON-951913559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e4e15061-0c11-42ef-8e93-d3c3045dd38a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:05:18 devstack sudo[90583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e4e15061-0c11-42ef-8e93-d3c3045dd38a
Nov 06 17:05:18 devstack sudo[90583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:05:19 devstack sudo[90583]: pam_unix(sudo:session): session closed for user root
Nov 06 17:05:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ffe3d6ff-876e-4ba3-b69c-3772c6f1681b tempest-AttachVolumeTestJSON-951913559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e4e15061-0c11-42ef-8e93-d3c3045dd38a" returned: 0 in 1.203s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:05:19 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ffe3d6ff-876e-4ba3-b69c-3772c6f1681b tempest-AttachVolumeTestJSON-951913559 None] <== create_volume: return (2458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:05:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ffe3d6ff-876e-4ba3-b69c-3772c6f1681b tempest-AttachVolumeTestJSON-951913559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.467s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:05:19 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ffe3d6ff-876e-4ba3-b69c-3772c6f1681b tempest-AttachVolumeTestJSON-951913559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dafd85eb-d26e-4591-b002-9df8c19edfff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4e15061-0c11-42ef-8e93-d3c3045dd38a', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:05:19 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ffe3d6ff-876e-4ba3-b69c-3772c6f1681b tempest-AttachVolumeTestJSON-951913559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25e1f4da-a573-445f-a572-af764c1941b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:05:19 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-ffe3d6ff-876e-4ba3-b69c-3772c6f1681b tempest-AttachVolumeTestJSON-951913559 None] Volume volume-e4e15061-0c11-42ef-8e93-d3c3045dd38a (e4e15061-0c11-42ef-8e93-d3c3045dd38a): created successfully
Nov 06 17:05:19 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ffe3d6ff-876e-4ba3-b69c-3772c6f1681b tempest-AttachVolumeTestJSON-951913559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25e1f4da-a573-445f-a572-af764c1941b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:05:19 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ffe3d6ff-876e-4ba3-b69c-3772c6f1681b tempest-AttachVolumeTestJSON-951913559 None] Flow 'volume_create_manager' (53e05fc2-3491-49dc-bb61-9a88fc14249a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:05:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-3703f516-1508-4451-91d6-e651b3eb1fc0 req-eef709ae-8e44-49ed-bf3c-eae1a7debd64 tempest-DeleteServersTestJSON-1920525012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:05:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-3703f516-1508-4451-91d6-e651b3eb1fc0 req-eef709ae-8e44-49ed-bf3c-eae1a7debd64 tempest-DeleteServersTestJSON-1920525012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:05:19 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-ffe3d6ff-876e-4ba3-b69c-3772c6f1681b tempest-AttachVolumeTestJSON-951913559 None] Created volume successfully.
Nov 06 17:05:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-3703f516-1508-4451-91d6-e651b3eb1fc0 req-eef709ae-8e44-49ed-bf3c-eae1a7debd64 tempest-DeleteServersTestJSON-1920525012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.049s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:05:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-3703f516-1508-4451-91d6-e651b3eb1fc0 req-eef709ae-8e44-49ed-bf3c-eae1a7debd64 tempest-DeleteServersTestJSON-1920525012 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316', 'name': 'volume-c3af8b8c-679e-4877-82c7-01a12bcc1f3e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a89fc167-bbc7-40f6-b2ac-aa579b6f0356', 'enforce_multipath': True} {{(pid=86856) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 17:05:20 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-3703f516-1508-4451-91d6-e651b3eb1fc0 req-eef709ae-8e44-49ed-bf3c-eae1a7debd64 tempest-DeleteServersTestJSON-1920525012 None] attachment_update completed successfully.
Nov 06 17:05:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-43c73748-0504-4c23-9088-b921a2af67b3 req-1c5f18ad-d97d-4d97-b412-61e94282351b tempest-AttachVolumeTestJSON-951913559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:05:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-43c73748-0504-4c23-9088-b921a2af67b3 req-1c5f18ad-d97d-4d97-b412-61e94282351b tempest-AttachVolumeTestJSON-951913559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:05:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-43c73748-0504-4c23-9088-b921a2af67b3 req-1c5f18ad-d97d-4d97-b412-61e94282351b tempest-AttachVolumeTestJSON-951913559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.045s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:05:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-43c73748-0504-4c23-9088-b921a2af67b3 req-1c5f18ad-d97d-4d97-b412-61e94282351b tempest-AttachVolumeTestJSON-951913559 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316', 'name': 'volume-e4e15061-0c11-42ef-8e93-d3c3045dd38a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8c477056-1faf-44e9-9d39-90f323658310', 'enforce_multipath': True} {{(pid=86856) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 17:05:23 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-43c73748-0504-4c23-9088-b921a2af67b3 req-1c5f18ad-d97d-4d97-b412-61e94282351b tempest-AttachVolumeTestJSON-951913559 None] attachment_update completed successfully.
Nov 06 17:05:25 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-004c4b11-806a-4622-8ef4-b8ddfe3e11fa req-b8c81824-d831-4f17-bb17-ed85d483c99b tempest-DeleteServersTestJSON-1920525012 None] Terminate volume connection completed successfully.
Nov 06 17:05:25 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-004c4b11-806a-4622-8ef4-b8ddfe3e11fa req-b8c81824-d831-4f17-bb17-ed85d483c99b tempest-DeleteServersTestJSON-1920525012 None] Deleting attachment a89fc167-bbc7-40f6-b2ac-aa579b6f0356. {{(pid=86856) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 17:05:27 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-54ee3f34-405b-485e-92af-f7555a08e687 req-9128dabe-8308-4209-b6a6-7964556db9d8 tempest-ServerActionsTestOtherA-1229582533 None] Terminate volume connection completed successfully.
Nov 06 17:05:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-54ee3f34-405b-485e-92af-f7555a08e687 req-9128dabe-8308-4209-b6a6-7964556db9d8 tempest-ServerActionsTestOtherA-1229582533 None] Deleting attachment 517b0be7-a5fa-4030-852f-9a5fd90281d6. {{(pid=86856) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 17:05:28 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9b14c203-65f9-47f8-8788-f50d049920b4 tempest-DeleteServersTestJSON-1920525012 None] Acquiring lock "cinder-c3af8b8c-679e-4877-82c7-01a12bcc1f3e-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:05:28 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9b14c203-65f9-47f8-8788-f50d049920b4 tempest-DeleteServersTestJSON-1920525012 None] Lock "cinder-c3af8b8c-679e-4877-82c7-01a12bcc1f3e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:05:29 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9b14c203-65f9-47f8-8788-f50d049920b4 tempest-DeleteServersTestJSON-1920525012 None] Acquiring lock "cinder-quobyte-c3af8b8c-679e-4877-82c7-01a12bcc1f3e" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:05:29 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9b14c203-65f9-47f8-8788-f50d049920b4 tempest-DeleteServersTestJSON-1920525012 None] Lock "cinder-quobyte-c3af8b8c-679e-4877-82c7-01a12bcc1f3e" acquired by "delete_volume" :: waited 0.026s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:05:29 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[19beaaa8-61b0-405a-9a89-003a834072d6]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:05:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9b14c203-65f9-47f8-8788-f50d049920b4 tempest-DeleteServersTestJSON-1920525012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c3af8b8c-679e-4877-82c7-01a12bcc1f3e {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:05:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-54ee3f34-405b-485e-92af-f7555a08e687 req-8a83e7aa-61ab-45a0-956e-fb563c5bbbf6 tempest-ServerActionsTestOtherA-1229582533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:05:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-54ee3f34-405b-485e-92af-f7555a08e687 req-8a83e7aa-61ab-45a0-956e-fb563c5bbbf6 tempest-ServerActionsTestOtherA-1229582533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:05:29 devstack sudo[90713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c3af8b8c-679e-4877-82c7-01a12bcc1f3e
Nov 06 17:05:29 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:05:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-54ee3f34-405b-485e-92af-f7555a08e687 req-8a83e7aa-61ab-45a0-956e-fb563c5bbbf6 tempest-ServerActionsTestOtherA-1229582533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:05:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-54ee3f34-405b-485e-92af-f7555a08e687 req-8a83e7aa-61ab-45a0-956e-fb563c5bbbf6 tempest-ServerActionsTestOtherA-1229582533 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316', 'name': 'volume-10a68d5c-f639-47cb-b05b-5df7a99e174d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1d99ffa5-0907-45b1-95bb-b72b75aed143', 'enforce_multipath': True} {{(pid=86856) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 17:05:29 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-54ee3f34-405b-485e-92af-f7555a08e687 req-8a83e7aa-61ab-45a0-956e-fb563c5bbbf6 tempest-ServerActionsTestOtherA-1229582533 None] attachment_update completed successfully.
Nov 06 17:05:29 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root
Nov 06 17:05:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9b14c203-65f9-47f8-8788-f50d049920b4 tempest-DeleteServersTestJSON-1920525012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c3af8b8c-679e-4877-82c7-01a12bcc1f3e" returned: 0 in 0.439s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:05:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9b14c203-65f9-47f8-8788-f50d049920b4 tempest-DeleteServersTestJSON-1920525012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c3af8b8c-679e-4877-82c7-01a12bcc1f3e {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:05:29 devstack sudo[90722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c3af8b8c-679e-4877-82c7-01a12bcc1f3e
Nov 06 17:05:29 devstack sudo[90722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:05:30 devstack sudo[90722]: pam_unix(sudo:session): session closed for user root
Nov 06 17:05:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9b14c203-65f9-47f8-8788-f50d049920b4 tempest-DeleteServersTestJSON-1920525012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c3af8b8c-679e-4877-82c7-01a12bcc1f3e" returned: 0 in 0.439s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:05:30 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9b14c203-65f9-47f8-8788-f50d049920b4 tempest-DeleteServersTestJSON-1920525012 None] Lock "cinder-quobyte-c3af8b8c-679e-4877-82c7-01a12bcc1f3e" released by "delete_volume" :: held 0.955s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:05:30 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-9b14c203-65f9-47f8-8788-f50d049920b4 tempest-DeleteServersTestJSON-1920525012 None] Created reservations ['246914d9-a343-4816-bc88-ef79de3d74dc', '21de492c-0045-467e-a615-dd64be99dc1d', '0a7882b7-568e-4e64-8b15-aefbbe9af350', '9c8ea5f0-10bc-4859-8a49-e19aa43271af'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:05:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9b14c203-65f9-47f8-8788-f50d049920b4 tempest-DeleteServersTestJSON-1920525012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:05:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9b14c203-65f9-47f8-8788-f50d049920b4 tempest-DeleteServersTestJSON-1920525012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:05:30 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-9b14c203-65f9-47f8-8788-f50d049920b4 tempest-DeleteServersTestJSON-1920525012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:05:30 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-9b14c203-65f9-47f8-8788-f50d049920b4 tempest-DeleteServersTestJSON-1920525012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:05:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9b14c203-65f9-47f8-8788-f50d049920b4 tempest-DeleteServersTestJSON-1920525012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:05:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9b14c203-65f9-47f8-8788-f50d049920b4 tempest-DeleteServersTestJSON-1920525012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:05:30 devstack sudo[90815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:05:30 devstack sudo[90815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:05:30 devstack sudo[90815]: pam_unix(sudo:session): session closed for user root
Nov 06 17:05:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9b14c203-65f9-47f8-8788-f50d049920b4 tempest-DeleteServersTestJSON-1920525012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.472s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:05:30 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-9b14c203-65f9-47f8-8788-f50d049920b4 tempest-DeleteServersTestJSON-1920525012 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:05:30 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-9b14c203-65f9-47f8-8788-f50d049920b4 tempest-DeleteServersTestJSON-1920525012 None] Deleted volume successfully.
Nov 06 17:05:30 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9b14c203-65f9-47f8-8788-f50d049920b4 tempest-DeleteServersTestJSON-1920525012 None] Lock "cinder-c3af8b8c-679e-4877-82c7-01a12bcc1f3e-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:05:40 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:UPDATE=26,cinder:SELECT=53,cinder:INSERT=10,cinder:DELETE=3 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:05:42 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:05:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:05:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:05:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:05:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:05:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:05:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:05:42 devstack sudo[91423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:05:42 devstack sudo[91423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:05:43 devstack sudo[91423]: pam_unix(sudo:session): session closed for user root
Nov 06 17:05:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 1.148s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:05:43 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:05:44 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=60,cinder:INSERT=11,cinder:UPDATE=33,cinder:DELETE=2 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:06:08 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c16196d-3564-4335-8507-1078b85ce3cc tempest-AttachVolumeNegativeTest-706916992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:06:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7c16196d-3564-4335-8507-1078b85ce3cc tempest-AttachVolumeNegativeTest-706916992 None] Flow 'volume_create_manager' (b8360247-41b4-46a0-8692-810d94b299d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:06:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7c16196d-3564-4335-8507-1078b85ce3cc tempest-AttachVolumeNegativeTest-706916992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cce768a-231c-48f8-a4f9-08d0049cffe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:06:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7c16196d-3564-4335-8507-1078b85ce3cc tempest-AttachVolumeNegativeTest-706916992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cce768a-231c-48f8-a4f9-08d0049cffe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-680232284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1284bc21-9299-4c2c-9c29-038d5820262c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a04a9285705648f4853ea8791a1f7679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:06:09Z,use_quota=True,user_id='ff1a8d854cb4480ba8aef514e49dc3a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:06:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7c16196d-3564-4335-8507-1078b85ce3cc tempest-AttachVolumeNegativeTest-706916992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8e44812-c116-4d97-ae4c-8d291bf94f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:06:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7c16196d-3564-4335-8507-1078b85ce3cc tempest-AttachVolumeNegativeTest-706916992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8e44812-c116-4d97-ae4c-8d291bf94f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:06:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7c16196d-3564-4335-8507-1078b85ce3cc tempest-AttachVolumeNegativeTest-706916992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf003871-99be-49f9-afc2-f0e1d4bcd0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:06:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7c16196d-3564-4335-8507-1078b85ce3cc tempest-AttachVolumeNegativeTest-706916992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf003871-99be-49f9-afc2-f0e1d4bcd0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1284bc21-9299-4c2c-9c29-038d5820262c', 'volume_name': 'volume-1284bc21-9299-4c2c-9c29-038d5820262c', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:06:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7c16196d-3564-4335-8507-1078b85ce3cc tempest-AttachVolumeNegativeTest-706916992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a4a7b8-0698-4860-a4b4-99943bb38e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:06:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7c16196d-3564-4335-8507-1078b85ce3cc tempest-AttachVolumeNegativeTest-706916992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a4a7b8-0698-4860-a4b4-99943bb38e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:06:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7c16196d-3564-4335-8507-1078b85ce3cc tempest-AttachVolumeNegativeTest-706916992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73a19815-1ecd-4c5a-b99e-102f04811324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:06:08 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-7c16196d-3564-4335-8507-1078b85ce3cc tempest-AttachVolumeNegativeTest-706916992 None] Volume 1284bc21-9299-4c2c-9c29-038d5820262c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1284bc21-9299-4c2c-9c29-038d5820262c', 'volume_size': 1}
Nov 06 17:06:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7c16196d-3564-4335-8507-1078b85ce3cc tempest-AttachVolumeNegativeTest-706916992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:06:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7c16196d-3564-4335-8507-1078b85ce3cc tempest-AttachVolumeNegativeTest-706916992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:06:08 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7c16196d-3564-4335-8507-1078b85ce3cc tempest-AttachVolumeNegativeTest-706916992 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-680232284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1284bc21-9299-4c2c-9c29-038d5820262c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a04a9285705648f4853ea8791a1f7679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:06:09Z,use_quota=True,user_id='ff1a8d854cb4480ba8aef514e49dc3a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:06:08 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-7c16196d-3564-4335-8507-1078b85ce3cc tempest-AttachVolumeNegativeTest-706916992 None] Creating volume 1284bc21-9299-4c2c-9c29-038d5820262c {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:06:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7c16196d-3564-4335-8507-1078b85ce3cc tempest-AttachVolumeNegativeTest-706916992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:06:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7c16196d-3564-4335-8507-1078b85ce3cc tempest-AttachVolumeNegativeTest-706916992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:06:08 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7c16196d-3564-4335-8507-1078b85ce3cc tempest-AttachVolumeNegativeTest-706916992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:06:08 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7c16196d-3564-4335-8507-1078b85ce3cc tempest-AttachVolumeNegativeTest-706916992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:06:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7c16196d-3564-4335-8507-1078b85ce3cc tempest-AttachVolumeNegativeTest-706916992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:06:08 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7c16196d-3564-4335-8507-1078b85ce3cc tempest-AttachVolumeNegativeTest-706916992 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:06:08 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-7c16196d-3564-4335-8507-1078b85ce3cc tempest-AttachVolumeNegativeTest-706916992 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:06:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7c16196d-3564-4335-8507-1078b85ce3cc tempest-AttachVolumeNegativeTest-706916992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1284bc21-9299-4c2c-9c29-038d5820262c 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:06:08 devstack sudo[91539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1284bc21-9299-4c2c-9c29-038d5820262c 1073741824
Nov 06 17:06:08 devstack sudo[91539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:06:09 devstack sudo[91539]: pam_unix(sudo:session): session closed for user root
Nov 06 17:06:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7c16196d-3564-4335-8507-1078b85ce3cc tempest-AttachVolumeNegativeTest-706916992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1284bc21-9299-4c2c-9c29-038d5820262c 1073741824" returned: 0 in 0.507s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:06:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7c16196d-3564-4335-8507-1078b85ce3cc tempest-AttachVolumeNegativeTest-706916992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1284bc21-9299-4c2c-9c29-038d5820262c {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:06:09 devstack sudo[91545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1284bc21-9299-4c2c-9c29-038d5820262c
Nov 06 17:06:09 devstack sudo[91545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:06:09 devstack sudo[91545]: pam_unix(sudo:session): session closed for user root
Nov 06 17:06:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7c16196d-3564-4335-8507-1078b85ce3cc tempest-AttachVolumeNegativeTest-706916992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1284bc21-9299-4c2c-9c29-038d5820262c" returned: 0 in 0.355s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:06:09 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7c16196d-3564-4335-8507-1078b85ce3cc tempest-AttachVolumeNegativeTest-706916992 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:06:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7c16196d-3564-4335-8507-1078b85ce3cc tempest-AttachVolumeNegativeTest-706916992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:06:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7c16196d-3564-4335-8507-1078b85ce3cc tempest-AttachVolumeNegativeTest-706916992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73a19815-1ecd-4c5a-b99e-102f04811324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1284bc21-9299-4c2c-9c29-038d5820262c', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:06:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7c16196d-3564-4335-8507-1078b85ce3cc tempest-AttachVolumeNegativeTest-706916992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1c5b9d5-b712-49d0-97b9-f7afb174fe8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:06:09 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-7c16196d-3564-4335-8507-1078b85ce3cc tempest-AttachVolumeNegativeTest-706916992 None] Volume volume-1284bc21-9299-4c2c-9c29-038d5820262c (1284bc21-9299-4c2c-9c29-038d5820262c): created successfully
Nov 06 17:06:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7c16196d-3564-4335-8507-1078b85ce3cc tempest-AttachVolumeNegativeTest-706916992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1c5b9d5-b712-49d0-97b9-f7afb174fe8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:06:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7c16196d-3564-4335-8507-1078b85ce3cc tempest-AttachVolumeNegativeTest-706916992 None] Flow 'volume_create_manager' (b8360247-41b4-46a0-8692-810d94b299d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:06:09 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-7c16196d-3564-4335-8507-1078b85ce3cc tempest-AttachVolumeNegativeTest-706916992 None] Created volume successfully.
Nov 06 17:06:10 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-a58119b5-6a34-47d7-84c7-ccf3b4f4748f req-e6e70e16-285c-4879-88d6-0af25a1f6b9a tempest-ServerActionsTestOtherA-1229582533 None] Terminate volume connection completed successfully.
Nov 06 17:06:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-a58119b5-6a34-47d7-84c7-ccf3b4f4748f req-e6e70e16-285c-4879-88d6-0af25a1f6b9a tempest-ServerActionsTestOtherA-1229582533 None] Deleting attachment 1d99ffa5-0907-45b1-95bb-b72b75aed143. {{(pid=86856) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 17:06:10 devstack cinder-volume[86856]: DEBUG cinder.coordination [req-a58119b5-6a34-47d7-84c7-ccf3b4f4748f req-e6c27576-10f7-4586-8dfd-4845c8cc5eb6 tempest-ServerActionsTestOtherA-1229582533 None] Acquiring lock "cinder-10a68d5c-f639-47cb-b05b-5df7a99e174d-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:06:10 devstack cinder-volume[86856]: DEBUG cinder.coordination [req-a58119b5-6a34-47d7-84c7-ccf3b4f4748f req-e6c27576-10f7-4586-8dfd-4845c8cc5eb6 tempest-ServerActionsTestOtherA-1229582533 None] Lock "cinder-10a68d5c-f639-47cb-b05b-5df7a99e174d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:06:10 devstack cinder-volume[86856]: DEBUG cinder.coordination [req-a58119b5-6a34-47d7-84c7-ccf3b4f4748f req-e6c27576-10f7-4586-8dfd-4845c8cc5eb6 tempest-ServerActionsTestOtherA-1229582533 None] Acquiring lock "cinder-quobyte-10a68d5c-f639-47cb-b05b-5df7a99e174d" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:06:10 devstack cinder-volume[86856]: DEBUG cinder.coordination [req-a58119b5-6a34-47d7-84c7-ccf3b4f4748f req-e6c27576-10f7-4586-8dfd-4845c8cc5eb6 tempest-ServerActionsTestOtherA-1229582533 None] Lock "cinder-quobyte-10a68d5c-f639-47cb-b05b-5df7a99e174d" acquired by "delete_volume" :: waited 0.018s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:06:10 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cef8f8-bdfe-4f1a-b72a-fe933a8a9b72]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:06:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-a58119b5-6a34-47d7-84c7-ccf3b4f4748f req-e6c27576-10f7-4586-8dfd-4845c8cc5eb6 tempest-ServerActionsTestOtherA-1229582533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-10a68d5c-f639-47cb-b05b-5df7a99e174d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:06:10 devstack sudo[91551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-10a68d5c-f639-47cb-b05b-5df7a99e174d
Nov 06 17:06:10 devstack sudo[91551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:06:11 devstack sudo[91551]: pam_unix(sudo:session): session closed for user root
Nov 06 17:06:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-a58119b5-6a34-47d7-84c7-ccf3b4f4748f req-e6c27576-10f7-4586-8dfd-4845c8cc5eb6 tempest-ServerActionsTestOtherA-1229582533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-10a68d5c-f639-47cb-b05b-5df7a99e174d" returned: 0 in 0.460s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:06:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-a58119b5-6a34-47d7-84c7-ccf3b4f4748f req-e6c27576-10f7-4586-8dfd-4845c8cc5eb6 tempest-ServerActionsTestOtherA-1229582533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-10a68d5c-f639-47cb-b05b-5df7a99e174d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:06:11 devstack sudo[91561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-10a68d5c-f639-47cb-b05b-5df7a99e174d
Nov 06 17:06:11 devstack sudo[91561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:06:11 devstack sudo[91561]: pam_unix(sudo:session): session closed for user root
Nov 06 17:06:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-a58119b5-6a34-47d7-84c7-ccf3b4f4748f req-e6c27576-10f7-4586-8dfd-4845c8cc5eb6 tempest-ServerActionsTestOtherA-1229582533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-10a68d5c-f639-47cb-b05b-5df7a99e174d" returned: 0 in 0.306s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:06:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [req-a58119b5-6a34-47d7-84c7-ccf3b4f4748f req-e6c27576-10f7-4586-8dfd-4845c8cc5eb6 tempest-ServerActionsTestOtherA-1229582533 None] Lock "cinder-quobyte-10a68d5c-f639-47cb-b05b-5df7a99e174d" released by "delete_volume" :: held 0.843s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:06:11 devstack cinder-volume[86856]: DEBUG cinder.quota [req-a58119b5-6a34-47d7-84c7-ccf3b4f4748f req-e6c27576-10f7-4586-8dfd-4845c8cc5eb6 tempest-ServerActionsTestOtherA-1229582533 None] Created reservations ['01f1eb4c-d976-45e9-b1b8-88eb46ce4bb8', '44c38c38-ffc9-4fbf-9e10-0113e0f407c7', '9b375a3e-560d-43ac-9a15-f4d87bdb6318', '20ccf42b-53f0-458a-9128-bf9ec4ce16e3'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:06:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5683ecf4-0d77-49ca-99e8-a30371040d97 tempest-ServerActionsTestOtherA-1229582533 None] Acquiring lock "cinder-08bf7294-f24f-417e-806c-bfbb6b23ef76-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:06:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-a58119b5-6a34-47d7-84c7-ccf3b4f4748f req-e6c27576-10f7-4586-8dfd-4845c8cc5eb6 tempest-ServerActionsTestOtherA-1229582533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:06:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-a58119b5-6a34-47d7-84c7-ccf3b4f4748f req-e6c27576-10f7-4586-8dfd-4845c8cc5eb6 tempest-ServerActionsTestOtherA-1229582533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:06:11 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [req-a58119b5-6a34-47d7-84c7-ccf3b4f4748f req-e6c27576-10f7-4586-8dfd-4845c8cc5eb6 tempest-ServerActionsTestOtherA-1229582533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:06:11 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [req-a58119b5-6a34-47d7-84c7-ccf3b4f4748f req-e6c27576-10f7-4586-8dfd-4845c8cc5eb6 tempest-ServerActionsTestOtherA-1229582533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:06:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-a58119b5-6a34-47d7-84c7-ccf3b4f4748f req-e6c27576-10f7-4586-8dfd-4845c8cc5eb6 tempest-ServerActionsTestOtherA-1229582533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:06:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-a58119b5-6a34-47d7-84c7-ccf3b4f4748f req-e6c27576-10f7-4586-8dfd-4845c8cc5eb6 tempest-ServerActionsTestOtherA-1229582533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:06:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5683ecf4-0d77-49ca-99e8-a30371040d97 tempest-ServerActionsTestOtherA-1229582533 None] Lock "cinder-08bf7294-f24f-417e-806c-bfbb6b23ef76-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:06:11 devstack sudo[91571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:06:11 devstack sudo[91571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:06:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5683ecf4-0d77-49ca-99e8-a30371040d97 tempest-ServerActionsTestOtherA-1229582533 None] Acquiring lock "cinder-quobyte-08bf7294-f24f-417e-806c-bfbb6b23ef76" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:06:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5683ecf4-0d77-49ca-99e8-a30371040d97 tempest-ServerActionsTestOtherA-1229582533 None] Lock "cinder-quobyte-08bf7294-f24f-417e-806c-bfbb6b23ef76" acquired by "delete_volume" :: waited 0.025s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:06:11 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[b137011c-90ae-4d67-8d9e-c970690228e3]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:06:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5683ecf4-0d77-49ca-99e8-a30371040d97 tempest-ServerActionsTestOtherA-1229582533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-08bf7294-f24f-417e-806c-bfbb6b23ef76 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:06:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-7d5d4b8b-936d-460b-8036-721084fb518b req-eeca4b20-cace-4933-b25c-cc2ce4f44963 tempest-AttachVolumeNegativeTest-706916992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:06:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-7d5d4b8b-936d-460b-8036-721084fb518b req-eeca4b20-cace-4933-b25c-cc2ce4f44963 tempest-AttachVolumeNegativeTest-706916992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:06:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-7d5d4b8b-936d-460b-8036-721084fb518b req-eeca4b20-cace-4933-b25c-cc2ce4f44963 tempest-AttachVolumeNegativeTest-706916992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:06:12 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-7d5d4b8b-936d-460b-8036-721084fb518b req-eeca4b20-cace-4933-b25c-cc2ce4f44963 tempest-AttachVolumeNegativeTest-706916992 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316', 'name': 'volume-1284bc21-9299-4c2c-9c29-038d5820262c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7fff03e7-8286-4f4f-961b-6f39f46fc030', 'enforce_multipath': True} {{(pid=86856) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 17:06:12 devstack sudo[91575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-08bf7294-f24f-417e-806c-bfbb6b23ef76
Nov 06 17:06:12 devstack sudo[91575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:06:12 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-7d5d4b8b-936d-460b-8036-721084fb518b req-eeca4b20-cace-4933-b25c-cc2ce4f44963 tempest-AttachVolumeNegativeTest-706916992 None] attachment_update completed successfully.
Nov 06 17:06:12 devstack sudo[91571]: pam_unix(sudo:session): session closed for user root
Nov 06 17:06:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-a58119b5-6a34-47d7-84c7-ccf3b4f4748f req-e6c27576-10f7-4586-8dfd-4845c8cc5eb6 tempest-ServerActionsTestOtherA-1229582533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.386s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:06:12 devstack cinder-volume[86856]: DEBUG cinder.manager [req-a58119b5-6a34-47d7-84c7-ccf3b4f4748f req-e6c27576-10f7-4586-8dfd-4845c8cc5eb6 tempest-ServerActionsTestOtherA-1229582533 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:06:12 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-a58119b5-6a34-47d7-84c7-ccf3b4f4748f req-e6c27576-10f7-4586-8dfd-4845c8cc5eb6 tempest-ServerActionsTestOtherA-1229582533 None] Deleted volume successfully.
Nov 06 17:06:12 devstack cinder-volume[86856]: DEBUG cinder.coordination [req-a58119b5-6a34-47d7-84c7-ccf3b4f4748f req-e6c27576-10f7-4586-8dfd-4845c8cc5eb6 tempest-ServerActionsTestOtherA-1229582533 None] Lock "cinder-10a68d5c-f639-47cb-b05b-5df7a99e174d-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:06:12 devstack sudo[91575]: pam_unix(sudo:session): session closed for user root
Nov 06 17:06:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5683ecf4-0d77-49ca-99e8-a30371040d97 tempest-ServerActionsTestOtherA-1229582533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-08bf7294-f24f-417e-806c-bfbb6b23ef76" returned: 0 in 0.478s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:06:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5683ecf4-0d77-49ca-99e8-a30371040d97 tempest-ServerActionsTestOtherA-1229582533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-08bf7294-f24f-417e-806c-bfbb6b23ef76 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:06:12 devstack sudo[91583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-08bf7294-f24f-417e-806c-bfbb6b23ef76
Nov 06 17:06:12 devstack sudo[91583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:06:12 devstack sudo[91583]: pam_unix(sudo:session): session closed for user root
Nov 06 17:06:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5683ecf4-0d77-49ca-99e8-a30371040d97 tempest-ServerActionsTestOtherA-1229582533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-08bf7294-f24f-417e-806c-bfbb6b23ef76" returned: 0 in 0.297s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:06:12 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5683ecf4-0d77-49ca-99e8-a30371040d97 tempest-ServerActionsTestOtherA-1229582533 None] Lock "cinder-quobyte-08bf7294-f24f-417e-806c-bfbb6b23ef76" released by "delete_volume" :: held 0.838s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:06:12 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-5683ecf4-0d77-49ca-99e8-a30371040d97 tempest-ServerActionsTestOtherA-1229582533 None] Created reservations ['6478902a-96bb-4d38-a8aa-34cac5e8140a', '57f1580e-c324-4466-890f-98e328dc824b', 'b43283b9-bd1d-4947-ac95-47483df7fbd8', 'c59cf246-0cca-4aba-a737-079aab697260'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:06:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5683ecf4-0d77-49ca-99e8-a30371040d97 tempest-ServerActionsTestOtherA-1229582533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:06:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5683ecf4-0d77-49ca-99e8-a30371040d97 tempest-ServerActionsTestOtherA-1229582533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:06:12 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5683ecf4-0d77-49ca-99e8-a30371040d97 tempest-ServerActionsTestOtherA-1229582533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:06:12 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5683ecf4-0d77-49ca-99e8-a30371040d97 tempest-ServerActionsTestOtherA-1229582533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:06:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5683ecf4-0d77-49ca-99e8-a30371040d97 tempest-ServerActionsTestOtherA-1229582533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:06:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5683ecf4-0d77-49ca-99e8-a30371040d97 tempest-ServerActionsTestOtherA-1229582533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:06:12 devstack sudo[91586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:06:12 devstack sudo[91586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:06:13 devstack sudo[91586]: pam_unix(sudo:session): session closed for user root
Nov 06 17:06:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5683ecf4-0d77-49ca-99e8-a30371040d97 tempest-ServerActionsTestOtherA-1229582533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.341s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:06:13 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-5683ecf4-0d77-49ca-99e8-a30371040d97 tempest-ServerActionsTestOtherA-1229582533 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:06:13 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-5683ecf4-0d77-49ca-99e8-a30371040d97 tempest-ServerActionsTestOtherA-1229582533 None] Deleted volume successfully.
Nov 06 17:06:13 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5683ecf4-0d77-49ca-99e8-a30371040d97 tempest-ServerActionsTestOtherA-1229582533 None] Lock "cinder-08bf7294-f24f-417e-806c-bfbb6b23ef76-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:06:15 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-0cd2a0ca-50e7-4718-9c9d-4c0707b5d0c2 req-5e0e2a22-c7a2-4538-baae-f815e9177537 tempest-AttachVolumeNegativeTest-706916992 None] Terminate volume connection completed successfully.
Nov 06 17:06:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-0cd2a0ca-50e7-4718-9c9d-4c0707b5d0c2 req-5e0e2a22-c7a2-4538-baae-f815e9177537 tempest-AttachVolumeNegativeTest-706916992 None] Deleting attachment 7fff03e7-8286-4f4f-961b-6f39f46fc030. {{(pid=86856) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 17:06:15 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-b32473b0-d384-41d6-a310-d87af7412795 req-8981b82f-68e3-44b7-afbf-437243676e1a tempest-AttachVolumeTestJSON-951913559 None] Terminate volume connection completed successfully.
Nov 06 17:06:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-b32473b0-d384-41d6-a310-d87af7412795 req-8981b82f-68e3-44b7-afbf-437243676e1a tempest-AttachVolumeTestJSON-951913559 None] Deleting attachment 8c477056-1faf-44e9-9d39-90f323658310. {{(pid=86856) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 17:06:20 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-354fd07c-7a08-4f85-8daa-9bc5e4e44da4 tempest-TaggedAttachmentsTest-1362406288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:06:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-354fd07c-7a08-4f85-8daa-9bc5e4e44da4 tempest-TaggedAttachmentsTest-1362406288 None] Flow 'volume_create_manager' (b8a4d890-c751-4407-8318-62cc4a96e7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:06:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-354fd07c-7a08-4f85-8daa-9bc5e4e44da4 tempest-TaggedAttachmentsTest-1362406288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f067168-b66c-4dd1-93e7-999fe82f4f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:06:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-354fd07c-7a08-4f85-8daa-9bc5e4e44da4 tempest-TaggedAttachmentsTest-1362406288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f067168-b66c-4dd1-93e7-999fe82f4f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-191644217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf2b6238-ab33-496b-b332-4483baefdc4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a6a64cfdcf845768150ee7cdecac2ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:06:20Z,use_quota=True,user_id='00b8df5f7d7444f09f97676af8ed307d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:06:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-354fd07c-7a08-4f85-8daa-9bc5e4e44da4 tempest-TaggedAttachmentsTest-1362406288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6192a2f8-2271-4575-9e29-a8f9fd847bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:06:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-354fd07c-7a08-4f85-8daa-9bc5e4e44da4 tempest-TaggedAttachmentsTest-1362406288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6192a2f8-2271-4575-9e29-a8f9fd847bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:06:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-354fd07c-7a08-4f85-8daa-9bc5e4e44da4 tempest-TaggedAttachmentsTest-1362406288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a28c2e8b-77d6-45a8-b8c3-e15eda83bbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:06:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-354fd07c-7a08-4f85-8daa-9bc5e4e44da4 tempest-TaggedAttachmentsTest-1362406288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a28c2e8b-77d6-45a8-b8c3-e15eda83bbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf2b6238-ab33-496b-b332-4483baefdc4b', 'volume_name': 'volume-cf2b6238-ab33-496b-b332-4483baefdc4b', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:06:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-354fd07c-7a08-4f85-8daa-9bc5e4e44da4 tempest-TaggedAttachmentsTest-1362406288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9d89494-53cf-49f8-9e53-e13fe89109c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:06:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-354fd07c-7a08-4f85-8daa-9bc5e4e44da4 tempest-TaggedAttachmentsTest-1362406288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9d89494-53cf-49f8-9e53-e13fe89109c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:06:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-354fd07c-7a08-4f85-8daa-9bc5e4e44da4 tempest-TaggedAttachmentsTest-1362406288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54620110-a319-4948-b3b8-2b3d3f9022ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:06:20 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-354fd07c-7a08-4f85-8daa-9bc5e4e44da4 tempest-TaggedAttachmentsTest-1362406288 None] Volume cf2b6238-ab33-496b-b332-4483baefdc4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf2b6238-ab33-496b-b332-4483baefdc4b', 'volume_size': 1}
Nov 06 17:06:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-354fd07c-7a08-4f85-8daa-9bc5e4e44da4 tempest-TaggedAttachmentsTest-1362406288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:06:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-354fd07c-7a08-4f85-8daa-9bc5e4e44da4 tempest-TaggedAttachmentsTest-1362406288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:06:20 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-354fd07c-7a08-4f85-8daa-9bc5e4e44da4 tempest-TaggedAttachmentsTest-1362406288 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-191644217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf2b6238-ab33-496b-b332-4483baefdc4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a6a64cfdcf845768150ee7cdecac2ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:06:20Z,use_quota=True,user_id='00b8df5f7d7444f09f97676af8ed307d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:06:20 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-354fd07c-7a08-4f85-8daa-9bc5e4e44da4 tempest-TaggedAttachmentsTest-1362406288 None] Creating volume cf2b6238-ab33-496b-b332-4483baefdc4b {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:06:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-354fd07c-7a08-4f85-8daa-9bc5e4e44da4 tempest-TaggedAttachmentsTest-1362406288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:06:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-354fd07c-7a08-4f85-8daa-9bc5e4e44da4 tempest-TaggedAttachmentsTest-1362406288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:06:20 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-354fd07c-7a08-4f85-8daa-9bc5e4e44da4 tempest-TaggedAttachmentsTest-1362406288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:06:20 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-354fd07c-7a08-4f85-8daa-9bc5e4e44da4 tempest-TaggedAttachmentsTest-1362406288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:06:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-354fd07c-7a08-4f85-8daa-9bc5e4e44da4 tempest-TaggedAttachmentsTest-1362406288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:06:20 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-354fd07c-7a08-4f85-8daa-9bc5e4e44da4 tempest-TaggedAttachmentsTest-1362406288 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:06:20 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-354fd07c-7a08-4f85-8daa-9bc5e4e44da4 tempest-TaggedAttachmentsTest-1362406288 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:06:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-354fd07c-7a08-4f85-8daa-9bc5e4e44da4 tempest-TaggedAttachmentsTest-1362406288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cf2b6238-ab33-496b-b332-4483baefdc4b 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:06:20 devstack sudo[91651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cf2b6238-ab33-496b-b332-4483baefdc4b 1073741824
Nov 06 17:06:20 devstack sudo[91651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:06:20 devstack sudo[91651]: pam_unix(sudo:session): session closed for user root
Nov 06 17:06:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-354fd07c-7a08-4f85-8daa-9bc5e4e44da4 tempest-TaggedAttachmentsTest-1362406288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cf2b6238-ab33-496b-b332-4483baefdc4b 1073741824" returned: 0 in 0.542s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:06:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-354fd07c-7a08-4f85-8daa-9bc5e4e44da4 tempest-TaggedAttachmentsTest-1362406288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cf2b6238-ab33-496b-b332-4483baefdc4b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:06:20 devstack sudo[91659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cf2b6238-ab33-496b-b332-4483baefdc4b
Nov 06 17:06:20 devstack sudo[91659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:06:20 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-4db0648a-7267-4a8d-ab1a-caeb11f84493 tempest-AttachVolumeNegativeTest-706916992 None] Acquiring lock "cinder-1284bc21-9299-4c2c-9c29-038d5820262c-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:06:20 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-4db0648a-7267-4a8d-ab1a-caeb11f84493 tempest-AttachVolumeNegativeTest-706916992 None] Lock "cinder-1284bc21-9299-4c2c-9c29-038d5820262c-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:06:21 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-4db0648a-7267-4a8d-ab1a-caeb11f84493 tempest-AttachVolumeNegativeTest-706916992 None] Acquiring lock "cinder-quobyte-1284bc21-9299-4c2c-9c29-038d5820262c" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:06:21 devstack sudo[91659]: pam_unix(sudo:session): session closed for user root
Nov 06 17:06:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-354fd07c-7a08-4f85-8daa-9bc5e4e44da4 tempest-TaggedAttachmentsTest-1362406288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cf2b6238-ab33-496b-b332-4483baefdc4b" returned: 0 in 0.327s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:06:21 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-354fd07c-7a08-4f85-8daa-9bc5e4e44da4 tempest-TaggedAttachmentsTest-1362406288 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:06:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-354fd07c-7a08-4f85-8daa-9bc5e4e44da4 tempest-TaggedAttachmentsTest-1362406288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:06:21 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-4db0648a-7267-4a8d-ab1a-caeb11f84493 tempest-AttachVolumeNegativeTest-706916992 None] Lock "cinder-quobyte-1284bc21-9299-4c2c-9c29-038d5820262c" acquired by "delete_volume" :: waited 0.042s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:06:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-354fd07c-7a08-4f85-8daa-9bc5e4e44da4 tempest-TaggedAttachmentsTest-1362406288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54620110-a319-4948-b3b8-2b3d3f9022ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf2b6238-ab33-496b-b332-4483baefdc4b', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:06:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-354fd07c-7a08-4f85-8daa-9bc5e4e44da4 tempest-TaggedAttachmentsTest-1362406288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fa3ff9a-6dac-4f18-a733-be2b02ce503b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:06:21 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e99acd8-55fd-40fa-83a1-de4164f1c827]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:06:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4db0648a-7267-4a8d-ab1a-caeb11f84493 tempest-AttachVolumeNegativeTest-706916992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1284bc21-9299-4c2c-9c29-038d5820262c {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:06:21 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-354fd07c-7a08-4f85-8daa-9bc5e4e44da4 tempest-TaggedAttachmentsTest-1362406288 None] Volume volume-cf2b6238-ab33-496b-b332-4483baefdc4b (cf2b6238-ab33-496b-b332-4483baefdc4b): created successfully
Nov 06 17:06:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-354fd07c-7a08-4f85-8daa-9bc5e4e44da4 tempest-TaggedAttachmentsTest-1362406288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fa3ff9a-6dac-4f18-a733-be2b02ce503b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:06:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-354fd07c-7a08-4f85-8daa-9bc5e4e44da4 tempest-TaggedAttachmentsTest-1362406288 None] Flow 'volume_create_manager' (b8a4d890-c751-4407-8318-62cc4a96e7e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:06:21 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-354fd07c-7a08-4f85-8daa-9bc5e4e44da4 tempest-TaggedAttachmentsTest-1362406288 None] Created volume successfully.
Nov 06 17:06:21 devstack sudo[91662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1284bc21-9299-4c2c-9c29-038d5820262c
Nov 06 17:06:21 devstack sudo[91662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:06:21 devstack sudo[91662]: pam_unix(sudo:session): session closed for user root
Nov 06 17:06:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4db0648a-7267-4a8d-ab1a-caeb11f84493 tempest-AttachVolumeNegativeTest-706916992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1284bc21-9299-4c2c-9c29-038d5820262c" returned: 0 in 0.542s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:06:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4db0648a-7267-4a8d-ab1a-caeb11f84493 tempest-AttachVolumeNegativeTest-706916992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1284bc21-9299-4c2c-9c29-038d5820262c {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:06:21 devstack sudo[91680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1284bc21-9299-4c2c-9c29-038d5820262c
Nov 06 17:06:21 devstack sudo[91680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:06:21 devstack sudo[91680]: pam_unix(sudo:session): session closed for user root
Nov 06 17:06:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4db0648a-7267-4a8d-ab1a-caeb11f84493 tempest-AttachVolumeNegativeTest-706916992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1284bc21-9299-4c2c-9c29-038d5820262c" returned: 0 in 0.316s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:06:22 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-4db0648a-7267-4a8d-ab1a-caeb11f84493 tempest-AttachVolumeNegativeTest-706916992 None] Lock "cinder-quobyte-1284bc21-9299-4c2c-9c29-038d5820262c" released by "delete_volume" :: held 0.928s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:06:22 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-4db0648a-7267-4a8d-ab1a-caeb11f84493 tempest-AttachVolumeNegativeTest-706916992 None] Created reservations ['9eb6817a-9c5a-4dd8-8992-fc56b3f066d7', 'e8ced948-83cd-46bb-8578-2600fee29aa6', 'aaf09ae3-17b6-467b-be7a-534893a352f2', '62854052-2357-415c-b02d-9d9893ba5f2f'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:06:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4db0648a-7267-4a8d-ab1a-caeb11f84493 tempest-AttachVolumeNegativeTest-706916992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:06:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4db0648a-7267-4a8d-ab1a-caeb11f84493 tempest-AttachVolumeNegativeTest-706916992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:06:22 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4db0648a-7267-4a8d-ab1a-caeb11f84493 tempest-AttachVolumeNegativeTest-706916992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:06:22 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4db0648a-7267-4a8d-ab1a-caeb11f84493 tempest-AttachVolumeNegativeTest-706916992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:06:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4db0648a-7267-4a8d-ab1a-caeb11f84493 tempest-AttachVolumeNegativeTest-706916992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:06:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4db0648a-7267-4a8d-ab1a-caeb11f84493 tempest-AttachVolumeNegativeTest-706916992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:06:22 devstack sudo[91695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:06:22 devstack sudo[91695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:06:22 devstack sudo[91695]: pam_unix(sudo:session): session closed for user root
Nov 06 17:06:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4db0648a-7267-4a8d-ab1a-caeb11f84493 tempest-AttachVolumeNegativeTest-706916992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.343s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:06:22 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-4db0648a-7267-4a8d-ab1a-caeb11f84493 tempest-AttachVolumeNegativeTest-706916992 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:06:22 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-4db0648a-7267-4a8d-ab1a-caeb11f84493 tempest-AttachVolumeNegativeTest-706916992 None] Deleted volume successfully.
Nov 06 17:06:22 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-4db0648a-7267-4a8d-ab1a-caeb11f84493 tempest-AttachVolumeNegativeTest-706916992 None] Lock "cinder-1284bc21-9299-4c2c-9c29-038d5820262c-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:06:23 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-814195ee-3d58-4a9e-8767-f061c078f991 tempest-AttachVolumeNegativeTest-706916992 None] Acquiring lock "cinder-3f531e27-5b35-4edd-9823-2c09514adf69-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:06:23 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-814195ee-3d58-4a9e-8767-f061c078f991 tempest-AttachVolumeNegativeTest-706916992 None] Lock "cinder-3f531e27-5b35-4edd-9823-2c09514adf69-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:06:23 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-814195ee-3d58-4a9e-8767-f061c078f991 tempest-AttachVolumeNegativeTest-706916992 None] Acquiring lock "cinder-quobyte-3f531e27-5b35-4edd-9823-2c09514adf69" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:06:23 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-814195ee-3d58-4a9e-8767-f061c078f991 tempest-AttachVolumeNegativeTest-706916992 None] Lock "cinder-quobyte-3f531e27-5b35-4edd-9823-2c09514adf69" acquired by "delete_volume" :: waited 0.022s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:06:23 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[a480cc1f-eafe-429d-8d62-596255a69d59]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:06:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-814195ee-3d58-4a9e-8767-f061c078f991 tempest-AttachVolumeNegativeTest-706916992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f531e27-5b35-4edd-9823-2c09514adf69 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:06:24 devstack sudo[91767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f531e27-5b35-4edd-9823-2c09514adf69
Nov 06 17:06:24 devstack sudo[91767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:06:24 devstack sudo[91767]: pam_unix(sudo:session): session closed for user root
Nov 06 17:06:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-814195ee-3d58-4a9e-8767-f061c078f991 tempest-AttachVolumeNegativeTest-706916992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f531e27-5b35-4edd-9823-2c09514adf69" returned: 0 in 0.687s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:06:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-814195ee-3d58-4a9e-8767-f061c078f991 tempest-AttachVolumeNegativeTest-706916992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f531e27-5b35-4edd-9823-2c09514adf69 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:06:24 devstack sudo[91775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f531e27-5b35-4edd-9823-2c09514adf69
Nov 06 17:06:24 devstack sudo[91775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:06:24 devstack sudo[91775]: pam_unix(sudo:session): session closed for user root
Nov 06 17:06:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-814195ee-3d58-4a9e-8767-f061c078f991 tempest-AttachVolumeNegativeTest-706916992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f531e27-5b35-4edd-9823-2c09514adf69" returned: 0 in 0.465s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:06:25 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-814195ee-3d58-4a9e-8767-f061c078f991 tempest-AttachVolumeNegativeTest-706916992 None] Lock "cinder-quobyte-3f531e27-5b35-4edd-9823-2c09514adf69" released by "delete_volume" :: held 1.235s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:06:25 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-814195ee-3d58-4a9e-8767-f061c078f991 tempest-AttachVolumeNegativeTest-706916992 None] Created reservations ['bb6197ac-de13-42ac-9f1d-0ee7a3803ce3', 'c51977c1-368a-44d3-9b5d-866a76c3a401', '10b40f31-4104-4429-a146-94ee5de3bcb6', 'f814a8f6-ce29-4914-92bf-db4c5b260c56'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:06:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-814195ee-3d58-4a9e-8767-f061c078f991 tempest-AttachVolumeNegativeTest-706916992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:06:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-814195ee-3d58-4a9e-8767-f061c078f991 tempest-AttachVolumeNegativeTest-706916992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:06:25 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-814195ee-3d58-4a9e-8767-f061c078f991 tempest-AttachVolumeNegativeTest-706916992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:06:25 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-814195ee-3d58-4a9e-8767-f061c078f991 tempest-AttachVolumeNegativeTest-706916992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:06:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-814195ee-3d58-4a9e-8767-f061c078f991 tempest-AttachVolumeNegativeTest-706916992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:06:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-814195ee-3d58-4a9e-8767-f061c078f991 tempest-AttachVolumeNegativeTest-706916992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:06:25 devstack sudo[91778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:06:25 devstack sudo[91778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:06:25 devstack sudo[91778]: pam_unix(sudo:session): session closed for user root
Nov 06 17:06:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-814195ee-3d58-4a9e-8767-f061c078f991 tempest-AttachVolumeNegativeTest-706916992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.387s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:06:25 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-814195ee-3d58-4a9e-8767-f061c078f991 tempest-AttachVolumeNegativeTest-706916992 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:06:25 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-814195ee-3d58-4a9e-8767-f061c078f991 tempest-AttachVolumeNegativeTest-706916992 None] Deleted volume successfully.
Nov 06 17:06:25 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-814195ee-3d58-4a9e-8767-f061c078f991 tempest-AttachVolumeNegativeTest-706916992 None] Lock "cinder-3f531e27-5b35-4edd-9823-2c09514adf69-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:06:26 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-149f775e-b7f0-49f4-8683-4ade2743e27c tempest-AttachVolumeNegativeTest-706916992 None] Acquiring lock "cinder-b9a37bff-5d79-4ee5-8141-ba0b1791d010-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:06:26 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-149f775e-b7f0-49f4-8683-4ade2743e27c tempest-AttachVolumeNegativeTest-706916992 None] Lock "cinder-b9a37bff-5d79-4ee5-8141-ba0b1791d010-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:06:26 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-149f775e-b7f0-49f4-8683-4ade2743e27c tempest-AttachVolumeNegativeTest-706916992 None] Acquiring lock "cinder-quobyte-b9a37bff-5d79-4ee5-8141-ba0b1791d010" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:06:26 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-149f775e-b7f0-49f4-8683-4ade2743e27c tempest-AttachVolumeNegativeTest-706916992 None] Lock "cinder-quobyte-b9a37bff-5d79-4ee5-8141-ba0b1791d010" acquired by "delete_volume" :: waited 0.037s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:06:26 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8caa55-43c4-42f2-a62c-83cc5c01c630]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:06:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-149f775e-b7f0-49f4-8683-4ade2743e27c tempest-AttachVolumeNegativeTest-706916992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b9a37bff-5d79-4ee5-8141-ba0b1791d010 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:06:26 devstack sudo[91785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b9a37bff-5d79-4ee5-8141-ba0b1791d010
Nov 06 17:06:26 devstack sudo[91785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:06:27 devstack sudo[91785]: pam_unix(sudo:session): session closed for user root
Nov 06 17:06:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-149f775e-b7f0-49f4-8683-4ade2743e27c tempest-AttachVolumeNegativeTest-706916992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b9a37bff-5d79-4ee5-8141-ba0b1791d010" returned: 0 in 0.539s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:06:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-149f775e-b7f0-49f4-8683-4ade2743e27c tempest-AttachVolumeNegativeTest-706916992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b9a37bff-5d79-4ee5-8141-ba0b1791d010 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:06:27 devstack sudo[91791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b9a37bff-5d79-4ee5-8141-ba0b1791d010
Nov 06 17:06:27 devstack sudo[91791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:06:27 devstack sudo[91791]: pam_unix(sudo:session): session closed for user root
Nov 06 17:06:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-149f775e-b7f0-49f4-8683-4ade2743e27c tempest-AttachVolumeNegativeTest-706916992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b9a37bff-5d79-4ee5-8141-ba0b1791d010" returned: 0 in 0.334s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:06:27 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-149f775e-b7f0-49f4-8683-4ade2743e27c tempest-AttachVolumeNegativeTest-706916992 None] Lock "cinder-quobyte-b9a37bff-5d79-4ee5-8141-ba0b1791d010" released by "delete_volume" :: held 0.980s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:06:27 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-149f775e-b7f0-49f4-8683-4ade2743e27c tempest-AttachVolumeNegativeTest-706916992 None] Created reservations ['faeeea58-cfa8-4a1f-a60d-b0bb8bdb02f6', 'faf31f89-bece-439c-bf4e-4779708bcbba', 'ac15b6eb-e50f-46b9-b640-61902112c6f9', 'a6473568-ca0f-47b4-b128-146d0f3b5567'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:06:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-149f775e-b7f0-49f4-8683-4ade2743e27c tempest-AttachVolumeNegativeTest-706916992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:06:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-149f775e-b7f0-49f4-8683-4ade2743e27c tempest-AttachVolumeNegativeTest-706916992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:06:27 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-149f775e-b7f0-49f4-8683-4ade2743e27c tempest-AttachVolumeNegativeTest-706916992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:06:27 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-149f775e-b7f0-49f4-8683-4ade2743e27c tempest-AttachVolumeNegativeTest-706916992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:06:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-149f775e-b7f0-49f4-8683-4ade2743e27c tempest-AttachVolumeNegativeTest-706916992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:06:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-149f775e-b7f0-49f4-8683-4ade2743e27c tempest-AttachVolumeNegativeTest-706916992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:06:27 devstack sudo[91798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:06:27 devstack sudo[91798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:06:28 devstack sudo[91798]: pam_unix(sudo:session): session closed for user root
Nov 06 17:06:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-149f775e-b7f0-49f4-8683-4ade2743e27c tempest-AttachVolumeNegativeTest-706916992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.340s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:06:28 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-149f775e-b7f0-49f4-8683-4ade2743e27c tempest-AttachVolumeNegativeTest-706916992 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:06:28 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-149f775e-b7f0-49f4-8683-4ade2743e27c tempest-AttachVolumeNegativeTest-706916992 None] Deleted volume successfully.
Nov 06 17:06:28 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-149f775e-b7f0-49f4-8683-4ade2743e27c tempest-AttachVolumeNegativeTest-706916992 None] Lock "cinder-b9a37bff-5d79-4ee5-8141-ba0b1791d010-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:06:37 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=38,cinder:UPDATE=46,cinder:INSERT=10,cinder:DELETE=4 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:06:38 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=39,cinder:UPDATE=49,cinder:INSERT=12,cinder:DELETE=3 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:06:41 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [req-e48d0cc5-8b55-48ae-8d21-5a9b17b4b5d3 req-290137d3-ebe4-4a1b-8373-b5d9315f1cb8 tempest-VolumesSnapshotsTestJSON-827644514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:06:41 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-e48d0cc5-8b55-48ae-8d21-5a9b17b4b5d3 req-290137d3-ebe4-4a1b-8373-b5d9315f1cb8 tempest-VolumesSnapshotsTestJSON-827644514 None] Flow 'volume_create_manager' (cec57246-9705-40e8-a0fd-81674a9a4b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:06:41 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-e48d0cc5-8b55-48ae-8d21-5a9b17b4b5d3 req-290137d3-ebe4-4a1b-8373-b5d9315f1cb8 tempest-VolumesSnapshotsTestJSON-827644514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ebd5ca5-fc46-4bb0-82b4-6021ae2ae070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:06:41 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-e48d0cc5-8b55-48ae-8d21-5a9b17b4b5d3 req-290137d3-ebe4-4a1b-8373-b5d9315f1cb8 tempest-VolumesSnapshotsTestJSON-827644514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ebd5ca5-fc46-4bb0-82b4-6021ae2ae070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-693348169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c21fedc4-2da2-47c5-8ca8-260f92eec81f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dc0e0861e2345a5af06dfc580d3d36d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:06:42Z,use_quota=True,user_id='e106208d66c14db38c34295c2eaa96c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:06:41 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-e48d0cc5-8b55-48ae-8d21-5a9b17b4b5d3 req-290137d3-ebe4-4a1b-8373-b5d9315f1cb8 tempest-VolumesSnapshotsTestJSON-827644514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03f95189-b131-4f11-9501-f41308ba813f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:06:41 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-e48d0cc5-8b55-48ae-8d21-5a9b17b4b5d3 req-290137d3-ebe4-4a1b-8373-b5d9315f1cb8 tempest-VolumesSnapshotsTestJSON-827644514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03f95189-b131-4f11-9501-f41308ba813f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:06:41 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-e48d0cc5-8b55-48ae-8d21-5a9b17b4b5d3 req-290137d3-ebe4-4a1b-8373-b5d9315f1cb8 tempest-VolumesSnapshotsTestJSON-827644514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddfebacd-45d8-4404-b0a8-86fdf5345df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:06:41 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-e48d0cc5-8b55-48ae-8d21-5a9b17b4b5d3 req-290137d3-ebe4-4a1b-8373-b5d9315f1cb8 tempest-VolumesSnapshotsTestJSON-827644514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddfebacd-45d8-4404-b0a8-86fdf5345df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c21fedc4-2da2-47c5-8ca8-260f92eec81f', 'volume_name': 'volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:06:41 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-e48d0cc5-8b55-48ae-8d21-5a9b17b4b5d3 req-290137d3-ebe4-4a1b-8373-b5d9315f1cb8 tempest-VolumesSnapshotsTestJSON-827644514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a60fa76-8e28-4139-b73f-2fef6abf02b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:06:41 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-e48d0cc5-8b55-48ae-8d21-5a9b17b4b5d3 req-290137d3-ebe4-4a1b-8373-b5d9315f1cb8 tempest-VolumesSnapshotsTestJSON-827644514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a60fa76-8e28-4139-b73f-2fef6abf02b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:06:41 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-e48d0cc5-8b55-48ae-8d21-5a9b17b4b5d3 req-290137d3-ebe4-4a1b-8373-b5d9315f1cb8 tempest-VolumesSnapshotsTestJSON-827644514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b18b6fe-0ba0-4c2d-8923-418eabca031a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:06:41 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [req-e48d0cc5-8b55-48ae-8d21-5a9b17b4b5d3 req-290137d3-ebe4-4a1b-8373-b5d9315f1cb8 tempest-VolumesSnapshotsTestJSON-827644514 None] Volume c21fedc4-2da2-47c5-8ca8-260f92eec81f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f', 'volume_size': 1}
Nov 06 17:06:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-e48d0cc5-8b55-48ae-8d21-5a9b17b4b5d3 req-290137d3-ebe4-4a1b-8373-b5d9315f1cb8 tempest-VolumesSnapshotsTestJSON-827644514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:06:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-e48d0cc5-8b55-48ae-8d21-5a9b17b4b5d3 req-290137d3-ebe4-4a1b-8373-b5d9315f1cb8 tempest-VolumesSnapshotsTestJSON-827644514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:06:41 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [req-e48d0cc5-8b55-48ae-8d21-5a9b17b4b5d3 req-290137d3-ebe4-4a1b-8373-b5d9315f1cb8 tempest-VolumesSnapshotsTestJSON-827644514 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-693348169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c21fedc4-2da2-47c5-8ca8-260f92eec81f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dc0e0861e2345a5af06dfc580d3d36d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:06:42Z,use_quota=True,user_id='e106208d66c14db38c34295c2eaa96c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:06:41 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [req-e48d0cc5-8b55-48ae-8d21-5a9b17b4b5d3 req-290137d3-ebe4-4a1b-8373-b5d9315f1cb8 tempest-VolumesSnapshotsTestJSON-827644514 None] Creating volume c21fedc4-2da2-47c5-8ca8-260f92eec81f {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:06:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-e48d0cc5-8b55-48ae-8d21-5a9b17b4b5d3 req-290137d3-ebe4-4a1b-8373-b5d9315f1cb8 tempest-VolumesSnapshotsTestJSON-827644514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:06:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-e48d0cc5-8b55-48ae-8d21-5a9b17b4b5d3 req-290137d3-ebe4-4a1b-8373-b5d9315f1cb8 tempest-VolumesSnapshotsTestJSON-827644514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:06:41 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [req-e48d0cc5-8b55-48ae-8d21-5a9b17b4b5d3 req-290137d3-ebe4-4a1b-8373-b5d9315f1cb8 tempest-VolumesSnapshotsTestJSON-827644514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:06:41 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [req-e48d0cc5-8b55-48ae-8d21-5a9b17b4b5d3 req-290137d3-ebe4-4a1b-8373-b5d9315f1cb8 tempest-VolumesSnapshotsTestJSON-827644514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:06:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-e48d0cc5-8b55-48ae-8d21-5a9b17b4b5d3 req-290137d3-ebe4-4a1b-8373-b5d9315f1cb8 tempest-VolumesSnapshotsTestJSON-827644514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:06:41 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [req-e48d0cc5-8b55-48ae-8d21-5a9b17b4b5d3 req-290137d3-ebe4-4a1b-8373-b5d9315f1cb8 tempest-VolumesSnapshotsTestJSON-827644514 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:06:41 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [req-e48d0cc5-8b55-48ae-8d21-5a9b17b4b5d3 req-290137d3-ebe4-4a1b-8373-b5d9315f1cb8 tempest-VolumesSnapshotsTestJSON-827644514 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:06:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-e48d0cc5-8b55-48ae-8d21-5a9b17b4b5d3 req-290137d3-ebe4-4a1b-8373-b5d9315f1cb8 tempest-VolumesSnapshotsTestJSON-827644514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:06:41 devstack sudo[91946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f 1073741824
Nov 06 17:06:41 devstack sudo[91946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:06:42 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:06:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:06:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:06:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:06:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:06:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:06:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:06:42 devstack sudo[91953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:06:42 devstack sudo[91953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:06:42 devstack sudo[91946]: pam_unix(sudo:session): session closed for user root
Nov 06 17:06:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-e48d0cc5-8b55-48ae-8d21-5a9b17b4b5d3 req-290137d3-ebe4-4a1b-8373-b5d9315f1cb8 tempest-VolumesSnapshotsTestJSON-827644514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f 1073741824" returned: 0 in 0.728s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:06:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-e48d0cc5-8b55-48ae-8d21-5a9b17b4b5d3 req-290137d3-ebe4-4a1b-8373-b5d9315f1cb8 tempest-VolumesSnapshotsTestJSON-827644514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:06:42 devstack sudo[91955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f
Nov 06 17:06:42 devstack sudo[91955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:06:42 devstack sudo[91953]: pam_unix(sudo:session): session closed for user root
Nov 06 17:06:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.396s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:06:42 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:06:42 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager._thread_info {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:06:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread count: 28 {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 17:06:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread info: [<_MainThread(MainThread, started 125183137599616)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125183027608256)>, <Thread(Thread-3 (stat_writer), started daemon 125183025243776)>, <Thread(Rabbit-heartbeat, started daemon 125183023512896)>, <Thread(Thread-5 (_runner), started daemon 125183023357120)>, <Thread(Thread-7 (_runner), started daemon 125183021306496)>, <Thread(fd_logger, started daemon 125183018711616)>, <Thread(privsep_reader, started daemon 125183017484224)>, <Thread(tpool_thread_0, started daemon 125183013742272)>, <Thread(tpool_thread_1, started daemon 125183005349568)>, <Thread(tpool_thread_2, started daemon 125182996956864)>, <Thread(tpool_thread_3, started daemon 125182988564160)>, <Thread(tpool_thread_4, started daemon 125182980171456)>, <Thread(tpool_thread_5, started daemon 125182971778752)>, <Thread(tpool_thread_6, started daemon 125182963386048)>, <Thread(tpool_thread_7, started daemon 125182954993344)>, <Thread(tpool_thread_8, started daemon 125182946600640)>, <Thread(tpool_thread_9, started daemon 125182938207936)>, <Thread(tpool_thread_10, started daemon 125182929815232)>, <Thread(tpool_thread_11, started daemon 125182921422528)>, <Thread(tpool_thread_12, started daemon 125182913013440)>, <Thread(tpool_thread_13, started daemon 125182904604352)>, <Thread(tpool_thread_14, started daemon 125182896195264)>, <Thread(tpool_thread_15, started daemon 125182887786176)>, <Thread(tpool_thread_16, started daemon 125182879377088)>, <Thread(tpool_thread_17, started daemon 125182870968000)>, <Thread(tpool_thread_18, started daemon 125182862558912)>, <Thread(tpool_thread_19, started daemon 125182854149824)>] {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 17:06:43 devstack sudo[91955]: pam_unix(sudo:session): session closed for user root
Nov 06 17:06:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-e48d0cc5-8b55-48ae-8d21-5a9b17b4b5d3 req-290137d3-ebe4-4a1b-8373-b5d9315f1cb8 tempest-VolumesSnapshotsTestJSON-827644514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f" returned: 0 in 0.485s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:06:43 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [req-e48d0cc5-8b55-48ae-8d21-5a9b17b4b5d3 req-290137d3-ebe4-4a1b-8373-b5d9315f1cb8 tempest-VolumesSnapshotsTestJSON-827644514 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:06:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-e48d0cc5-8b55-48ae-8d21-5a9b17b4b5d3 req-290137d3-ebe4-4a1b-8373-b5d9315f1cb8 tempest-VolumesSnapshotsTestJSON-827644514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:06:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-e48d0cc5-8b55-48ae-8d21-5a9b17b4b5d3 req-290137d3-ebe4-4a1b-8373-b5d9315f1cb8 tempest-VolumesSnapshotsTestJSON-827644514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b18b6fe-0ba0-4c2d-8923-418eabca031a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:06:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-e48d0cc5-8b55-48ae-8d21-5a9b17b4b5d3 req-290137d3-ebe4-4a1b-8373-b5d9315f1cb8 tempest-VolumesSnapshotsTestJSON-827644514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5afac70-7989-4c92-8fd9-16df36752881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:06:43 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [req-e48d0cc5-8b55-48ae-8d21-5a9b17b4b5d3 req-290137d3-ebe4-4a1b-8373-b5d9315f1cb8 tempest-VolumesSnapshotsTestJSON-827644514 None] Volume volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f (c21fedc4-2da2-47c5-8ca8-260f92eec81f): created successfully
Nov 06 17:06:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-e48d0cc5-8b55-48ae-8d21-5a9b17b4b5d3 req-290137d3-ebe4-4a1b-8373-b5d9315f1cb8 tempest-VolumesSnapshotsTestJSON-827644514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5afac70-7989-4c92-8fd9-16df36752881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:06:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-e48d0cc5-8b55-48ae-8d21-5a9b17b4b5d3 req-290137d3-ebe4-4a1b-8373-b5d9315f1cb8 tempest-VolumesSnapshotsTestJSON-827644514 None] Flow 'volume_create_manager' (cec57246-9705-40e8-a0fd-81674a9a4b5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:06:43 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-e48d0cc5-8b55-48ae-8d21-5a9b17b4b5d3 req-290137d3-ebe4-4a1b-8373-b5d9315f1cb8 tempest-VolumesSnapshotsTestJSON-827644514 None] Created volume successfully.
Nov 06 17:06:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-232b0d10-8450-4055-89ac-b79d7a3bf24f req-1564f122-9d7f-4aa7-b4ae-b9fce7980f81 tempest-VolumesSnapshotsTestJSON-827644514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:06:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-232b0d10-8450-4055-89ac-b79d7a3bf24f req-1564f122-9d7f-4aa7-b4ae-b9fce7980f81 tempest-VolumesSnapshotsTestJSON-827644514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:06:44 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [req-232b0d10-8450-4055-89ac-b79d7a3bf24f req-1564f122-9d7f-4aa7-b4ae-b9fce7980f81 tempest-VolumesSnapshotsTestJSON-827644514 None] Creating offline snapshot b6ee40c8-8c94-4df9-b43e-42988ad34caa of volume c21fedc4-2da2-47c5-8ca8-260f92eec81f {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:06:44 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f61107-9db8-443d-a245-670f44035092]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:06:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-232b0d10-8450-4055-89ac-b79d7a3bf24f req-1564f122-9d7f-4aa7-b4ae-b9fce7980f81 tempest-VolumesSnapshotsTestJSON-827644514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:06:44 devstack sudo[91967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f
Nov 06 17:06:44 devstack sudo[91967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:06:45 devstack sudo[91967]: pam_unix(sudo:session): session closed for user root
Nov 06 17:06:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-232b0d10-8450-4055-89ac-b79d7a3bf24f req-1564f122-9d7f-4aa7-b4ae-b9fce7980f81 tempest-VolumesSnapshotsTestJSON-827644514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f" returned: 0 in 0.590s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:06:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-232b0d10-8450-4055-89ac-b79d7a3bf24f req-1564f122-9d7f-4aa7-b4ae-b9fce7980f81 tempest-VolumesSnapshotsTestJSON-827644514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f.b6ee40c8-8c94-4df9-b43e-42988ad34caa 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:06:45 devstack sudo[91972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f.b6ee40c8-8c94-4df9-b43e-42988ad34caa 1G
Nov 06 17:06:45 devstack sudo[91972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:06:45 devstack sudo[91972]: pam_unix(sudo:session): session closed for user root
Nov 06 17:06:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-232b0d10-8450-4055-89ac-b79d7a3bf24f req-1564f122-9d7f-4aa7-b4ae-b9fce7980f81 tempest-VolumesSnapshotsTestJSON-827644514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f.b6ee40c8-8c94-4df9-b43e-42988ad34caa 1G" returned: 0 in 0.592s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:06:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-232b0d10-8450-4055-89ac-b79d7a3bf24f req-1564f122-9d7f-4aa7-b4ae-b9fce7980f81 tempest-VolumesSnapshotsTestJSON-827644514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f.b6ee40c8-8c94-4df9-b43e-42988ad34caa {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:06:45 devstack sudo[91980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f.b6ee40c8-8c94-4df9-b43e-42988ad34caa
Nov 06 17:06:45 devstack sudo[91980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:06:46 devstack sudo[91980]: pam_unix(sudo:session): session closed for user root
Nov 06 17:06:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-232b0d10-8450-4055-89ac-b79d7a3bf24f req-1564f122-9d7f-4aa7-b4ae-b9fce7980f81 tempest-VolumesSnapshotsTestJSON-827644514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f.b6ee40c8-8c94-4df9-b43e-42988ad34caa" returned: 0 in 0.612s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:06:46 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [req-232b0d10-8450-4055-89ac-b79d7a3bf24f req-1564f122-9d7f-4aa7-b4ae-b9fce7980f81 tempest-VolumesSnapshotsTestJSON-827644514 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f.b6ee40c8-8c94-4df9-b43e-42988ad34caa is being set with open permissions: ugo+rw
Nov 06 17:06:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-232b0d10-8450-4055-89ac-b79d7a3bf24f req-1564f122-9d7f-4aa7-b4ae-b9fce7980f81 tempest-VolumesSnapshotsTestJSON-827644514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f.b6ee40c8-8c94-4df9-b43e-42988ad34caa {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:06:46 devstack sudo[91989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f.b6ee40c8-8c94-4df9-b43e-42988ad34caa
Nov 06 17:06:46 devstack sudo[91989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:06:47 devstack sudo[91989]: pam_unix(sudo:session): session closed for user root
Nov 06 17:06:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-232b0d10-8450-4055-89ac-b79d7a3bf24f req-1564f122-9d7f-4aa7-b4ae-b9fce7980f81 tempest-VolumesSnapshotsTestJSON-827644514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f.b6ee40c8-8c94-4df9-b43e-42988ad34caa" returned: 0 in 0.709s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:06:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-232b0d10-8450-4055-89ac-b79d7a3bf24f req-1564f122-9d7f-4aa7-b4ae-b9fce7980f81 tempest-VolumesSnapshotsTestJSON-827644514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:06:47 devstack sudo[92011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f.info
Nov 06 17:06:47 devstack sudo[92011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:06:47 devstack sudo[92011]: pam_unix(sudo:session): session closed for user root
Nov 06 17:06:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-232b0d10-8450-4055-89ac-b79d7a3bf24f req-1564f122-9d7f-4aa7-b4ae-b9fce7980f81 tempest-VolumesSnapshotsTestJSON-827644514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f.info" returned: 0 in 0.557s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:06:47 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [req-232b0d10-8450-4055-89ac-b79d7a3bf24f req-1564f122-9d7f-4aa7-b4ae-b9fce7980f81 tempest-VolumesSnapshotsTestJSON-827644514 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f.info is being set with open permissions: ugo+rw
Nov 06 17:06:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-232b0d10-8450-4055-89ac-b79d7a3bf24f req-1564f122-9d7f-4aa7-b4ae-b9fce7980f81 tempest-VolumesSnapshotsTestJSON-827644514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:06:47 devstack sudo[92015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f.info
Nov 06 17:06:47 devstack sudo[92015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:06:48 devstack sudo[92015]: pam_unix(sudo:session): session closed for user root
Nov 06 17:06:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-232b0d10-8450-4055-89ac-b79d7a3bf24f req-1564f122-9d7f-4aa7-b4ae-b9fce7980f81 tempest-VolumesSnapshotsTestJSON-827644514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f.info" returned: 0 in 0.332s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:06:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-232b0d10-8450-4055-89ac-b79d7a3bf24f req-1564f122-9d7f-4aa7-b4ae-b9fce7980f81 tempest-VolumesSnapshotsTestJSON-827644514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.610s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:06:48 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-232b0d10-8450-4055-89ac-b79d7a3bf24f req-1564f122-9d7f-4aa7-b4ae-b9fce7980f81 tempest-VolumesSnapshotsTestJSON-827644514 None] Create snapshot completed successfully
Nov 06 17:06:48 devstack cinder-volume[86856]: DEBUG cinder.coordination [req-69325de3-1a5c-4272-b824-ec49680e0cb8 req-6df56515-991d-4658-a732-6abf11af30e2 tempest-VolumesSnapshotsTestJSON-827644514 None] Acquiring lock "cinder-b6ee40c8-8c94-4df9-b43e-42988ad34caa-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:06:48 devstack cinder-volume[86856]: DEBUG cinder.coordination [req-69325de3-1a5c-4272-b824-ec49680e0cb8 req-6df56515-991d-4658-a732-6abf11af30e2 tempest-VolumesSnapshotsTestJSON-827644514 None] Lock "cinder-b6ee40c8-8c94-4df9-b43e-42988ad34caa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:06:48 devstack cinder-volume[86856]: DEBUG cinder.coordination [req-69325de3-1a5c-4272-b824-ec49680e0cb8 req-6df56515-991d-4658-a732-6abf11af30e2 tempest-VolumesSnapshotsTestJSON-827644514 None] Acquiring lock "cinder-quobyte-c21fedc4-2da2-47c5-8ca8-260f92eec81f" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:06:48 devstack cinder-volume[86856]: DEBUG cinder.coordination [req-69325de3-1a5c-4272-b824-ec49680e0cb8 req-6df56515-991d-4658-a732-6abf11af30e2 tempest-VolumesSnapshotsTestJSON-827644514 None] Lock "cinder-quobyte-c21fedc4-2da2-47c5-8ca8-260f92eec81f" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:06:48 devstack cinder-volume[86856]: DEBUG cinder.coordination [req-69325de3-1a5c-4272-b824-ec49680e0cb8 req-6df56515-991d-4658-a732-6abf11af30e2 tempest-VolumesSnapshotsTestJSON-827644514 None] Acquiring lock "cinder-quobyte-b6ee40c8-8c94-4df9-b43e-42988ad34caa" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:06:48 devstack cinder-volume[86856]: DEBUG cinder.coordination [req-69325de3-1a5c-4272-b824-ec49680e0cb8 req-6df56515-991d-4658-a732-6abf11af30e2 tempest-VolumesSnapshotsTestJSON-827644514 None] Lock "cinder-quobyte-b6ee40c8-8c94-4df9-b43e-42988ad34caa" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:06:48 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [req-69325de3-1a5c-4272-b824-ec49680e0cb8 req-6df56515-991d-4658-a732-6abf11af30e2 tempest-VolumesSnapshotsTestJSON-827644514 None] Deleting offline snapshot b6ee40c8-8c94-4df9-b43e-42988ad34caa of volume c21fedc4-2da2-47c5-8ca8-260f92eec81f {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:06:48 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [req-69325de3-1a5c-4272-b824-ec49680e0cb8 req-6df56515-991d-4658-a732-6abf11af30e2 tempest-VolumesSnapshotsTestJSON-827644514 None] snapshot_file for this snap is: volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f.b6ee40c8-8c94-4df9-b43e-42988ad34caa {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:06:48 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf37714c-2245-4a98-870f-b5977f11fa11]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:06:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-69325de3-1a5c-4272-b824-ec49680e0cb8 req-6df56515-991d-4658-a732-6abf11af30e2 tempest-VolumesSnapshotsTestJSON-827644514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f.b6ee40c8-8c94-4df9-b43e-42988ad34caa {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:06:48 devstack sudo[92020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f.b6ee40c8-8c94-4df9-b43e-42988ad34caa
Nov 06 17:06:48 devstack sudo[92020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:06:49 devstack sudo[92020]: pam_unix(sudo:session): session closed for user root
Nov 06 17:06:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-69325de3-1a5c-4272-b824-ec49680e0cb8 req-6df56515-991d-4658-a732-6abf11af30e2 tempest-VolumesSnapshotsTestJSON-827644514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f.b6ee40c8-8c94-4df9-b43e-42988ad34caa" returned: 0 in 0.582s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:06:49 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [req-69325de3-1a5c-4272-b824-ec49680e0cb8 req-6df56515-991d-4658-a732-6abf11af30e2 tempest-VolumesSnapshotsTestJSON-827644514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:06:49 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[b929a8c4-1dda-40cd-a902-7018917d3278]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:06:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-69325de3-1a5c-4272-b824-ec49680e0cb8 req-6df56515-991d-4658-a732-6abf11af30e2 tempest-VolumesSnapshotsTestJSON-827644514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:06:49 devstack sudo[92027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f
Nov 06 17:06:49 devstack sudo[92027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:06:49 devstack sudo[92027]: pam_unix(sudo:session): session closed for user root
Nov 06 17:06:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-69325de3-1a5c-4272-b824-ec49680e0cb8 req-6df56515-991d-4658-a732-6abf11af30e2 tempest-VolumesSnapshotsTestJSON-827644514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f" returned: 0 in 0.561s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:06:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-69325de3-1a5c-4272-b824-ec49680e0cb8 req-6df56515-991d-4658-a732-6abf11af30e2 tempest-VolumesSnapshotsTestJSON-827644514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f.b6ee40c8-8c94-4df9-b43e-42988ad34caa {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:06:49 devstack sudo[92032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f.b6ee40c8-8c94-4df9-b43e-42988ad34caa
Nov 06 17:06:49 devstack sudo[92032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:06:50 devstack sudo[92032]: pam_unix(sudo:session): session closed for user root
Nov 06 17:06:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-69325de3-1a5c-4272-b824-ec49680e0cb8 req-6df56515-991d-4658-a732-6abf11af30e2 tempest-VolumesSnapshotsTestJSON-827644514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f.b6ee40c8-8c94-4df9-b43e-42988ad34caa" returned: 0 in 0.636s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:06:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-69325de3-1a5c-4272-b824-ec49680e0cb8 req-6df56515-991d-4658-a732-6abf11af30e2 tempest-VolumesSnapshotsTestJSON-827644514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f.b6ee40c8-8c94-4df9-b43e-42988ad34caa {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:06:50 devstack sudo[92041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f.b6ee40c8-8c94-4df9-b43e-42988ad34caa
Nov 06 17:06:50 devstack sudo[92041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:06:50 devstack sudo[92041]: pam_unix(sudo:session): session closed for user root
Nov 06 17:06:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-69325de3-1a5c-4272-b824-ec49680e0cb8 req-6df56515-991d-4658-a732-6abf11af30e2 tempest-VolumesSnapshotsTestJSON-827644514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f.b6ee40c8-8c94-4df9-b43e-42988ad34caa" returned: 0 in 0.388s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:06:51 devstack cinder-volume[86856]: DEBUG cinder.coordination [req-69325de3-1a5c-4272-b824-ec49680e0cb8 req-6df56515-991d-4658-a732-6abf11af30e2 tempest-VolumesSnapshotsTestJSON-827644514 None] Lock "cinder-quobyte-b6ee40c8-8c94-4df9-b43e-42988ad34caa" released by "_delete_snapshot" :: held 2.358s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:06:51 devstack cinder-volume[86856]: DEBUG cinder.coordination [req-69325de3-1a5c-4272-b824-ec49680e0cb8 req-6df56515-991d-4658-a732-6abf11af30e2 tempest-VolumesSnapshotsTestJSON-827644514 None] Lock "cinder-quobyte-c21fedc4-2da2-47c5-8ca8-260f92eec81f" released by "delete_snapshot" :: held 2.409s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:06:51 devstack cinder-volume[86856]: WARNING cinder.quota [req-69325de3-1a5c-4272-b824-ec49680e0cb8 req-6df56515-991d-4658-a732-6abf11af30e2 tempest-VolumesSnapshotsTestJSON-827644514 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 06 17:06:51 devstack cinder-volume[86856]: DEBUG cinder.quota [req-69325de3-1a5c-4272-b824-ec49680e0cb8 req-6df56515-991d-4658-a732-6abf11af30e2 tempest-VolumesSnapshotsTestJSON-827644514 None] Created reservations ['bb96386b-800e-428e-8fca-d04f6cec5108', '4a091098-a54c-485e-8b86-a10a015b7128', 'ea5991e4-3515-489b-af8a-bb71610dfd5f', '3bdba841-af12-48b9-8767-20ae092c2519'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:06:51 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-69325de3-1a5c-4272-b824-ec49680e0cb8 req-6df56515-991d-4658-a732-6abf11af30e2 tempest-VolumesSnapshotsTestJSON-827644514 None] Delete snapshot completed successfully.
Nov 06 17:06:51 devstack cinder-volume[86856]: DEBUG cinder.coordination [req-69325de3-1a5c-4272-b824-ec49680e0cb8 req-6df56515-991d-4658-a732-6abf11af30e2 tempest-VolumesSnapshotsTestJSON-827644514 None] Lock "cinder-b6ee40c8-8c94-4df9-b43e-42988ad34caa-delete_snapshot" released by "delete_snapshot" :: held 2.655s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:06:52 devstack cinder-volume[86856]: DEBUG cinder.coordination [req-b23b26a6-9274-4a89-b5fe-77dd8c3aa711 req-648bdabd-950f-40e7-9afd-2e85b82b5ed6 tempest-VolumesSnapshotsTestJSON-827644514 None] Acquiring lock "cinder-c21fedc4-2da2-47c5-8ca8-260f92eec81f-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:06:52 devstack cinder-volume[86856]: DEBUG cinder.coordination [req-b23b26a6-9274-4a89-b5fe-77dd8c3aa711 req-648bdabd-950f-40e7-9afd-2e85b82b5ed6 tempest-VolumesSnapshotsTestJSON-827644514 None] Lock "cinder-c21fedc4-2da2-47c5-8ca8-260f92eec81f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:06:52 devstack cinder-volume[86856]: DEBUG cinder.coordination [req-b23b26a6-9274-4a89-b5fe-77dd8c3aa711 req-648bdabd-950f-40e7-9afd-2e85b82b5ed6 tempest-VolumesSnapshotsTestJSON-827644514 None] Acquiring lock "cinder-quobyte-c21fedc4-2da2-47c5-8ca8-260f92eec81f" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:06:52 devstack cinder-volume[86856]: DEBUG cinder.coordination [req-b23b26a6-9274-4a89-b5fe-77dd8c3aa711 req-648bdabd-950f-40e7-9afd-2e85b82b5ed6 tempest-VolumesSnapshotsTestJSON-827644514 None] Lock "cinder-quobyte-c21fedc4-2da2-47c5-8ca8-260f92eec81f" acquired by "delete_volume" :: waited 0.038s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:06:52 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79660e9-8445-4f48-9d1e-392e5bb7edd9]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:06:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-b23b26a6-9274-4a89-b5fe-77dd8c3aa711 req-648bdabd-950f-40e7-9afd-2e85b82b5ed6 tempest-VolumesSnapshotsTestJSON-827644514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:06:52 devstack sudo[92062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f
Nov 06 17:06:52 devstack sudo[92062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:06:53 devstack sudo[92062]: pam_unix(sudo:session): session closed for user root
Nov 06 17:06:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-b23b26a6-9274-4a89-b5fe-77dd8c3aa711 req-648bdabd-950f-40e7-9afd-2e85b82b5ed6 tempest-VolumesSnapshotsTestJSON-827644514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f" returned: 0 in 0.851s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:06:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-b23b26a6-9274-4a89-b5fe-77dd8c3aa711 req-648bdabd-950f-40e7-9afd-2e85b82b5ed6 tempest-VolumesSnapshotsTestJSON-827644514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:06:53 devstack sudo[92078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f
Nov 06 17:06:53 devstack sudo[92078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:06:53 devstack sudo[92078]: pam_unix(sudo:session): session closed for user root
Nov 06 17:06:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-b23b26a6-9274-4a89-b5fe-77dd8c3aa711 req-648bdabd-950f-40e7-9afd-2e85b82b5ed6 tempest-VolumesSnapshotsTestJSON-827644514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c21fedc4-2da2-47c5-8ca8-260f92eec81f" returned: 0 in 0.597s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:06:53 devstack cinder-volume[86856]: DEBUG cinder.coordination [req-b23b26a6-9274-4a89-b5fe-77dd8c3aa711 req-648bdabd-950f-40e7-9afd-2e85b82b5ed6 tempest-VolumesSnapshotsTestJSON-827644514 None] Lock "cinder-quobyte-c21fedc4-2da2-47c5-8ca8-260f92eec81f" released by "delete_volume" :: held 1.612s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:06:53 devstack cinder-volume[86856]: DEBUG cinder.quota [req-b23b26a6-9274-4a89-b5fe-77dd8c3aa711 req-648bdabd-950f-40e7-9afd-2e85b82b5ed6 tempest-VolumesSnapshotsTestJSON-827644514 None] Created reservations ['4e5f3b43-1740-4807-9d7f-b70fe01036ee', '37c1ebdd-e82a-4fac-a3a8-b676e8cb75f4', '18398c47-e320-458c-8055-a16dbb3da7c7', 'e703cee5-3531-4d69-b28b-7020f184716a'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:06:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-b23b26a6-9274-4a89-b5fe-77dd8c3aa711 req-648bdabd-950f-40e7-9afd-2e85b82b5ed6 tempest-VolumesSnapshotsTestJSON-827644514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:06:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-b23b26a6-9274-4a89-b5fe-77dd8c3aa711 req-648bdabd-950f-40e7-9afd-2e85b82b5ed6 tempest-VolumesSnapshotsTestJSON-827644514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:06:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [req-b23b26a6-9274-4a89-b5fe-77dd8c3aa711 req-648bdabd-950f-40e7-9afd-2e85b82b5ed6 tempest-VolumesSnapshotsTestJSON-827644514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:06:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [req-b23b26a6-9274-4a89-b5fe-77dd8c3aa711 req-648bdabd-950f-40e7-9afd-2e85b82b5ed6 tempest-VolumesSnapshotsTestJSON-827644514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:06:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-b23b26a6-9274-4a89-b5fe-77dd8c3aa711 req-648bdabd-950f-40e7-9afd-2e85b82b5ed6 tempest-VolumesSnapshotsTestJSON-827644514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:06:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-b23b26a6-9274-4a89-b5fe-77dd8c3aa711 req-648bdabd-950f-40e7-9afd-2e85b82b5ed6 tempest-VolumesSnapshotsTestJSON-827644514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:06:54 devstack sudo[92090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:06:54 devstack sudo[92090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:06:54 devstack sudo[92090]: pam_unix(sudo:session): session closed for user root
Nov 06 17:06:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-b23b26a6-9274-4a89-b5fe-77dd8c3aa711 req-648bdabd-950f-40e7-9afd-2e85b82b5ed6 tempest-VolumesSnapshotsTestJSON-827644514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.306s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:06:54 devstack cinder-volume[86856]: DEBUG cinder.manager [req-b23b26a6-9274-4a89-b5fe-77dd8c3aa711 req-648bdabd-950f-40e7-9afd-2e85b82b5ed6 tempest-VolumesSnapshotsTestJSON-827644514 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:06:54 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-b23b26a6-9274-4a89-b5fe-77dd8c3aa711 req-648bdabd-950f-40e7-9afd-2e85b82b5ed6 tempest-VolumesSnapshotsTestJSON-827644514 None] Deleted volume successfully.
Nov 06 17:06:54 devstack cinder-volume[86856]: DEBUG cinder.coordination [req-b23b26a6-9274-4a89-b5fe-77dd8c3aa711 req-648bdabd-950f-40e7-9afd-2e85b82b5ed6 tempest-VolumesSnapshotsTestJSON-827644514 None] Lock "cinder-c21fedc4-2da2-47c5-8ca8-260f92eec81f-delete_volume" released by "delete_volume" :: held 2.209s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:07:04 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=21,cinder:UPDATE=16,cinder:DELETE=1,cinder:INSERT=4 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:07:04 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=11,cinder:UPDATE=20,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:07:11 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fb761ecc-c42c-43be-a713-b98cba3a3bf8 tempest-BackendsCapabilitiesAdminTestsJSON-1227197389 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7657089233398, 'free_capacity_gb': 1773.7657089233398, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86856) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 06 17:07:12 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8a5ecb01-b8f6-4abd-a1fd-a0b22807821c tempest-BackendsCapabilitiesAdminTestsJSON-1227197389 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7657089233398, 'free_capacity_gb': 1773.7657089233398, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86856) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 06 17:07:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-6de1e91d-d0cc-49b5-8bf1-e7b009d74fee req-19e994cf-2413-4f26-9040-4d54175f5ca1 tempest-TaggedAttachmentsTest-1362406288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:07:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-6de1e91d-d0cc-49b5-8bf1-e7b009d74fee req-19e994cf-2413-4f26-9040-4d54175f5ca1 tempest-TaggedAttachmentsTest-1362406288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:07:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-6de1e91d-d0cc-49b5-8bf1-e7b009d74fee req-19e994cf-2413-4f26-9040-4d54175f5ca1 tempest-TaggedAttachmentsTest-1362406288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:07:19 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-6de1e91d-d0cc-49b5-8bf1-e7b009d74fee req-19e994cf-2413-4f26-9040-4d54175f5ca1 tempest-TaggedAttachmentsTest-1362406288 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316', 'name': 'volume-cf2b6238-ab33-496b-b332-4483baefdc4b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '95402b88-f4f4-40e9-84bb-1bfe8115f449', 'enforce_multipath': True} {{(pid=86856) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 17:07:19 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-6de1e91d-d0cc-49b5-8bf1-e7b009d74fee req-19e994cf-2413-4f26-9040-4d54175f5ca1 tempest-TaggedAttachmentsTest-1362406288 None] attachment_update completed successfully.
Nov 06 17:07:21 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dd1a0e4-841a-43a5-afb6-76e32d253706 tempest-ServerRescueNegativeTestJSON-1976205692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:07:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4dd1a0e4-841a-43a5-afb6-76e32d253706 tempest-ServerRescueNegativeTestJSON-1976205692 None] Flow 'volume_create_manager' (52f17d73-df6d-46f7-8594-118031cb7382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:07:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4dd1a0e4-841a-43a5-afb6-76e32d253706 tempest-ServerRescueNegativeTestJSON-1976205692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cadca5dc-8ba5-41eb-b473-763724b24aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:07:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4dd1a0e4-841a-43a5-afb6-76e32d253706 tempest-ServerRescueNegativeTestJSON-1976205692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cadca5dc-8ba5-41eb-b473-763724b24aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-86844199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2e02d68-8876-42b3-8c1a-fbdfd0880273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bae3cc03dc741dd9060ec7330598133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:07:21Z,use_quota=True,user_id='2da4237a61414960a3a9cc140daf6bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:07:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4dd1a0e4-841a-43a5-afb6-76e32d253706 tempest-ServerRescueNegativeTestJSON-1976205692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00de0be7-d645-454e-a898-6d42df72dd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:07:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4dd1a0e4-841a-43a5-afb6-76e32d253706 tempest-ServerRescueNegativeTestJSON-1976205692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00de0be7-d645-454e-a898-6d42df72dd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:07:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4dd1a0e4-841a-43a5-afb6-76e32d253706 tempest-ServerRescueNegativeTestJSON-1976205692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cea312e-1704-4e74-bda8-6394e21a1ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:07:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4dd1a0e4-841a-43a5-afb6-76e32d253706 tempest-ServerRescueNegativeTestJSON-1976205692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cea312e-1704-4e74-bda8-6394e21a1ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2e02d68-8876-42b3-8c1a-fbdfd0880273', 'volume_name': 'volume-c2e02d68-8876-42b3-8c1a-fbdfd0880273', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:07:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4dd1a0e4-841a-43a5-afb6-76e32d253706 tempest-ServerRescueNegativeTestJSON-1976205692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326f8d72-ff07-405f-9586-4afc2dcb58e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:07:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4dd1a0e4-841a-43a5-afb6-76e32d253706 tempest-ServerRescueNegativeTestJSON-1976205692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326f8d72-ff07-405f-9586-4afc2dcb58e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:07:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4dd1a0e4-841a-43a5-afb6-76e32d253706 tempest-ServerRescueNegativeTestJSON-1976205692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c049c1c-b386-4095-814a-9d0b71158007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:07:21 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-4dd1a0e4-841a-43a5-afb6-76e32d253706 tempest-ServerRescueNegativeTestJSON-1976205692 None] Volume c2e02d68-8876-42b3-8c1a-fbdfd0880273: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2e02d68-8876-42b3-8c1a-fbdfd0880273', 'volume_size': 1}
Nov 06 17:07:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4dd1a0e4-841a-43a5-afb6-76e32d253706 tempest-ServerRescueNegativeTestJSON-1976205692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:07:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4dd1a0e4-841a-43a5-afb6-76e32d253706 tempest-ServerRescueNegativeTestJSON-1976205692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:07:21 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4dd1a0e4-841a-43a5-afb6-76e32d253706 tempest-ServerRescueNegativeTestJSON-1976205692 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-86844199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2e02d68-8876-42b3-8c1a-fbdfd0880273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bae3cc03dc741dd9060ec7330598133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:07:21Z,use_quota=True,user_id='2da4237a61414960a3a9cc140daf6bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:07:21 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-4dd1a0e4-841a-43a5-afb6-76e32d253706 tempest-ServerRescueNegativeTestJSON-1976205692 None] Creating volume c2e02d68-8876-42b3-8c1a-fbdfd0880273 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:07:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4dd1a0e4-841a-43a5-afb6-76e32d253706 tempest-ServerRescueNegativeTestJSON-1976205692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:07:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4dd1a0e4-841a-43a5-afb6-76e32d253706 tempest-ServerRescueNegativeTestJSON-1976205692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:07:21 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4dd1a0e4-841a-43a5-afb6-76e32d253706 tempest-ServerRescueNegativeTestJSON-1976205692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:07:21 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4dd1a0e4-841a-43a5-afb6-76e32d253706 tempest-ServerRescueNegativeTestJSON-1976205692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:07:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4dd1a0e4-841a-43a5-afb6-76e32d253706 tempest-ServerRescueNegativeTestJSON-1976205692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:07:21 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4dd1a0e4-841a-43a5-afb6-76e32d253706 tempest-ServerRescueNegativeTestJSON-1976205692 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:07:21 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-4dd1a0e4-841a-43a5-afb6-76e32d253706 tempest-ServerRescueNegativeTestJSON-1976205692 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:07:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4dd1a0e4-841a-43a5-afb6-76e32d253706 tempest-ServerRescueNegativeTestJSON-1976205692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c2e02d68-8876-42b3-8c1a-fbdfd0880273 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:07:21 devstack sudo[92854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c2e02d68-8876-42b3-8c1a-fbdfd0880273 1073741824
Nov 06 17:07:21 devstack sudo[92854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:07:22 devstack sudo[92854]: pam_unix(sudo:session): session closed for user root
Nov 06 17:07:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4dd1a0e4-841a-43a5-afb6-76e32d253706 tempest-ServerRescueNegativeTestJSON-1976205692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c2e02d68-8876-42b3-8c1a-fbdfd0880273 1073741824" returned: 0 in 1.265s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:07:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4dd1a0e4-841a-43a5-afb6-76e32d253706 tempest-ServerRescueNegativeTestJSON-1976205692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c2e02d68-8876-42b3-8c1a-fbdfd0880273 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:07:22 devstack sudo[92864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c2e02d68-8876-42b3-8c1a-fbdfd0880273
Nov 06 17:07:22 devstack sudo[92864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:07:23 devstack sudo[92864]: pam_unix(sudo:session): session closed for user root
Nov 06 17:07:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4dd1a0e4-841a-43a5-afb6-76e32d253706 tempest-ServerRescueNegativeTestJSON-1976205692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c2e02d68-8876-42b3-8c1a-fbdfd0880273" returned: 0 in 0.638s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:07:23 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4dd1a0e4-841a-43a5-afb6-76e32d253706 tempest-ServerRescueNegativeTestJSON-1976205692 None] <== create_volume: return (2025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:07:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4dd1a0e4-841a-43a5-afb6-76e32d253706 tempest-ServerRescueNegativeTestJSON-1976205692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.030s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:07:23 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4dd1a0e4-841a-43a5-afb6-76e32d253706 tempest-ServerRescueNegativeTestJSON-1976205692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c049c1c-b386-4095-814a-9d0b71158007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2e02d68-8876-42b3-8c1a-fbdfd0880273', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:07:23 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4dd1a0e4-841a-43a5-afb6-76e32d253706 tempest-ServerRescueNegativeTestJSON-1976205692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bc6860b-e016-4c52-a3fc-55d64e2c8eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:07:23 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-4dd1a0e4-841a-43a5-afb6-76e32d253706 tempest-ServerRescueNegativeTestJSON-1976205692 None] Volume volume-c2e02d68-8876-42b3-8c1a-fbdfd0880273 (c2e02d68-8876-42b3-8c1a-fbdfd0880273): created successfully
Nov 06 17:07:23 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4dd1a0e4-841a-43a5-afb6-76e32d253706 tempest-ServerRescueNegativeTestJSON-1976205692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bc6860b-e016-4c52-a3fc-55d64e2c8eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:07:23 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4dd1a0e4-841a-43a5-afb6-76e32d253706 tempest-ServerRescueNegativeTestJSON-1976205692 None] Flow 'volume_create_manager' (52f17d73-df6d-46f7-8594-118031cb7382) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:07:23 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-4dd1a0e4-841a-43a5-afb6-76e32d253706 tempest-ServerRescueNegativeTestJSON-1976205692 None] Created volume successfully.
Nov 06 17:07:24 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-adbd4f20-0ecb-4765-8973-e8a35f7d4ba7 req-895aa172-e1f1-48df-9bf0-743c9e0f6b0e tempest-TaggedAttachmentsTest-1362406288 None] Terminate volume connection completed successfully.
Nov 06 17:07:24 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-adbd4f20-0ecb-4765-8973-e8a35f7d4ba7 req-895aa172-e1f1-48df-9bf0-743c9e0f6b0e tempest-TaggedAttachmentsTest-1362406288 None] Deleting attachment 95402b88-f4f4-40e9-84bb-1bfe8115f449. {{(pid=86856) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 17:07:28 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-d60a49e4-edc9-4cef-814e-2c116c1f9392 tempest-GroupSnapshotsV319Test-1140526698 None] Group tempest-GroupSnapshotsV319Test-Group-1974697779: creating
Nov 06 17:07:28 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-d60a49e4-edc9-4cef-814e-2c116c1f9392 tempest-GroupSnapshotsV319Test-1140526698 None] Group tempest-GroupSnapshotsV319Test-Group-1974697779: created successfully
Nov 06 17:07:28 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-d60a49e4-edc9-4cef-814e-2c116c1f9392 tempest-GroupSnapshotsV319Test-1140526698 None] Create group completed successfully.
Nov 06 17:07:30 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-19680c9b-b504-443f-883a-3a7762d35b57 tempest-GroupSnapshotsV319Test-1140526698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:07:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-19680c9b-b504-443f-883a-3a7762d35b57 tempest-GroupSnapshotsV319Test-1140526698 None] Flow 'volume_create_manager' (e2e31549-8685-4f35-b901-76244ad0dc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:07:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-19680c9b-b504-443f-883a-3a7762d35b57 tempest-GroupSnapshotsV319Test-1140526698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cffbd76-0b4e-441f-b023-02459551cb71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:07:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-19680c9b-b504-443f-883a-3a7762d35b57 tempest-GroupSnapshotsV319Test-1140526698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cffbd76-0b4e-441f-b023-02459551cb71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-155207146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=44b6a3b9-7bd0-481d-938d-37808bb8de6f,host='devstack@QuobyteHD#QuobyteHD',id=726d4ee6-c11d-4d2b-84eb-87780cff2f72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a96f5a117314a6380b9e4cce7306eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:07:30Z,use_quota=True,user_id='d76584ba50214de8b32b862a1fdc1d8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e1aa016-6b0a-4814-9069-5424f8dff17f),volume_type_id=5e1aa016-6b0a-4814-9069-5424f8dff17f)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:07:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-19680c9b-b504-443f-883a-3a7762d35b57 tempest-GroupSnapshotsV319Test-1140526698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34eb9d16-9da9-4f5c-b0de-99ae335e0c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:07:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-19680c9b-b504-443f-883a-3a7762d35b57 tempest-GroupSnapshotsV319Test-1140526698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34eb9d16-9da9-4f5c-b0de-99ae335e0c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:07:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-19680c9b-b504-443f-883a-3a7762d35b57 tempest-GroupSnapshotsV319Test-1140526698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4f7c777-315c-40d1-acd6-7f09867249e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:07:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-19680c9b-b504-443f-883a-3a7762d35b57 tempest-GroupSnapshotsV319Test-1140526698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4f7c777-315c-40d1-acd6-7f09867249e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '726d4ee6-c11d-4d2b-84eb-87780cff2f72', 'volume_name': 'volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:07:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-19680c9b-b504-443f-883a-3a7762d35b57 tempest-GroupSnapshotsV319Test-1140526698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b60286e7-c09b-46f1-b430-cfadcd811b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:07:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-19680c9b-b504-443f-883a-3a7762d35b57 tempest-GroupSnapshotsV319Test-1140526698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b60286e7-c09b-46f1-b430-cfadcd811b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:07:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-19680c9b-b504-443f-883a-3a7762d35b57 tempest-GroupSnapshotsV319Test-1140526698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (253f1af5-7565-4900-96b6-faab9eab04bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:07:30 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-19680c9b-b504-443f-883a-3a7762d35b57 tempest-GroupSnapshotsV319Test-1140526698 None] Volume 726d4ee6-c11d-4d2b-84eb-87780cff2f72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72', 'volume_size': 1}
Nov 06 17:07:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-19680c9b-b504-443f-883a-3a7762d35b57 tempest-GroupSnapshotsV319Test-1140526698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:07:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-19680c9b-b504-443f-883a-3a7762d35b57 tempest-GroupSnapshotsV319Test-1140526698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:07:30 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-19680c9b-b504-443f-883a-3a7762d35b57 tempest-GroupSnapshotsV319Test-1140526698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=44b6a3b9-7bd0-481d-938d-37808bb8de6f,created_at=2026-11-06T16:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-155207146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=44b6a3b9-7bd0-481d-938d-37808bb8de6f,host='devstack@QuobyteHD#QuobyteHD',id=726d4ee6-c11d-4d2b-84eb-87780cff2f72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a96f5a117314a6380b9e4cce7306eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:07:30Z,use_quota=True,user_id='d76584ba50214de8b32b862a1fdc1d8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e1aa016-6b0a-4814-9069-5424f8dff17f),volume_type_id=5e1aa016-6b0a-4814-9069-5424f8dff17f)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:07:30 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-19680c9b-b504-443f-883a-3a7762d35b57 tempest-GroupSnapshotsV319Test-1140526698 None] Creating volume 726d4ee6-c11d-4d2b-84eb-87780cff2f72 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:07:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-19680c9b-b504-443f-883a-3a7762d35b57 tempest-GroupSnapshotsV319Test-1140526698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:07:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-19680c9b-b504-443f-883a-3a7762d35b57 tempest-GroupSnapshotsV319Test-1140526698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:07:30 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-19680c9b-b504-443f-883a-3a7762d35b57 tempest-GroupSnapshotsV319Test-1140526698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:07:30 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-19680c9b-b504-443f-883a-3a7762d35b57 tempest-GroupSnapshotsV319Test-1140526698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:07:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-19680c9b-b504-443f-883a-3a7762d35b57 tempest-GroupSnapshotsV319Test-1140526698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:07:30 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-19680c9b-b504-443f-883a-3a7762d35b57 tempest-GroupSnapshotsV319Test-1140526698 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:07:30 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-19680c9b-b504-443f-883a-3a7762d35b57 tempest-GroupSnapshotsV319Test-1140526698 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:07:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-19680c9b-b504-443f-883a-3a7762d35b57 tempest-GroupSnapshotsV319Test-1140526698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:07:30 devstack sudo[92976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72 1073741824
Nov 06 17:07:30 devstack sudo[92976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:07:31 devstack sudo[92976]: pam_unix(sudo:session): session closed for user root
Nov 06 17:07:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-19680c9b-b504-443f-883a-3a7762d35b57 tempest-GroupSnapshotsV319Test-1140526698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72 1073741824" returned: 0 in 1.182s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:07:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-19680c9b-b504-443f-883a-3a7762d35b57 tempest-GroupSnapshotsV319Test-1140526698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:07:31 devstack sudo[93003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72
Nov 06 17:07:31 devstack sudo[93003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:07:32 devstack sudo[93003]: pam_unix(sudo:session): session closed for user root
Nov 06 17:07:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-19680c9b-b504-443f-883a-3a7762d35b57 tempest-GroupSnapshotsV319Test-1140526698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72" returned: 0 in 0.495s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:07:32 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-19680c9b-b504-443f-883a-3a7762d35b57 tempest-GroupSnapshotsV319Test-1140526698 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:07:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-19680c9b-b504-443f-883a-3a7762d35b57 tempest-GroupSnapshotsV319Test-1140526698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.782s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:07:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-19680c9b-b504-443f-883a-3a7762d35b57 tempest-GroupSnapshotsV319Test-1140526698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (253f1af5-7565-4900-96b6-faab9eab04bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:07:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-19680c9b-b504-443f-883a-3a7762d35b57 tempest-GroupSnapshotsV319Test-1140526698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8562bc2b-c13d-4d2a-9fb4-90fd9824e8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:07:32 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-19680c9b-b504-443f-883a-3a7762d35b57 tempest-GroupSnapshotsV319Test-1140526698 None] Volume volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72 (726d4ee6-c11d-4d2b-84eb-87780cff2f72): created successfully
Nov 06 17:07:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-19680c9b-b504-443f-883a-3a7762d35b57 tempest-GroupSnapshotsV319Test-1140526698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8562bc2b-c13d-4d2a-9fb4-90fd9824e8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:07:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-19680c9b-b504-443f-883a-3a7762d35b57 tempest-GroupSnapshotsV319Test-1140526698 None] Flow 'volume_create_manager' (e2e31549-8685-4f35-b901-76244ad0dc0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:07:32 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-19680c9b-b504-443f-883a-3a7762d35b57 tempest-GroupSnapshotsV319Test-1140526698 None] Created volume successfully.
Nov 06 17:07:33 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-cf3e66e8-da44-4dd9-b068-8e31e2736f19 tempest-GroupSnapshotsV319Test-1140526698 None] GroupSnapshot fee2b9bf-dd1a-41fd-b8f8-f1e18e441ad5: creating.
Nov 06 17:07:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cf3e66e8-da44-4dd9-b068-8e31e2736f19 tempest-GroupSnapshotsV319Test-1140526698 None] Group snapshot fee2b9bf-dd1a-41fd-b8f8-f1e18e441ad5: creating. {{(pid=86856) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 06 17:07:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-cf3e66e8-da44-4dd9-b068-8e31e2736f19 tempest-GroupSnapshotsV319Test-1140526698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:07:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-cf3e66e8-da44-4dd9-b068-8e31e2736f19 tempest-GroupSnapshotsV319Test-1140526698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:07:33 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-cf3e66e8-da44-4dd9-b068-8e31e2736f19 tempest-GroupSnapshotsV319Test-1140526698 None] Creating offline snapshot a57da39f-4f06-483b-85d7-32fa70e5dd14 of volume 726d4ee6-c11d-4d2b-84eb-87780cff2f72 {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:07:33 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e731d6-9229-40a5-b9c1-1ed512d877c4]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:07:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cf3e66e8-da44-4dd9-b068-8e31e2736f19 tempest-GroupSnapshotsV319Test-1140526698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:07:34 devstack sudo[93024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72
Nov 06 17:07:34 devstack sudo[93024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:07:34 devstack sudo[93024]: pam_unix(sudo:session): session closed for user root
Nov 06 17:07:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cf3e66e8-da44-4dd9-b068-8e31e2736f19 tempest-GroupSnapshotsV319Test-1140526698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72" returned: 0 in 0.432s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:07:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cf3e66e8-da44-4dd9-b068-8e31e2736f19 tempest-GroupSnapshotsV319Test-1140526698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72.a57da39f-4f06-483b-85d7-32fa70e5dd14 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:07:34 devstack sudo[93055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72.a57da39f-4f06-483b-85d7-32fa70e5dd14 1G
Nov 06 17:07:34 devstack sudo[93055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:07:34 devstack sudo[93055]: pam_unix(sudo:session): session closed for user root
Nov 06 17:07:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cf3e66e8-da44-4dd9-b068-8e31e2736f19 tempest-GroupSnapshotsV319Test-1140526698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72.a57da39f-4f06-483b-85d7-32fa70e5dd14 1G" returned: 0 in 0.427s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:07:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cf3e66e8-da44-4dd9-b068-8e31e2736f19 tempest-GroupSnapshotsV319Test-1140526698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72.a57da39f-4f06-483b-85d7-32fa70e5dd14 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:07:34 devstack sudo[93061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72.a57da39f-4f06-483b-85d7-32fa70e5dd14
Nov 06 17:07:34 devstack sudo[93061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:07:35 devstack sudo[93061]: pam_unix(sudo:session): session closed for user root
Nov 06 17:07:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cf3e66e8-da44-4dd9-b068-8e31e2736f19 tempest-GroupSnapshotsV319Test-1140526698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72.a57da39f-4f06-483b-85d7-32fa70e5dd14" returned: 0 in 0.302s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:07:35 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-cf3e66e8-da44-4dd9-b068-8e31e2736f19 tempest-GroupSnapshotsV319Test-1140526698 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72.a57da39f-4f06-483b-85d7-32fa70e5dd14 is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 17:07:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cf3e66e8-da44-4dd9-b068-8e31e2736f19 tempest-GroupSnapshotsV319Test-1140526698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72.a57da39f-4f06-483b-85d7-32fa70e5dd14 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:07:35 devstack sudo[93066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72.a57da39f-4f06-483b-85d7-32fa70e5dd14
Nov 06 17:07:35 devstack sudo[93066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:07:35 devstack sudo[93066]: pam_unix(sudo:session): session closed for user root
Nov 06 17:07:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cf3e66e8-da44-4dd9-b068-8e31e2736f19 tempest-GroupSnapshotsV319Test-1140526698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72.a57da39f-4f06-483b-85d7-32fa70e5dd14" returned: 0 in 0.322s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:07:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cf3e66e8-da44-4dd9-b068-8e31e2736f19 tempest-GroupSnapshotsV319Test-1140526698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:07:35 devstack sudo[93070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72.info
Nov 06 17:07:35 devstack sudo[93070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:07:35 devstack sudo[93070]: pam_unix(sudo:session): session closed for user root
Nov 06 17:07:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cf3e66e8-da44-4dd9-b068-8e31e2736f19 tempest-GroupSnapshotsV319Test-1140526698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72.info" returned: 0 in 0.334s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:07:35 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-cf3e66e8-da44-4dd9-b068-8e31e2736f19 tempest-GroupSnapshotsV319Test-1140526698 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 17:07:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cf3e66e8-da44-4dd9-b068-8e31e2736f19 tempest-GroupSnapshotsV319Test-1140526698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:07:35 devstack sudo[93073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72.info
Nov 06 17:07:35 devstack sudo[93073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:07:35 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-78e25057-98f8-4df2-881f-695ba0b7ac35 tempest-ServerRescueNegativeTestJSON-1976205692 None] Acquiring lock "cinder-c2e02d68-8876-42b3-8c1a-fbdfd0880273-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:07:35 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-78e25057-98f8-4df2-881f-695ba0b7ac35 tempest-ServerRescueNegativeTestJSON-1976205692 None] Lock "cinder-c2e02d68-8876-42b3-8c1a-fbdfd0880273-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:07:36 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-78e25057-98f8-4df2-881f-695ba0b7ac35 tempest-ServerRescueNegativeTestJSON-1976205692 None] Acquiring lock "cinder-quobyte-c2e02d68-8876-42b3-8c1a-fbdfd0880273" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:07:36 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-78e25057-98f8-4df2-881f-695ba0b7ac35 tempest-ServerRescueNegativeTestJSON-1976205692 None] Lock "cinder-quobyte-c2e02d68-8876-42b3-8c1a-fbdfd0880273" acquired by "delete_volume" :: waited 0.022s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:07:36 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[263584f3-965d-45d9-83d8-48f58ec20470]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:07:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-78e25057-98f8-4df2-881f-695ba0b7ac35 tempest-ServerRescueNegativeTestJSON-1976205692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c2e02d68-8876-42b3-8c1a-fbdfd0880273 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:07:36 devstack sudo[93073]: pam_unix(sudo:session): session closed for user root
Nov 06 17:07:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cf3e66e8-da44-4dd9-b068-8e31e2736f19 tempest-GroupSnapshotsV319Test-1140526698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72.info" returned: 0 in 0.454s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:07:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-cf3e66e8-da44-4dd9-b068-8e31e2736f19 tempest-GroupSnapshotsV319Test-1140526698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.402s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:07:36 devstack sudo[93076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c2e02d68-8876-42b3-8c1a-fbdfd0880273
Nov 06 17:07:36 devstack sudo[93076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:07:36 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-cf3e66e8-da44-4dd9-b068-8e31e2736f19 tempest-GroupSnapshotsV319Test-1140526698 None] group_snapshot fee2b9bf-dd1a-41fd-b8f8-f1e18e441ad5: created successfully
Nov 06 17:07:36 devstack sudo[93076]: pam_unix(sudo:session): session closed for user root
Nov 06 17:07:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-78e25057-98f8-4df2-881f-695ba0b7ac35 tempest-ServerRescueNegativeTestJSON-1976205692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c2e02d68-8876-42b3-8c1a-fbdfd0880273" returned: 0 in 0.627s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:07:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-78e25057-98f8-4df2-881f-695ba0b7ac35 tempest-ServerRescueNegativeTestJSON-1976205692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c2e02d68-8876-42b3-8c1a-fbdfd0880273 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:07:36 devstack sudo[93090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c2e02d68-8876-42b3-8c1a-fbdfd0880273
Nov 06 17:07:36 devstack sudo[93090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:07:37 devstack sudo[93090]: pam_unix(sudo:session): session closed for user root
Nov 06 17:07:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-78e25057-98f8-4df2-881f-695ba0b7ac35 tempest-ServerRescueNegativeTestJSON-1976205692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c2e02d68-8876-42b3-8c1a-fbdfd0880273" returned: 0 in 0.499s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:07:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-78e25057-98f8-4df2-881f-695ba0b7ac35 tempest-ServerRescueNegativeTestJSON-1976205692 None] Lock "cinder-quobyte-c2e02d68-8876-42b3-8c1a-fbdfd0880273" released by "delete_volume" :: held 1.237s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:07:37 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-78e25057-98f8-4df2-881f-695ba0b7ac35 tempest-ServerRescueNegativeTestJSON-1976205692 None] Created reservations ['44910772-da76-4621-92c3-5f7aaafeb86d', '01c4c045-a3de-4d3c-9c83-268cc99dc738', '35c2029d-c89e-4468-85fe-c67e02f70851', '69ff616c-bb48-4471-9f2f-673a6be12cbf'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:07:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-78e25057-98f8-4df2-881f-695ba0b7ac35 tempest-ServerRescueNegativeTestJSON-1976205692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:07:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-78e25057-98f8-4df2-881f-695ba0b7ac35 tempest-ServerRescueNegativeTestJSON-1976205692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:07:37 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-78e25057-98f8-4df2-881f-695ba0b7ac35 tempest-ServerRescueNegativeTestJSON-1976205692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:07:37 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-78e25057-98f8-4df2-881f-695ba0b7ac35 tempest-ServerRescueNegativeTestJSON-1976205692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:07:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-78e25057-98f8-4df2-881f-695ba0b7ac35 tempest-ServerRescueNegativeTestJSON-1976205692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:07:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-78e25057-98f8-4df2-881f-695ba0b7ac35 tempest-ServerRescueNegativeTestJSON-1976205692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:07:37 devstack sudo[93132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:07:37 devstack sudo[93132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:07:38 devstack sudo[93132]: pam_unix(sudo:session): session closed for user root
Nov 06 17:07:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-78e25057-98f8-4df2-881f-695ba0b7ac35 tempest-ServerRescueNegativeTestJSON-1976205692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.647s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:07:38 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-78e25057-98f8-4df2-881f-695ba0b7ac35 tempest-ServerRescueNegativeTestJSON-1976205692 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:07:38 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-78e25057-98f8-4df2-881f-695ba0b7ac35 tempest-ServerRescueNegativeTestJSON-1976205692 None] Deleted volume successfully.
Nov 06 17:07:38 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-78e25057-98f8-4df2-881f-695ba0b7ac35 tempest-ServerRescueNegativeTestJSON-1976205692 None] Lock "cinder-c2e02d68-8876-42b3-8c1a-fbdfd0880273-delete_volume" released by "delete_volume" :: held 2.406s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:07:38 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-14187921-9bdb-4bb3-9485-c5f44b96b5d2 tempest-GroupSnapshotsV319Test-1140526698 None] group_snapshot fee2b9bf-dd1a-41fd-b8f8-f1e18e441ad5: deleting
Nov 06 17:07:38 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-14187921-9bdb-4bb3-9485-c5f44b96b5d2 tempest-GroupSnapshotsV319Test-1140526698 None] group_snapshot fee2b9bf-dd1a-41fd-b8f8-f1e18e441ad5: deleting {{(pid=86856) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 06 17:07:38 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-14187921-9bdb-4bb3-9485-c5f44b96b5d2 tempest-GroupSnapshotsV319Test-1140526698 None] Acquiring lock "cinder-quobyte-726d4ee6-c11d-4d2b-84eb-87780cff2f72" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:07:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-14187921-9bdb-4bb3-9485-c5f44b96b5d2 tempest-GroupSnapshotsV319Test-1140526698 None] Lock "cinder-quobyte-726d4ee6-c11d-4d2b-84eb-87780cff2f72" acquired by "delete_snapshot" :: waited 0.097s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:07:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-14187921-9bdb-4bb3-9485-c5f44b96b5d2 tempest-GroupSnapshotsV319Test-1140526698 None] Acquiring lock "cinder-quobyte-a57da39f-4f06-483b-85d7-32fa70e5dd14" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:07:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-14187921-9bdb-4bb3-9485-c5f44b96b5d2 tempest-GroupSnapshotsV319Test-1140526698 None] Lock "cinder-quobyte-a57da39f-4f06-483b-85d7-32fa70e5dd14" acquired by "_delete_snapshot" :: waited 0.077s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:07:39 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-14187921-9bdb-4bb3-9485-c5f44b96b5d2 tempest-GroupSnapshotsV319Test-1140526698 None] Deleting offline snapshot a57da39f-4f06-483b-85d7-32fa70e5dd14 of volume 726d4ee6-c11d-4d2b-84eb-87780cff2f72 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:07:39 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-14187921-9bdb-4bb3-9485-c5f44b96b5d2 tempest-GroupSnapshotsV319Test-1140526698 None] snapshot_file for this snap is: volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72.a57da39f-4f06-483b-85d7-32fa70e5dd14 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:07:39 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd6adfa-e2d9-4c46-b162-823d512343b9]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:07:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-14187921-9bdb-4bb3-9485-c5f44b96b5d2 tempest-GroupSnapshotsV319Test-1140526698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72.a57da39f-4f06-483b-85d7-32fa70e5dd14 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:07:39 devstack sudo[93162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72.a57da39f-4f06-483b-85d7-32fa70e5dd14
Nov 06 17:07:39 devstack sudo[93162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:07:40 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ab319ef4-5083-4409-b972-fd1bb7015d7f tempest-TaggedAttachmentsTest-1362406288 None] Acquiring lock "cinder-cf2b6238-ab33-496b-b332-4483baefdc4b-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:07:40 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ab319ef4-5083-4409-b972-fd1bb7015d7f tempest-TaggedAttachmentsTest-1362406288 None] Lock "cinder-cf2b6238-ab33-496b-b332-4483baefdc4b-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:07:40 devstack sudo[93162]: pam_unix(sudo:session): session closed for user root
Nov 06 17:07:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-14187921-9bdb-4bb3-9485-c5f44b96b5d2 tempest-GroupSnapshotsV319Test-1140526698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72.a57da39f-4f06-483b-85d7-32fa70e5dd14" returned: 0 in 0.873s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:07:40 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-14187921-9bdb-4bb3-9485-c5f44b96b5d2 tempest-GroupSnapshotsV319Test-1140526698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:07:40 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[690efa8f-60f8-47f0-ae62-751f06a142a4]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:07:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-14187921-9bdb-4bb3-9485-c5f44b96b5d2 tempest-GroupSnapshotsV319Test-1140526698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:07:40 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ab319ef4-5083-4409-b972-fd1bb7015d7f tempest-TaggedAttachmentsTest-1362406288 None] Acquiring lock "cinder-quobyte-cf2b6238-ab33-496b-b332-4483baefdc4b" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:07:40 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ab319ef4-5083-4409-b972-fd1bb7015d7f tempest-TaggedAttachmentsTest-1362406288 None] Lock "cinder-quobyte-cf2b6238-ab33-496b-b332-4483baefdc4b" acquired by "delete_volume" :: waited 0.045s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:07:40 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef6ab9c-d712-45f0-8b7b-6b88d0092613]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:07:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab319ef4-5083-4409-b972-fd1bb7015d7f tempest-TaggedAttachmentsTest-1362406288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cf2b6238-ab33-496b-b332-4483baefdc4b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:07:40 devstack sudo[93188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72
Nov 06 17:07:40 devstack sudo[93188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:07:40 devstack sudo[93191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cf2b6238-ab33-496b-b332-4483baefdc4b
Nov 06 17:07:40 devstack sudo[93191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:07:41 devstack sudo[93191]: pam_unix(sudo:session): session closed for user root
Nov 06 17:07:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab319ef4-5083-4409-b972-fd1bb7015d7f tempest-TaggedAttachmentsTest-1362406288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cf2b6238-ab33-496b-b332-4483baefdc4b" returned: 0 in 0.721s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:07:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab319ef4-5083-4409-b972-fd1bb7015d7f tempest-TaggedAttachmentsTest-1362406288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cf2b6238-ab33-496b-b332-4483baefdc4b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:07:41 devstack sudo[93188]: pam_unix(sudo:session): session closed for user root
Nov 06 17:07:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-14187921-9bdb-4bb3-9485-c5f44b96b5d2 tempest-GroupSnapshotsV319Test-1140526698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72" returned: 0 in 0.956s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:07:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-14187921-9bdb-4bb3-9485-c5f44b96b5d2 tempest-GroupSnapshotsV319Test-1140526698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72.a57da39f-4f06-483b-85d7-32fa70e5dd14 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:07:41 devstack sudo[93201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cf2b6238-ab33-496b-b332-4483baefdc4b
Nov 06 17:07:41 devstack sudo[93201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:07:41 devstack sudo[93202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72.a57da39f-4f06-483b-85d7-32fa70e5dd14
Nov 06 17:07:41 devstack sudo[93202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:07:41 devstack sudo[93201]: pam_unix(sudo:session): session closed for user root
Nov 06 17:07:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab319ef4-5083-4409-b972-fd1bb7015d7f tempest-TaggedAttachmentsTest-1362406288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cf2b6238-ab33-496b-b332-4483baefdc4b" returned: 0 in 0.655s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ab319ef4-5083-4409-b972-fd1bb7015d7f tempest-TaggedAttachmentsTest-1362406288 None] Lock "cinder-quobyte-cf2b6238-ab33-496b-b332-4483baefdc4b" released by "delete_volume" :: held 1.540s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-3144b180-51fc-4bef-a726-8168d0ff24ea tempest-AttachVolumeTestJSON-951913559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3144b180-51fc-4bef-a726-8168d0ff24ea tempest-AttachVolumeTestJSON-951913559 None] Flow 'volume_create_manager' (33db9643-8f45-4405-ac50-0949b4aafa53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3144b180-51fc-4bef-a726-8168d0ff24ea tempest-AttachVolumeTestJSON-951913559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27fda3e3-006f-46e4-8145-9f37a94e0544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3144b180-51fc-4bef-a726-8168d0ff24ea tempest-AttachVolumeTestJSON-951913559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27fda3e3-006f-46e4-8145-9f37a94e0544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-988760432',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de63f69c-a006-4b50-81c6-857f17b5ac8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='958cd8b6170a4a698f40d7c517400c17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:07:42Z,use_quota=True,user_id='2af7ef660aa94c85acf5bff05ce43754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3144b180-51fc-4bef-a726-8168d0ff24ea tempest-AttachVolumeTestJSON-951913559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd1cfd2-1658-419b-b3b3-48be36f32aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3144b180-51fc-4bef-a726-8168d0ff24ea tempest-AttachVolumeTestJSON-951913559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd1cfd2-1658-419b-b3b3-48be36f32aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3144b180-51fc-4bef-a726-8168d0ff24ea tempest-AttachVolumeTestJSON-951913559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eacda7e-6eb6-42f7-802f-bf0c62863028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3144b180-51fc-4bef-a726-8168d0ff24ea tempest-AttachVolumeTestJSON-951913559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eacda7e-6eb6-42f7-802f-bf0c62863028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de63f69c-a006-4b50-81c6-857f17b5ac8f', 'volume_name': 'volume-de63f69c-a006-4b50-81c6-857f17b5ac8f', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3144b180-51fc-4bef-a726-8168d0ff24ea tempest-AttachVolumeTestJSON-951913559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a16ac4d9-50d9-4f61-9086-f5ba3819d84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:07:42 devstack sudo[93202]: pam_unix(sudo:session): session closed for user root
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3144b180-51fc-4bef-a726-8168d0ff24ea tempest-AttachVolumeTestJSON-951913559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a16ac4d9-50d9-4f61-9086-f5ba3819d84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3144b180-51fc-4bef-a726-8168d0ff24ea tempest-AttachVolumeTestJSON-951913559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98d92130-a617-458e-804a-3f5ca40cfafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:07:42 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-3144b180-51fc-4bef-a726-8168d0ff24ea tempest-AttachVolumeTestJSON-951913559 None] Volume de63f69c-a006-4b50-81c6-857f17b5ac8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de63f69c-a006-4b50-81c6-857f17b5ac8f', 'volume_size': 1}
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3144b180-51fc-4bef-a726-8168d0ff24ea tempest-AttachVolumeTestJSON-951913559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3144b180-51fc-4bef-a726-8168d0ff24ea tempest-AttachVolumeTestJSON-951913559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3144b180-51fc-4bef-a726-8168d0ff24ea tempest-AttachVolumeTestJSON-951913559 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-988760432',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de63f69c-a006-4b50-81c6-857f17b5ac8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='958cd8b6170a4a698f40d7c517400c17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:07:42Z,use_quota=True,user_id='2af7ef660aa94c85acf5bff05ce43754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-3144b180-51fc-4bef-a726-8168d0ff24ea tempest-AttachVolumeTestJSON-951913559 None] Creating volume de63f69c-a006-4b50-81c6-857f17b5ac8f {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3144b180-51fc-4bef-a726-8168d0ff24ea tempest-AttachVolumeTestJSON-951913559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3144b180-51fc-4bef-a726-8168d0ff24ea tempest-AttachVolumeTestJSON-951913559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3144b180-51fc-4bef-a726-8168d0ff24ea tempest-AttachVolumeTestJSON-951913559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3144b180-51fc-4bef-a726-8168d0ff24ea tempest-AttachVolumeTestJSON-951913559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3144b180-51fc-4bef-a726-8168d0ff24ea tempest-AttachVolumeTestJSON-951913559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3144b180-51fc-4bef-a726-8168d0ff24ea tempest-AttachVolumeTestJSON-951913559 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:07:42 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-3144b180-51fc-4bef-a726-8168d0ff24ea tempest-AttachVolumeTestJSON-951913559 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3144b180-51fc-4bef-a726-8168d0ff24ea tempest-AttachVolumeTestJSON-951913559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-de63f69c-a006-4b50-81c6-857f17b5ac8f 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-14187921-9bdb-4bb3-9485-c5f44b96b5d2 tempest-GroupSnapshotsV319Test-1140526698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72.a57da39f-4f06-483b-85d7-32fa70e5dd14" returned: 0 in 0.907s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-14187921-9bdb-4bb3-9485-c5f44b96b5d2 tempest-GroupSnapshotsV319Test-1140526698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72.a57da39f-4f06-483b-85d7-32fa70e5dd14 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:07:42 devstack sudo[93211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-de63f69c-a006-4b50-81c6-857f17b5ac8f 1073741824
Nov 06 17:07:42 devstack sudo[93211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-ab319ef4-5083-4409-b972-fd1bb7015d7f tempest-TaggedAttachmentsTest-1362406288 None] Created reservations ['acc8e840-18e6-47a9-b37d-de115cdd2fdb', '616d76c3-d149-4231-b96b-3d2e71bc8d66', 'a6a5a93f-6f59-411b-94b9-48e550d5f80b', 'dc2b7fb4-8e28-498c-9c2f-841f0bbdaa35'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:07:42 devstack sudo[93212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72.a57da39f-4f06-483b-85d7-32fa70e5dd14
Nov 06 17:07:42 devstack sudo[93212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ab319ef4-5083-4409-b972-fd1bb7015d7f tempest-TaggedAttachmentsTest-1362406288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ab319ef4-5083-4409-b972-fd1bb7015d7f tempest-TaggedAttachmentsTest-1362406288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ab319ef4-5083-4409-b972-fd1bb7015d7f tempest-TaggedAttachmentsTest-1362406288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ab319ef4-5083-4409-b972-fd1bb7015d7f tempest-TaggedAttachmentsTest-1362406288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ab319ef4-5083-4409-b972-fd1bb7015d7f tempest-TaggedAttachmentsTest-1362406288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab319ef4-5083-4409-b972-fd1bb7015d7f tempest-TaggedAttachmentsTest-1362406288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:07:42 devstack sudo[93215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:07:42 devstack sudo[93215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:07:42 devstack sudo[93217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:07:42 devstack sudo[93217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:07:42 devstack sudo[93215]: pam_unix(sudo:session): session closed for user root
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab319ef4-5083-4409-b972-fd1bb7015d7f tempest-TaggedAttachmentsTest-1362406288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.532s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:07:42 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-ab319ef4-5083-4409-b972-fd1bb7015d7f tempest-TaggedAttachmentsTest-1362406288 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:07:43 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-ab319ef4-5083-4409-b972-fd1bb7015d7f tempest-TaggedAttachmentsTest-1362406288 None] Deleted volume successfully.
Nov 06 17:07:43 devstack sudo[93212]: pam_unix(sudo:session): session closed for user root
Nov 06 17:07:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-14187921-9bdb-4bb3-9485-c5f44b96b5d2 tempest-GroupSnapshotsV319Test-1140526698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72.a57da39f-4f06-483b-85d7-32fa70e5dd14" returned: 0 in 0.741s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:07:43 devstack sudo[93217]: pam_unix(sudo:session): session closed for user root
Nov 06 17:07:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.596s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:07:43 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:07:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-14187921-9bdb-4bb3-9485-c5f44b96b5d2 tempest-GroupSnapshotsV319Test-1140526698 None] Lock "cinder-quobyte-a57da39f-4f06-483b-85d7-32fa70e5dd14" released by "_delete_snapshot" :: held 3.977s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:07:43 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager._thread_info {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:07:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread count: 28 {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 17:07:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread info: [<_MainThread(MainThread, started 125183137599616)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125183027608256)>, <Thread(Thread-3 (stat_writer), started daemon 125183025243776)>, <Thread(Rabbit-heartbeat, started daemon 125183023512896)>, <Thread(Thread-5 (_runner), started daemon 125183023357120)>, <Thread(Thread-7 (_runner), started daemon 125183021306496)>, <Thread(fd_logger, started daemon 125183018711616)>, <Thread(privsep_reader, started daemon 125183017484224)>, <Thread(tpool_thread_0, started daemon 125183013742272)>, <Thread(tpool_thread_1, started daemon 125183005349568)>, <Thread(tpool_thread_2, started daemon 125182996956864)>, <Thread(tpool_thread_3, started daemon 125182988564160)>, <Thread(tpool_thread_4, started daemon 125182980171456)>, <Thread(tpool_thread_5, started daemon 125182971778752)>, <Thread(tpool_thread_6, started daemon 125182963386048)>, <Thread(tpool_thread_7, started daemon 125182954993344)>, <Thread(tpool_thread_8, started daemon 125182946600640)>, <Thread(tpool_thread_9, started daemon 125182938207936)>, <Thread(tpool_thread_10, started daemon 125182929815232)>, <Thread(tpool_thread_11, started daemon 125182921422528)>, <Thread(tpool_thread_12, started daemon 125182913013440)>, <Thread(tpool_thread_13, started daemon 125182904604352)>, <Thread(tpool_thread_14, started daemon 125182896195264)>, <Thread(tpool_thread_15, started daemon 125182887786176)>, <Thread(tpool_thread_16, started daemon 125182879377088)>, <Thread(tpool_thread_17, started daemon 125182870968000)>, <Thread(tpool_thread_18, started daemon 125182862558912)>, <Thread(tpool_thread_19, started daemon 125182854149824)>] {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 17:07:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-14187921-9bdb-4bb3-9485-c5f44b96b5d2 tempest-GroupSnapshotsV319Test-1140526698 None] Lock "cinder-quobyte-726d4ee6-c11d-4d2b-84eb-87780cff2f72" released by "delete_snapshot" :: held 4.100s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:07:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ab319ef4-5083-4409-b972-fd1bb7015d7f tempest-TaggedAttachmentsTest-1362406288 None] Lock "cinder-cf2b6238-ab33-496b-b332-4483baefdc4b-delete_volume" released by "delete_volume" :: held 2.926s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:07:43 devstack sudo[93211]: pam_unix(sudo:session): session closed for user root
Nov 06 17:07:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3144b180-51fc-4bef-a726-8168d0ff24ea tempest-AttachVolumeTestJSON-951913559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-de63f69c-a006-4b50-81c6-857f17b5ac8f 1073741824" returned: 0 in 0.907s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:07:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3144b180-51fc-4bef-a726-8168d0ff24ea tempest-AttachVolumeTestJSON-951913559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-de63f69c-a006-4b50-81c6-857f17b5ac8f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:07:43 devstack sudo[93226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-de63f69c-a006-4b50-81c6-857f17b5ac8f
Nov 06 17:07:43 devstack sudo[93226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:07:43 devstack cinder-volume[86856]: WARNING cinder.quota [None req-14187921-9bdb-4bb3-9485-c5f44b96b5d2 tempest-GroupSnapshotsV319Test-1140526698 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1018789000 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1018789000, it is now deprecated. Please use the default quota class for default quota.
Nov 06 17:07:43 devstack cinder-volume[86856]: WARNING cinder.quota [None req-14187921-9bdb-4bb3-9485-c5f44b96b5d2 tempest-GroupSnapshotsV319Test-1140526698 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1018789000 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1018789000, it is now deprecated. Please use the default quota class for default quota.
Nov 06 17:07:43 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-14187921-9bdb-4bb3-9485-c5f44b96b5d2 tempest-GroupSnapshotsV319Test-1140526698 None] Created reservations ['c75c53d7-7046-4f96-8b62-1bd0e94ddab7', '2ccfeac2-6241-4306-844a-a60ac05a3de2', '99fd1221-3b88-4483-96b6-90abfbc2e728', 'a5132882-28dd-43e3-9938-fdcfaf036306'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:07:43 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-14187921-9bdb-4bb3-9485-c5f44b96b5d2 tempest-GroupSnapshotsV319Test-1140526698 None] group_snapshot fee2b9bf-dd1a-41fd-b8f8-f1e18e441ad5: deleted successfully
Nov 06 17:07:43 devstack sudo[93226]: pam_unix(sudo:session): session closed for user root
Nov 06 17:07:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3144b180-51fc-4bef-a726-8168d0ff24ea tempest-AttachVolumeTestJSON-951913559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-de63f69c-a006-4b50-81c6-857f17b5ac8f" returned: 0 in 0.400s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:07:43 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3144b180-51fc-4bef-a726-8168d0ff24ea tempest-AttachVolumeTestJSON-951913559 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:07:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3144b180-51fc-4bef-a726-8168d0ff24ea tempest-AttachVolumeTestJSON-951913559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.391s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:07:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3144b180-51fc-4bef-a726-8168d0ff24ea tempest-AttachVolumeTestJSON-951913559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98d92130-a617-458e-804a-3f5ca40cfafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de63f69c-a006-4b50-81c6-857f17b5ac8f', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:07:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3144b180-51fc-4bef-a726-8168d0ff24ea tempest-AttachVolumeTestJSON-951913559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb714b42-2fb9-4d9a-9a98-87b0dda66071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:07:43 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-3144b180-51fc-4bef-a726-8168d0ff24ea tempest-AttachVolumeTestJSON-951913559 None] Volume volume-de63f69c-a006-4b50-81c6-857f17b5ac8f (de63f69c-a006-4b50-81c6-857f17b5ac8f): created successfully
Nov 06 17:07:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3144b180-51fc-4bef-a726-8168d0ff24ea tempest-AttachVolumeTestJSON-951913559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb714b42-2fb9-4d9a-9a98-87b0dda66071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:07:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3144b180-51fc-4bef-a726-8168d0ff24ea tempest-AttachVolumeTestJSON-951913559 None] Flow 'volume_create_manager' (33db9643-8f45-4405-ac50-0949b4aafa53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:07:43 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-3144b180-51fc-4bef-a726-8168d0ff24ea tempest-AttachVolumeTestJSON-951913559 None] Created volume successfully.
Nov 06 17:07:44 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1deee3e5-93cc-4018-82a4-5782ece97062 tempest-GroupSnapshotsV319Test-1140526698 None] Acquiring lock "cinder-quobyte-726d4ee6-c11d-4d2b-84eb-87780cff2f72" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:07:44 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1deee3e5-93cc-4018-82a4-5782ece97062 tempest-GroupSnapshotsV319Test-1140526698 None] Lock "cinder-quobyte-726d4ee6-c11d-4d2b-84eb-87780cff2f72" acquired by "delete_volume" :: waited 0.046s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:07:44 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd1a4dd-f9ed-49dd-9a20-1fea4c122efc]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:07:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1deee3e5-93cc-4018-82a4-5782ece97062 tempest-GroupSnapshotsV319Test-1140526698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:07:44 devstack sudo[93259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72
Nov 06 17:07:44 devstack sudo[93259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:07:45 devstack sudo[93259]: pam_unix(sudo:session): session closed for user root
Nov 06 17:07:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1deee3e5-93cc-4018-82a4-5782ece97062 tempest-GroupSnapshotsV319Test-1140526698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72" returned: 0 in 0.594s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:07:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1deee3e5-93cc-4018-82a4-5782ece97062 tempest-GroupSnapshotsV319Test-1140526698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:07:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-ac61cac2-52c7-49b6-b199-6080451c7a35 req-90bf39cc-0d94-4269-85c9-c165d1117baf tempest-AttachVolumeTestJSON-951913559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:07:45 devstack sudo[93273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72
Nov 06 17:07:45 devstack sudo[93273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:07:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-ac61cac2-52c7-49b6-b199-6080451c7a35 req-90bf39cc-0d94-4269-85c9-c165d1117baf tempest-AttachVolumeTestJSON-951913559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:07:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-ac61cac2-52c7-49b6-b199-6080451c7a35 req-90bf39cc-0d94-4269-85c9-c165d1117baf tempest-AttachVolumeTestJSON-951913559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:07:45 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-ac61cac2-52c7-49b6-b199-6080451c7a35 req-90bf39cc-0d94-4269-85c9-c165d1117baf tempest-AttachVolumeTestJSON-951913559 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316', 'name': 'volume-de63f69c-a006-4b50-81c6-857f17b5ac8f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fe1ab93a-c188-49b0-8900-d70e6a0c77ef', 'enforce_multipath': True} {{(pid=86856) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 17:07:45 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-ac61cac2-52c7-49b6-b199-6080451c7a35 req-90bf39cc-0d94-4269-85c9-c165d1117baf tempest-AttachVolumeTestJSON-951913559 None] attachment_update completed successfully.
Nov 06 17:07:45 devstack sudo[93273]: pam_unix(sudo:session): session closed for user root
Nov 06 17:07:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1deee3e5-93cc-4018-82a4-5782ece97062 tempest-GroupSnapshotsV319Test-1140526698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726d4ee6-c11d-4d2b-84eb-87780cff2f72" returned: 0 in 0.460s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:07:45 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1deee3e5-93cc-4018-82a4-5782ece97062 tempest-GroupSnapshotsV319Test-1140526698 None] Lock "cinder-quobyte-726d4ee6-c11d-4d2b-84eb-87780cff2f72" released by "delete_volume" :: held 1.211s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:07:45 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-1deee3e5-93cc-4018-82a4-5782ece97062 tempest-GroupSnapshotsV319Test-1140526698 None] Created reservations ['076a44b7-793e-47f6-8695-af7017db3dc3'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:07:45 devstack cinder-volume[86856]: WARNING cinder.quota [None req-1deee3e5-93cc-4018-82a4-5782ece97062 tempest-GroupSnapshotsV319Test-1140526698 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1018789000 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1018789000, it is now deprecated. Please use the default quota class for default quota.
Nov 06 17:07:45 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-1deee3e5-93cc-4018-82a4-5782ece97062 tempest-GroupSnapshotsV319Test-1140526698 None] Created reservations ['507ba9be-7a5b-4a55-b14a-c00a06f5c060', '7405db89-1c88-4102-8d9f-c944d138f61e', '5d633881-69ba-4aa0-bdb0-d0bce42c4689', '80630ac8-ccae-487c-b691-f6dd19ddf243'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:07:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1deee3e5-93cc-4018-82a4-5782ece97062 tempest-GroupSnapshotsV319Test-1140526698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:07:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1deee3e5-93cc-4018-82a4-5782ece97062 tempest-GroupSnapshotsV319Test-1140526698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:07:46 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1deee3e5-93cc-4018-82a4-5782ece97062 tempest-GroupSnapshotsV319Test-1140526698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:07:46 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1deee3e5-93cc-4018-82a4-5782ece97062 tempest-GroupSnapshotsV319Test-1140526698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:07:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1deee3e5-93cc-4018-82a4-5782ece97062 tempest-GroupSnapshotsV319Test-1140526698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:07:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1deee3e5-93cc-4018-82a4-5782ece97062 tempest-GroupSnapshotsV319Test-1140526698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:07:46 devstack sudo[93692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:07:46 devstack sudo[93692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:07:46 devstack sudo[93692]: pam_unix(sudo:session): session closed for user root
Nov 06 17:07:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1deee3e5-93cc-4018-82a4-5782ece97062 tempest-GroupSnapshotsV319Test-1140526698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.317s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:07:46 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-1deee3e5-93cc-4018-82a4-5782ece97062 tempest-GroupSnapshotsV319Test-1140526698 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:07:46 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-1deee3e5-93cc-4018-82a4-5782ece97062 tempest-GroupSnapshotsV319Test-1140526698 None] Delete group completed successfully.
Nov 06 17:07:48 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-22ddf283-20a1-489e-9939-2d160d739c49 tempest-AttachVolumeTestJSON-951913559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:07:48 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-22ddf283-20a1-489e-9939-2d160d739c49 tempest-AttachVolumeTestJSON-951913559 None] Flow 'volume_create_manager' (0830c7a0-71f9-4894-a0f0-6e1257217f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:07:48 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-22ddf283-20a1-489e-9939-2d160d739c49 tempest-AttachVolumeTestJSON-951913559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45709c4c-dd66-4825-a5ac-e367a7fe7215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:07:48 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-22ddf283-20a1-489e-9939-2d160d739c49 tempest-AttachVolumeTestJSON-951913559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45709c4c-dd66-4825-a5ac-e367a7fe7215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-178214136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ae113b8-f311-41d3-a745-85e2e9a055c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='958cd8b6170a4a698f40d7c517400c17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:07:48Z,use_quota=True,user_id='2af7ef660aa94c85acf5bff05ce43754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:07:48 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-22ddf283-20a1-489e-9939-2d160d739c49 tempest-AttachVolumeTestJSON-951913559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bba0548-03a2-4251-b966-a55bc21bae86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:07:48 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-22ddf283-20a1-489e-9939-2d160d739c49 tempest-AttachVolumeTestJSON-951913559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bba0548-03a2-4251-b966-a55bc21bae86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:07:48 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-22ddf283-20a1-489e-9939-2d160d739c49 tempest-AttachVolumeTestJSON-951913559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76065e85-1578-4576-b871-2ed3afa5dba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:07:48 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-22ddf283-20a1-489e-9939-2d160d739c49 tempest-AttachVolumeTestJSON-951913559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76065e85-1578-4576-b871-2ed3afa5dba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ae113b8-f311-41d3-a745-85e2e9a055c0', 'volume_name': 'volume-1ae113b8-f311-41d3-a745-85e2e9a055c0', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:07:48 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-22ddf283-20a1-489e-9939-2d160d739c49 tempest-AttachVolumeTestJSON-951913559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e07aacc8-bd5b-4d1b-90a4-ac8f3d076788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:07:48 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-22ddf283-20a1-489e-9939-2d160d739c49 tempest-AttachVolumeTestJSON-951913559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e07aacc8-bd5b-4d1b-90a4-ac8f3d076788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:07:48 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-22ddf283-20a1-489e-9939-2d160d739c49 tempest-AttachVolumeTestJSON-951913559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab633e4c-ebc1-410a-ba76-bb505c6b96b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:07:48 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-22ddf283-20a1-489e-9939-2d160d739c49 tempest-AttachVolumeTestJSON-951913559 None] Volume 1ae113b8-f311-41d3-a745-85e2e9a055c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ae113b8-f311-41d3-a745-85e2e9a055c0', 'volume_size': 1}
Nov 06 17:07:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-22ddf283-20a1-489e-9939-2d160d739c49 tempest-AttachVolumeTestJSON-951913559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:07:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-22ddf283-20a1-489e-9939-2d160d739c49 tempest-AttachVolumeTestJSON-951913559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:07:48 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-22ddf283-20a1-489e-9939-2d160d739c49 tempest-AttachVolumeTestJSON-951913559 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-178214136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ae113b8-f311-41d3-a745-85e2e9a055c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='958cd8b6170a4a698f40d7c517400c17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:07:48Z,use_quota=True,user_id='2af7ef660aa94c85acf5bff05ce43754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:07:48 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-22ddf283-20a1-489e-9939-2d160d739c49 tempest-AttachVolumeTestJSON-951913559 None] Creating volume 1ae113b8-f311-41d3-a745-85e2e9a055c0 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:07:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-22ddf283-20a1-489e-9939-2d160d739c49 tempest-AttachVolumeTestJSON-951913559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:07:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-22ddf283-20a1-489e-9939-2d160d739c49 tempest-AttachVolumeTestJSON-951913559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:07:48 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-22ddf283-20a1-489e-9939-2d160d739c49 tempest-AttachVolumeTestJSON-951913559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:07:48 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-22ddf283-20a1-489e-9939-2d160d739c49 tempest-AttachVolumeTestJSON-951913559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:07:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-22ddf283-20a1-489e-9939-2d160d739c49 tempest-AttachVolumeTestJSON-951913559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:07:48 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-22ddf283-20a1-489e-9939-2d160d739c49 tempest-AttachVolumeTestJSON-951913559 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:07:48 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-22ddf283-20a1-489e-9939-2d160d739c49 tempest-AttachVolumeTestJSON-951913559 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:07:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-22ddf283-20a1-489e-9939-2d160d739c49 tempest-AttachVolumeTestJSON-951913559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1ae113b8-f311-41d3-a745-85e2e9a055c0 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:07:48 devstack sudo[93696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1ae113b8-f311-41d3-a745-85e2e9a055c0 1073741824
Nov 06 17:07:48 devstack sudo[93696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:07:48 devstack sudo[93696]: pam_unix(sudo:session): session closed for user root
Nov 06 17:07:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-22ddf283-20a1-489e-9939-2d160d739c49 tempest-AttachVolumeTestJSON-951913559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1ae113b8-f311-41d3-a745-85e2e9a055c0 1073741824" returned: 0 in 0.607s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:07:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-22ddf283-20a1-489e-9939-2d160d739c49 tempest-AttachVolumeTestJSON-951913559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1ae113b8-f311-41d3-a745-85e2e9a055c0 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:07:48 devstack sudo[93702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1ae113b8-f311-41d3-a745-85e2e9a055c0
Nov 06 17:07:48 devstack sudo[93702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:07:49 devstack sudo[93702]: pam_unix(sudo:session): session closed for user root
Nov 06 17:07:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-22ddf283-20a1-489e-9939-2d160d739c49 tempest-AttachVolumeTestJSON-951913559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1ae113b8-f311-41d3-a745-85e2e9a055c0" returned: 0 in 0.309s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:07:49 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-22ddf283-20a1-489e-9939-2d160d739c49 tempest-AttachVolumeTestJSON-951913559 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:07:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-22ddf283-20a1-489e-9939-2d160d739c49 tempest-AttachVolumeTestJSON-951913559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:07:49 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-22ddf283-20a1-489e-9939-2d160d739c49 tempest-AttachVolumeTestJSON-951913559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab633e4c-ebc1-410a-ba76-bb505c6b96b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ae113b8-f311-41d3-a745-85e2e9a055c0', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:07:49 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-22ddf283-20a1-489e-9939-2d160d739c49 tempest-AttachVolumeTestJSON-951913559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd4c97e9-1cfb-484f-87f9-c6900f19e495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:07:49 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-22ddf283-20a1-489e-9939-2d160d739c49 tempest-AttachVolumeTestJSON-951913559 None] Volume volume-1ae113b8-f311-41d3-a745-85e2e9a055c0 (1ae113b8-f311-41d3-a745-85e2e9a055c0): created successfully
Nov 06 17:07:49 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-22ddf283-20a1-489e-9939-2d160d739c49 tempest-AttachVolumeTestJSON-951913559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd4c97e9-1cfb-484f-87f9-c6900f19e495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:07:49 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-22ddf283-20a1-489e-9939-2d160d739c49 tempest-AttachVolumeTestJSON-951913559 None] Flow 'volume_create_manager' (0830c7a0-71f9-4894-a0f0-6e1257217f15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:07:49 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-22ddf283-20a1-489e-9939-2d160d739c49 tempest-AttachVolumeTestJSON-951913559 None] Created volume successfully.
Nov 06 17:07:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-5877d78a-871d-418f-aaa6-f539c7f96f66 req-78c32c88-de7c-4768-9a33-c32e70f464a9 tempest-AttachVolumeTestJSON-951913559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:07:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-5877d78a-871d-418f-aaa6-f539c7f96f66 req-78c32c88-de7c-4768-9a33-c32e70f464a9 tempest-AttachVolumeTestJSON-951913559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:07:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-5877d78a-871d-418f-aaa6-f539c7f96f66 req-78c32c88-de7c-4768-9a33-c32e70f464a9 tempest-AttachVolumeTestJSON-951913559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:07:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-5877d78a-871d-418f-aaa6-f539c7f96f66 req-78c32c88-de7c-4768-9a33-c32e70f464a9 tempest-AttachVolumeTestJSON-951913559 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316', 'name': 'volume-1ae113b8-f311-41d3-a745-85e2e9a055c0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a516d9a8-a41a-42d2-9dcf-d7cda4875aa4', 'enforce_multipath': True} {{(pid=86856) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 17:07:51 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-5877d78a-871d-418f-aaa6-f539c7f96f66 req-78c32c88-de7c-4768-9a33-c32e70f464a9 tempest-AttachVolumeTestJSON-951913559 None] attachment_update completed successfully.
Nov 06 17:07:54 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-28faa19c-7754-4cf3-a54c-cf4e0d649c0e req-1ac7953a-4cd5-4a5f-8446-958b3d4a3e3e tempest-AttachVolumeTestJSON-951913559 None] Terminate volume connection completed successfully.
Nov 06 17:07:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-28faa19c-7754-4cf3-a54c-cf4e0d649c0e req-1ac7953a-4cd5-4a5f-8446-958b3d4a3e3e tempest-AttachVolumeTestJSON-951913559 None] Deleting attachment fe1ab93a-c188-49b0-8900-d70e6a0c77ef. {{(pid=86856) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 17:07:55 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-fc599f0d-bce5-4f67-9570-d80a6a43d6b9 req-c32e2dbb-93cf-4689-8e73-f62424e32808 tempest-AttachVolumeTestJSON-951913559 None] Terminate volume connection completed successfully.
Nov 06 17:07:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-fc599f0d-bce5-4f67-9570-d80a6a43d6b9 req-c32e2dbb-93cf-4689-8e73-f62424e32808 tempest-AttachVolumeTestJSON-951913559 None] Deleting attachment a516d9a8-a41a-42d2-9dcf-d7cda4875aa4. {{(pid=86856) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 17:07:56 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-14c4a5fd-04c0-4527-b39a-1355c10c00fb tempest-GroupsTest-1593812186 None] Group tempest-Group1-1201990688: creating
Nov 06 17:07:56 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-14c4a5fd-04c0-4527-b39a-1355c10c00fb tempest-GroupsTest-1593812186 None] Group tempest-Group1-1201990688: created successfully
Nov 06 17:07:56 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-14c4a5fd-04c0-4527-b39a-1355c10c00fb tempest-GroupsTest-1593812186 None] Create group completed successfully.
Nov 06 17:07:58 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-39a9b33f-f2dd-43d4-a58b-647b57ab4be8 tempest-GroupsTest-1593812186 None] Group tempest-Group2-1631789917: creating
Nov 06 17:07:58 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-39a9b33f-f2dd-43d4-a58b-647b57ab4be8 tempest-GroupsTest-1593812186 None] Group tempest-Group2-1631789917: created successfully
Nov 06 17:07:58 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-39a9b33f-f2dd-43d4-a58b-647b57ab4be8 tempest-GroupsTest-1593812186 None] Create group completed successfully.
Nov 06 17:08:00 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca1b10b4-6f2a-482a-84d4-070105100ba7 tempest-GroupsTest-1593812186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:08:00 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ca1b10b4-6f2a-482a-84d4-070105100ba7 tempest-GroupsTest-1593812186 None] Flow 'volume_create_manager' (a36b9fcd-1973-4bb5-afb1-f1461ae8fb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:08:00 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ca1b10b4-6f2a-482a-84d4-070105100ba7 tempest-GroupsTest-1593812186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324b2f44-6f9c-4e35-b7b5-2405f18895aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:00 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ca1b10b4-6f2a-482a-84d4-070105100ba7 tempest-GroupsTest-1593812186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324b2f44-6f9c-4e35-b7b5-2405f18895aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-601611366',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b7bfbda5-7b00-4347-b13b-91afb12013bb,host='devstack@QuobyteHD#QuobyteHD',id=4973c4d1-bc9d-414f-a13d-beb7449fb66d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b3d5183e4904775bf988b6c80155730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:08:00Z,use_quota=True,user_id='2a0b40ef0b564c04b56427f80ecdda7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(554e9b2c-5eba-44bf-a91a-c7a7e085d2f9),volume_type_id=554e9b2c-5eba-44bf-a91a-c7a7e085d2f9)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:00 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ca1b10b4-6f2a-482a-84d4-070105100ba7 tempest-GroupsTest-1593812186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8948de3-43c9-43ec-a632-7629f7ed5781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:00 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ca1b10b4-6f2a-482a-84d4-070105100ba7 tempest-GroupsTest-1593812186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8948de3-43c9-43ec-a632-7629f7ed5781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:00 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ca1b10b4-6f2a-482a-84d4-070105100ba7 tempest-GroupsTest-1593812186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04cb502d-fdeb-4625-bf11-c4c504019bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:00 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ca1b10b4-6f2a-482a-84d4-070105100ba7 tempest-GroupsTest-1593812186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04cb502d-fdeb-4625-bf11-c4c504019bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4973c4d1-bc9d-414f-a13d-beb7449fb66d', 'volume_name': 'volume-4973c4d1-bc9d-414f-a13d-beb7449fb66d', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:00 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ca1b10b4-6f2a-482a-84d4-070105100ba7 tempest-GroupsTest-1593812186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd4ab4f3-d40e-439a-8ac3-9bf12b3ef353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:00 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ca1b10b4-6f2a-482a-84d4-070105100ba7 tempest-GroupsTest-1593812186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd4ab4f3-d40e-439a-8ac3-9bf12b3ef353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:00 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ca1b10b4-6f2a-482a-84d4-070105100ba7 tempest-GroupsTest-1593812186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8268783-8013-4a2d-9316-29ab68355248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:00 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-ca1b10b4-6f2a-482a-84d4-070105100ba7 tempest-GroupsTest-1593812186 None] Volume 4973c4d1-bc9d-414f-a13d-beb7449fb66d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4973c4d1-bc9d-414f-a13d-beb7449fb66d', 'volume_size': 1}
Nov 06 17:08:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ca1b10b4-6f2a-482a-84d4-070105100ba7 tempest-GroupsTest-1593812186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:08:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ca1b10b4-6f2a-482a-84d4-070105100ba7 tempest-GroupsTest-1593812186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:08:00 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ca1b10b4-6f2a-482a-84d4-070105100ba7 tempest-GroupsTest-1593812186 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b7bfbda5-7b00-4347-b13b-91afb12013bb,created_at=2026-11-06T16:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-601611366',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b7bfbda5-7b00-4347-b13b-91afb12013bb,host='devstack@QuobyteHD#QuobyteHD',id=4973c4d1-bc9d-414f-a13d-beb7449fb66d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b3d5183e4904775bf988b6c80155730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:08:00Z,use_quota=True,user_id='2a0b40ef0b564c04b56427f80ecdda7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(554e9b2c-5eba-44bf-a91a-c7a7e085d2f9),volume_type_id=554e9b2c-5eba-44bf-a91a-c7a7e085d2f9)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:08:00 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-ca1b10b4-6f2a-482a-84d4-070105100ba7 tempest-GroupsTest-1593812186 None] Creating volume 4973c4d1-bc9d-414f-a13d-beb7449fb66d {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:08:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ca1b10b4-6f2a-482a-84d4-070105100ba7 tempest-GroupsTest-1593812186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:08:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ca1b10b4-6f2a-482a-84d4-070105100ba7 tempest-GroupsTest-1593812186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:08:00 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ca1b10b4-6f2a-482a-84d4-070105100ba7 tempest-GroupsTest-1593812186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:08:00 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ca1b10b4-6f2a-482a-84d4-070105100ba7 tempest-GroupsTest-1593812186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:08:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ca1b10b4-6f2a-482a-84d4-070105100ba7 tempest-GroupsTest-1593812186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:08:00 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ca1b10b4-6f2a-482a-84d4-070105100ba7 tempest-GroupsTest-1593812186 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:08:00 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-ca1b10b4-6f2a-482a-84d4-070105100ba7 tempest-GroupsTest-1593812186 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:08:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ca1b10b4-6f2a-482a-84d4-070105100ba7 tempest-GroupsTest-1593812186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-4973c4d1-bc9d-414f-a13d-beb7449fb66d 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:00 devstack sudo[93779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-4973c4d1-bc9d-414f-a13d-beb7449fb66d 1073741824
Nov 06 17:08:00 devstack sudo[93779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:00 devstack sudo[93779]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ca1b10b4-6f2a-482a-84d4-070105100ba7 tempest-GroupsTest-1593812186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-4973c4d1-bc9d-414f-a13d-beb7449fb66d 1073741824" returned: 0 in 0.486s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ca1b10b4-6f2a-482a-84d4-070105100ba7 tempest-GroupsTest-1593812186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-4973c4d1-bc9d-414f-a13d-beb7449fb66d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:00 devstack sudo[93786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-4973c4d1-bc9d-414f-a13d-beb7449fb66d
Nov 06 17:08:00 devstack sudo[93786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:01 devstack sudo[93786]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ca1b10b4-6f2a-482a-84d4-070105100ba7 tempest-GroupsTest-1593812186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-4973c4d1-bc9d-414f-a13d-beb7449fb66d" returned: 0 in 0.274s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:01 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ca1b10b4-6f2a-482a-84d4-070105100ba7 tempest-GroupsTest-1593812186 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:08:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ca1b10b4-6f2a-482a-84d4-070105100ba7 tempest-GroupsTest-1593812186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:08:01 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ca1b10b4-6f2a-482a-84d4-070105100ba7 tempest-GroupsTest-1593812186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8268783-8013-4a2d-9316-29ab68355248) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4973c4d1-bc9d-414f-a13d-beb7449fb66d', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:01 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ca1b10b4-6f2a-482a-84d4-070105100ba7 tempest-GroupsTest-1593812186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c776ae9-f6b5-4c8c-8414-108256345c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:01 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-ca1b10b4-6f2a-482a-84d4-070105100ba7 tempest-GroupsTest-1593812186 None] Volume volume-4973c4d1-bc9d-414f-a13d-beb7449fb66d (4973c4d1-bc9d-414f-a13d-beb7449fb66d): created successfully
Nov 06 17:08:01 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ca1b10b4-6f2a-482a-84d4-070105100ba7 tempest-GroupsTest-1593812186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c776ae9-f6b5-4c8c-8414-108256345c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:01 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ca1b10b4-6f2a-482a-84d4-070105100ba7 tempest-GroupsTest-1593812186 None] Flow 'volume_create_manager' (a36b9fcd-1973-4bb5-afb1-f1461ae8fb34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:08:01 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-ca1b10b4-6f2a-482a-84d4-070105100ba7 tempest-GroupsTest-1593812186 None] Created volume successfully.
Nov 06 17:08:02 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-10650057-1768-4059-a42e-fdd8fb0fd0ad tempest-GroupsTest-1593812186 None] Acquiring lock "cinder-quobyte-4973c4d1-bc9d-414f-a13d-beb7449fb66d" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:08:02 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-10650057-1768-4059-a42e-fdd8fb0fd0ad tempest-GroupsTest-1593812186 None] Lock "cinder-quobyte-4973c4d1-bc9d-414f-a13d-beb7449fb66d" acquired by "delete_volume" :: waited 0.047s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:08:02 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[05700b0f-f0ac-4b65-9a44-6d49403b1ff5]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:08:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-10650057-1768-4059-a42e-fdd8fb0fd0ad tempest-GroupsTest-1593812186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-4973c4d1-bc9d-414f-a13d-beb7449fb66d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:02 devstack sudo[93789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-4973c4d1-bc9d-414f-a13d-beb7449fb66d
Nov 06 17:08:02 devstack sudo[93789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:03 devstack sudo[93789]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-10650057-1768-4059-a42e-fdd8fb0fd0ad tempest-GroupsTest-1593812186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-4973c4d1-bc9d-414f-a13d-beb7449fb66d" returned: 0 in 0.459s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-10650057-1768-4059-a42e-fdd8fb0fd0ad tempest-GroupsTest-1593812186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-4973c4d1-bc9d-414f-a13d-beb7449fb66d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:03 devstack sudo[93794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-4973c4d1-bc9d-414f-a13d-beb7449fb66d
Nov 06 17:08:03 devstack sudo[93794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:03 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-2efb2492-939d-44a8-99b2-f47b25eb52ae tempest-AttachVolumeTestJSON-951913559 None] Acquiring lock "cinder-1ae113b8-f311-41d3-a745-85e2e9a055c0-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:08:03 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-2efb2492-939d-44a8-99b2-f47b25eb52ae tempest-AttachVolumeTestJSON-951913559 None] Lock "cinder-1ae113b8-f311-41d3-a745-85e2e9a055c0-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:08:03 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-2efb2492-939d-44a8-99b2-f47b25eb52ae tempest-AttachVolumeTestJSON-951913559 None] Acquiring lock "cinder-quobyte-1ae113b8-f311-41d3-a745-85e2e9a055c0" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:08:03 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-2efb2492-939d-44a8-99b2-f47b25eb52ae tempest-AttachVolumeTestJSON-951913559 None] Lock "cinder-quobyte-1ae113b8-f311-41d3-a745-85e2e9a055c0" acquired by "delete_volume" :: waited 0.022s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:08:03 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cf1320-8f41-48a2-b278-3081c53256da]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:08:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2efb2492-939d-44a8-99b2-f47b25eb52ae tempest-AttachVolumeTestJSON-951913559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1ae113b8-f311-41d3-a745-85e2e9a055c0 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:03 devstack sudo[93794]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-10650057-1768-4059-a42e-fdd8fb0fd0ad tempest-GroupsTest-1593812186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-4973c4d1-bc9d-414f-a13d-beb7449fb66d" returned: 0 in 0.394s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:03 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-10650057-1768-4059-a42e-fdd8fb0fd0ad tempest-GroupsTest-1593812186 None] Lock "cinder-quobyte-4973c4d1-bc9d-414f-a13d-beb7449fb66d" released by "delete_volume" :: held 0.965s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:08:03 devstack sudo[93797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1ae113b8-f311-41d3-a745-85e2e9a055c0
Nov 06 17:08:03 devstack sudo[93797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:03 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-10650057-1768-4059-a42e-fdd8fb0fd0ad tempest-GroupsTest-1593812186 None] Created reservations ['1e35207c-6a43-475c-ab5f-bb5e6ac42e59'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:08:03 devstack cinder-volume[86856]: WARNING cinder.quota [None req-10650057-1768-4059-a42e-fdd8fb0fd0ad tempest-GroupsTest-1593812186 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-86468774 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-86468774, it is now deprecated. Please use the default quota class for default quota.
Nov 06 17:08:03 devstack cinder-volume[86856]: WARNING cinder.quota [None req-10650057-1768-4059-a42e-fdd8fb0fd0ad tempest-GroupsTest-1593812186 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-86468774 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-86468774, it is now deprecated. Please use the default quota class for default quota.
Nov 06 17:08:03 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-10650057-1768-4059-a42e-fdd8fb0fd0ad tempest-GroupsTest-1593812186 None] Created reservations ['2bd29ed1-4c4b-43fc-9e2d-3c030605374b', '02845201-905c-441f-975f-dc9d2aa406e0', 'b2e266ba-088b-4ffc-ba11-fa352e3e4bb7', '609cc1ae-6979-47cc-9437-a9608d57d921'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:08:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-10650057-1768-4059-a42e-fdd8fb0fd0ad tempest-GroupsTest-1593812186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:08:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-10650057-1768-4059-a42e-fdd8fb0fd0ad tempest-GroupsTest-1593812186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:08:04 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-10650057-1768-4059-a42e-fdd8fb0fd0ad tempest-GroupsTest-1593812186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:08:04 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-10650057-1768-4059-a42e-fdd8fb0fd0ad tempest-GroupsTest-1593812186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:08:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-10650057-1768-4059-a42e-fdd8fb0fd0ad tempest-GroupsTest-1593812186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:08:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-10650057-1768-4059-a42e-fdd8fb0fd0ad tempest-GroupsTest-1593812186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:04 devstack sudo[93797]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2efb2492-939d-44a8-99b2-f47b25eb52ae tempest-AttachVolumeTestJSON-951913559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1ae113b8-f311-41d3-a745-85e2e9a055c0" returned: 0 in 0.564s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2efb2492-939d-44a8-99b2-f47b25eb52ae tempest-AttachVolumeTestJSON-951913559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1ae113b8-f311-41d3-a745-85e2e9a055c0 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:04 devstack sudo[93802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:08:04 devstack sudo[93802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:04 devstack sudo[93803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1ae113b8-f311-41d3-a745-85e2e9a055c0
Nov 06 17:08:04 devstack sudo[93803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:04 devstack sudo[93803]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2efb2492-939d-44a8-99b2-f47b25eb52ae tempest-AttachVolumeTestJSON-951913559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1ae113b8-f311-41d3-a745-85e2e9a055c0" returned: 0 in 0.298s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:04 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-2efb2492-939d-44a8-99b2-f47b25eb52ae tempest-AttachVolumeTestJSON-951913559 None] Lock "cinder-quobyte-1ae113b8-f311-41d3-a745-85e2e9a055c0" released by "delete_volume" :: held 0.936s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:08:04 devstack sudo[93802]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-10650057-1768-4059-a42e-fdd8fb0fd0ad tempest-GroupsTest-1593812186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.374s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:04 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-10650057-1768-4059-a42e-fdd8fb0fd0ad tempest-GroupsTest-1593812186 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:08:04 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-10650057-1768-4059-a42e-fdd8fb0fd0ad tempest-GroupsTest-1593812186 None] Delete group completed successfully.
Nov 06 17:08:04 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-2efb2492-939d-44a8-99b2-f47b25eb52ae tempest-AttachVolumeTestJSON-951913559 None] Created reservations ['26023fe5-992e-40ab-a923-1abf9aee4b87', '35fe8622-0b54-478d-b696-7aba978989e8', '636a6446-667d-499d-95ae-00d58e61ed4b', '7ab0f2cd-adc6-400d-9b73-13bc9229434f'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:08:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2efb2492-939d-44a8-99b2-f47b25eb52ae tempest-AttachVolumeTestJSON-951913559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:08:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2efb2492-939d-44a8-99b2-f47b25eb52ae tempest-AttachVolumeTestJSON-951913559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:08:04 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-2efb2492-939d-44a8-99b2-f47b25eb52ae tempest-AttachVolumeTestJSON-951913559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:08:04 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-2efb2492-939d-44a8-99b2-f47b25eb52ae tempest-AttachVolumeTestJSON-951913559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:08:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2efb2492-939d-44a8-99b2-f47b25eb52ae tempest-AttachVolumeTestJSON-951913559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:08:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2efb2492-939d-44a8-99b2-f47b25eb52ae tempest-AttachVolumeTestJSON-951913559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:04 devstack sudo[93808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:08:04 devstack sudo[93808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:04 devstack sudo[93808]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2efb2492-939d-44a8-99b2-f47b25eb52ae tempest-AttachVolumeTestJSON-951913559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.264s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:04 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-2efb2492-939d-44a8-99b2-f47b25eb52ae tempest-AttachVolumeTestJSON-951913559 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:08:04 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-2efb2492-939d-44a8-99b2-f47b25eb52ae tempest-AttachVolumeTestJSON-951913559 None] Deleted volume successfully.
Nov 06 17:08:04 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-2efb2492-939d-44a8-99b2-f47b25eb52ae tempest-AttachVolumeTestJSON-951913559 None] Lock "cinder-1ae113b8-f311-41d3-a745-85e2e9a055c0-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:08:05 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-d59f194b-d4e7-49a3-9a22-a9dca6e3327d tempest-GroupsTest-1593812186 None] Created reservations ['670dc942-f736-4509-97e2-4269762c92b0'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:08:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d59f194b-d4e7-49a3-9a22-a9dca6e3327d tempest-GroupsTest-1593812186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:08:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d59f194b-d4e7-49a3-9a22-a9dca6e3327d tempest-GroupsTest-1593812186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:08:05 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d59f194b-d4e7-49a3-9a22-a9dca6e3327d tempest-GroupsTest-1593812186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:08:05 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d59f194b-d4e7-49a3-9a22-a9dca6e3327d tempest-GroupsTest-1593812186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:08:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d59f194b-d4e7-49a3-9a22-a9dca6e3327d tempest-GroupsTest-1593812186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:08:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d59f194b-d4e7-49a3-9a22-a9dca6e3327d tempest-GroupsTest-1593812186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:05 devstack sudo[93811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:08:05 devstack sudo[93811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:05 devstack sudo[93811]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d59f194b-d4e7-49a3-9a22-a9dca6e3327d tempest-GroupsTest-1593812186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.368s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:05 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-d59f194b-d4e7-49a3-9a22-a9dca6e3327d tempest-GroupsTest-1593812186 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:08:05 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e20333fc-1994-4783-b097-f62c4ae940f5 tempest-AttachVolumeTestJSON-951913559 None] Acquiring lock "cinder-de63f69c-a006-4b50-81c6-857f17b5ac8f-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:08:05 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-d59f194b-d4e7-49a3-9a22-a9dca6e3327d tempest-GroupsTest-1593812186 None] Delete group completed successfully.
Nov 06 17:08:05 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e20333fc-1994-4783-b097-f62c4ae940f5 tempest-AttachVolumeTestJSON-951913559 None] Lock "cinder-de63f69c-a006-4b50-81c6-857f17b5ac8f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:08:05 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e20333fc-1994-4783-b097-f62c4ae940f5 tempest-AttachVolumeTestJSON-951913559 None] Acquiring lock "cinder-quobyte-de63f69c-a006-4b50-81c6-857f17b5ac8f" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:08:05 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e20333fc-1994-4783-b097-f62c4ae940f5 tempest-AttachVolumeTestJSON-951913559 None] Lock "cinder-quobyte-de63f69c-a006-4b50-81c6-857f17b5ac8f" acquired by "delete_volume" :: waited 0.018s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:08:05 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fcd416-cf6d-4492-b83c-0100db23e00f]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:08:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e20333fc-1994-4783-b097-f62c4ae940f5 tempest-AttachVolumeTestJSON-951913559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-de63f69c-a006-4b50-81c6-857f17b5ac8f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:05 devstack sudo[93814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-de63f69c-a006-4b50-81c6-857f17b5ac8f
Nov 06 17:08:05 devstack sudo[93814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:06 devstack sudo[93814]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e20333fc-1994-4783-b097-f62c4ae940f5 tempest-AttachVolumeTestJSON-951913559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-de63f69c-a006-4b50-81c6-857f17b5ac8f" returned: 0 in 0.456s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e20333fc-1994-4783-b097-f62c4ae940f5 tempest-AttachVolumeTestJSON-951913559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-de63f69c-a006-4b50-81c6-857f17b5ac8f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:06 devstack sudo[93819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-de63f69c-a006-4b50-81c6-857f17b5ac8f
Nov 06 17:08:06 devstack sudo[93819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:06 devstack sudo[93819]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e20333fc-1994-4783-b097-f62c4ae940f5 tempest-AttachVolumeTestJSON-951913559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-de63f69c-a006-4b50-81c6-857f17b5ac8f" returned: 0 in 0.345s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:06 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e20333fc-1994-4783-b097-f62c4ae940f5 tempest-AttachVolumeTestJSON-951913559 None] Lock "cinder-quobyte-de63f69c-a006-4b50-81c6-857f17b5ac8f" released by "delete_volume" :: held 0.875s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:08:06 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-e20333fc-1994-4783-b097-f62c4ae940f5 tempest-AttachVolumeTestJSON-951913559 None] Created reservations ['ccfcb050-5a89-4732-99f5-20ad3eda3419', '53c0fc3d-a4fd-467a-8245-e3ab49a95336', '45d7a8ca-b9a8-478f-a11a-71793fb6e2a2', 'b2a63082-cf7e-4b5b-941b-ec07345aee33'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:08:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e20333fc-1994-4783-b097-f62c4ae940f5 tempest-AttachVolumeTestJSON-951913559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:08:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e20333fc-1994-4783-b097-f62c4ae940f5 tempest-AttachVolumeTestJSON-951913559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:08:06 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e20333fc-1994-4783-b097-f62c4ae940f5 tempest-AttachVolumeTestJSON-951913559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:08:06 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e20333fc-1994-4783-b097-f62c4ae940f5 tempest-AttachVolumeTestJSON-951913559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:08:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e20333fc-1994-4783-b097-f62c4ae940f5 tempest-AttachVolumeTestJSON-951913559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:08:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e20333fc-1994-4783-b097-f62c4ae940f5 tempest-AttachVolumeTestJSON-951913559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:06 devstack sudo[93822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:08:06 devstack sudo[93822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:07 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-b04558a4-2cb5-486f-859a-79230494f868 tempest-AttachVolumeTestJSON-951913559 None] Acquiring lock "cinder-e4e15061-0c11-42ef-8e93-d3c3045dd38a-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:08:07 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-264b0eeb-c4af-4750-ad3e-c7b46145a523 tempest-GroupsTest-1593812186 None] Group tempest-GroupsTest-Group-764242978: creating
Nov 06 17:08:07 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-b04558a4-2cb5-486f-859a-79230494f868 tempest-AttachVolumeTestJSON-951913559 None] Lock "cinder-e4e15061-0c11-42ef-8e93-d3c3045dd38a-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:08:07 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-264b0eeb-c4af-4750-ad3e-c7b46145a523 tempest-GroupsTest-1593812186 None] Group tempest-GroupsTest-Group-764242978: created successfully
Nov 06 17:08:07 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-b04558a4-2cb5-486f-859a-79230494f868 tempest-AttachVolumeTestJSON-951913559 None] Acquiring lock "cinder-quobyte-e4e15061-0c11-42ef-8e93-d3c3045dd38a" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:08:07 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-264b0eeb-c4af-4750-ad3e-c7b46145a523 tempest-GroupsTest-1593812186 None] Create group completed successfully.
Nov 06 17:08:07 devstack sudo[93822]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e20333fc-1994-4783-b097-f62c4ae940f5 tempest-AttachVolumeTestJSON-951913559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.343s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:07 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-e20333fc-1994-4783-b097-f62c4ae940f5 tempest-AttachVolumeTestJSON-951913559 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:08:07 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-b04558a4-2cb5-486f-859a-79230494f868 tempest-AttachVolumeTestJSON-951913559 None] Lock "cinder-quobyte-e4e15061-0c11-42ef-8e93-d3c3045dd38a" acquired by "delete_volume" :: waited 0.029s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:08:07 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-e20333fc-1994-4783-b097-f62c4ae940f5 tempest-AttachVolumeTestJSON-951913559 None] Deleted volume successfully.
Nov 06 17:08:07 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e20333fc-1994-4783-b097-f62c4ae940f5 tempest-AttachVolumeTestJSON-951913559 None] Lock "cinder-de63f69c-a006-4b50-81c6-857f17b5ac8f-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:08:07 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6706afc-21e1-43e1-8c06-80af4327ade4]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:08:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b04558a4-2cb5-486f-859a-79230494f868 tempest-AttachVolumeTestJSON-951913559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e4e15061-0c11-42ef-8e93-d3c3045dd38a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:07 devstack sudo[93825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e4e15061-0c11-42ef-8e93-d3c3045dd38a
Nov 06 17:08:07 devstack sudo[93825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:07 devstack sudo[93825]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b04558a4-2cb5-486f-859a-79230494f868 tempest-AttachVolumeTestJSON-951913559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e4e15061-0c11-42ef-8e93-d3c3045dd38a" returned: 0 in 0.379s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b04558a4-2cb5-486f-859a-79230494f868 tempest-AttachVolumeTestJSON-951913559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e4e15061-0c11-42ef-8e93-d3c3045dd38a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:07 devstack sudo[93831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e4e15061-0c11-42ef-8e93-d3c3045dd38a
Nov 06 17:08:07 devstack sudo[93831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:07 devstack sudo[93831]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b04558a4-2cb5-486f-859a-79230494f868 tempest-AttachVolumeTestJSON-951913559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e4e15061-0c11-42ef-8e93-d3c3045dd38a" returned: 0 in 0.286s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:08 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-b04558a4-2cb5-486f-859a-79230494f868 tempest-AttachVolumeTestJSON-951913559 None] Lock "cinder-quobyte-e4e15061-0c11-42ef-8e93-d3c3045dd38a" released by "delete_volume" :: held 0.746s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:08:08 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-b04558a4-2cb5-486f-859a-79230494f868 tempest-AttachVolumeTestJSON-951913559 None] Created reservations ['9ee9013c-7326-4a16-a6e2-c1261c619f6c', '151819b6-19f4-48ed-a12a-79ffa1f15159', 'dd79ccab-ba86-40dc-83d0-58e6132b2c9a', '52058b89-3a8b-453c-90ad-c1e1eba4f6bb'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:08:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b04558a4-2cb5-486f-859a-79230494f868 tempest-AttachVolumeTestJSON-951913559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:08:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b04558a4-2cb5-486f-859a-79230494f868 tempest-AttachVolumeTestJSON-951913559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:08:08 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-b04558a4-2cb5-486f-859a-79230494f868 tempest-AttachVolumeTestJSON-951913559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:08:08 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-b04558a4-2cb5-486f-859a-79230494f868 tempest-AttachVolumeTestJSON-951913559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:08:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b04558a4-2cb5-486f-859a-79230494f868 tempest-AttachVolumeTestJSON-951913559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:08:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b04558a4-2cb5-486f-859a-79230494f868 tempest-AttachVolumeTestJSON-951913559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:08 devstack sudo[93834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:08:08 devstack sudo[93834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:08 devstack sudo[93834]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b04558a4-2cb5-486f-859a-79230494f868 tempest-AttachVolumeTestJSON-951913559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.432s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:08 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-b04558a4-2cb5-486f-859a-79230494f868 tempest-AttachVolumeTestJSON-951913559 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:08:08 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-b04558a4-2cb5-486f-859a-79230494f868 tempest-AttachVolumeTestJSON-951913559 None] Deleted volume successfully.
Nov 06 17:08:08 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-b04558a4-2cb5-486f-859a-79230494f868 tempest-AttachVolumeTestJSON-951913559 None] Lock "cinder-e4e15061-0c11-42ef-8e93-d3c3045dd38a-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:08:09 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fb4f06f-47a8-48f4-bb08-54669b13ffb9 tempest-GroupsTest-1593812186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:08:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7fb4f06f-47a8-48f4-bb08-54669b13ffb9 tempest-GroupsTest-1593812186 None] Flow 'volume_create_manager' (81f9d643-6dcd-4ae1-899d-91c6aeb59607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:08:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7fb4f06f-47a8-48f4-bb08-54669b13ffb9 tempest-GroupsTest-1593812186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e39c1701-8869-4dc4-865a-c4f56e030178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7fb4f06f-47a8-48f4-bb08-54669b13ffb9 tempest-GroupsTest-1593812186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e39c1701-8869-4dc4-865a-c4f56e030178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1546023165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3a8bc4eb-db0a-4f4c-9892-3172ece66ae4,host='devstack@QuobyteHD#QuobyteHD',id=8753f866-ed31-47c3-bb71-e1eede8afdf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b3d5183e4904775bf988b6c80155730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:08:09Z,use_quota=True,user_id='2a0b40ef0b564c04b56427f80ecdda7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62da406b-f566-4a3d-bc7f-11f99b422a4e),volume_type_id=62da406b-f566-4a3d-bc7f-11f99b422a4e)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7fb4f06f-47a8-48f4-bb08-54669b13ffb9 tempest-GroupsTest-1593812186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f84afeda-c647-4795-86d0-94258d93d44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7fb4f06f-47a8-48f4-bb08-54669b13ffb9 tempest-GroupsTest-1593812186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f84afeda-c647-4795-86d0-94258d93d44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7fb4f06f-47a8-48f4-bb08-54669b13ffb9 tempest-GroupsTest-1593812186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d87b6483-031d-49ba-8b4d-f6fa2f8369ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7fb4f06f-47a8-48f4-bb08-54669b13ffb9 tempest-GroupsTest-1593812186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d87b6483-031d-49ba-8b4d-f6fa2f8369ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8753f866-ed31-47c3-bb71-e1eede8afdf7', 'volume_name': 'volume-8753f866-ed31-47c3-bb71-e1eede8afdf7', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7fb4f06f-47a8-48f4-bb08-54669b13ffb9 tempest-GroupsTest-1593812186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6d6c030-165a-4c17-9df0-43793c1f8e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7fb4f06f-47a8-48f4-bb08-54669b13ffb9 tempest-GroupsTest-1593812186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6d6c030-165a-4c17-9df0-43793c1f8e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7fb4f06f-47a8-48f4-bb08-54669b13ffb9 tempest-GroupsTest-1593812186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee0709c-3714-49f2-adc2-c4fc3aa97496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:09 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-7fb4f06f-47a8-48f4-bb08-54669b13ffb9 tempest-GroupsTest-1593812186 None] Volume 8753f866-ed31-47c3-bb71-e1eede8afdf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8753f866-ed31-47c3-bb71-e1eede8afdf7', 'volume_size': 1}
Nov 06 17:08:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7fb4f06f-47a8-48f4-bb08-54669b13ffb9 tempest-GroupsTest-1593812186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:08:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7fb4f06f-47a8-48f4-bb08-54669b13ffb9 tempest-GroupsTest-1593812186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:08:09 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7fb4f06f-47a8-48f4-bb08-54669b13ffb9 tempest-GroupsTest-1593812186 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=3a8bc4eb-db0a-4f4c-9892-3172ece66ae4,created_at=2026-11-06T16:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1546023165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3a8bc4eb-db0a-4f4c-9892-3172ece66ae4,host='devstack@QuobyteHD#QuobyteHD',id=8753f866-ed31-47c3-bb71-e1eede8afdf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b3d5183e4904775bf988b6c80155730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:08:09Z,use_quota=True,user_id='2a0b40ef0b564c04b56427f80ecdda7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62da406b-f566-4a3d-bc7f-11f99b422a4e),volume_type_id=62da406b-f566-4a3d-bc7f-11f99b422a4e)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:08:09 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-7fb4f06f-47a8-48f4-bb08-54669b13ffb9 tempest-GroupsTest-1593812186 None] Creating volume 8753f866-ed31-47c3-bb71-e1eede8afdf7 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:08:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7fb4f06f-47a8-48f4-bb08-54669b13ffb9 tempest-GroupsTest-1593812186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:08:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7fb4f06f-47a8-48f4-bb08-54669b13ffb9 tempest-GroupsTest-1593812186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:08:09 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7fb4f06f-47a8-48f4-bb08-54669b13ffb9 tempest-GroupsTest-1593812186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:08:09 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7fb4f06f-47a8-48f4-bb08-54669b13ffb9 tempest-GroupsTest-1593812186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:08:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7fb4f06f-47a8-48f4-bb08-54669b13ffb9 tempest-GroupsTest-1593812186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:08:09 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7fb4f06f-47a8-48f4-bb08-54669b13ffb9 tempest-GroupsTest-1593812186 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:08:09 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-7fb4f06f-47a8-48f4-bb08-54669b13ffb9 tempest-GroupsTest-1593812186 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:08:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7fb4f06f-47a8-48f4-bb08-54669b13ffb9 tempest-GroupsTest-1593812186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8753f866-ed31-47c3-bb71-e1eede8afdf7 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:09 devstack sudo[93837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8753f866-ed31-47c3-bb71-e1eede8afdf7 1073741824
Nov 06 17:08:09 devstack sudo[93837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:09 devstack sudo[93837]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7fb4f06f-47a8-48f4-bb08-54669b13ffb9 tempest-GroupsTest-1593812186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8753f866-ed31-47c3-bb71-e1eede8afdf7 1073741824" returned: 0 in 0.669s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7fb4f06f-47a8-48f4-bb08-54669b13ffb9 tempest-GroupsTest-1593812186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8753f866-ed31-47c3-bb71-e1eede8afdf7 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:09 devstack sudo[93842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8753f866-ed31-47c3-bb71-e1eede8afdf7
Nov 06 17:08:09 devstack sudo[93842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:10 devstack sudo[93842]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7fb4f06f-47a8-48f4-bb08-54669b13ffb9 tempest-GroupsTest-1593812186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8753f866-ed31-47c3-bb71-e1eede8afdf7" returned: 0 in 0.297s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:10 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7fb4f06f-47a8-48f4-bb08-54669b13ffb9 tempest-GroupsTest-1593812186 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:08:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7fb4f06f-47a8-48f4-bb08-54669b13ffb9 tempest-GroupsTest-1593812186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:08:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7fb4f06f-47a8-48f4-bb08-54669b13ffb9 tempest-GroupsTest-1593812186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee0709c-3714-49f2-adc2-c4fc3aa97496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8753f866-ed31-47c3-bb71-e1eede8afdf7', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7fb4f06f-47a8-48f4-bb08-54669b13ffb9 tempest-GroupsTest-1593812186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (421ca70c-eced-4d66-969a-b9ac62d74bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:10 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-7fb4f06f-47a8-48f4-bb08-54669b13ffb9 tempest-GroupsTest-1593812186 None] Volume volume-8753f866-ed31-47c3-bb71-e1eede8afdf7 (8753f866-ed31-47c3-bb71-e1eede8afdf7): created successfully
Nov 06 17:08:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7fb4f06f-47a8-48f4-bb08-54669b13ffb9 tempest-GroupsTest-1593812186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (421ca70c-eced-4d66-969a-b9ac62d74bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7fb4f06f-47a8-48f4-bb08-54669b13ffb9 tempest-GroupsTest-1593812186 None] Flow 'volume_create_manager' (81f9d643-6dcd-4ae1-899d-91c6aeb59607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:08:10 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-7fb4f06f-47a8-48f4-bb08-54669b13ffb9 tempest-GroupsTest-1593812186 None] Created volume successfully.
Nov 06 17:08:12 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5b48cd7-43fc-4cd6-9714-05dac30ea4da tempest-GroupsTest-1593812186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:08:12 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d5b48cd7-43fc-4cd6-9714-05dac30ea4da tempest-GroupsTest-1593812186 None] Flow 'volume_create_manager' (77c6da22-f958-4dee-83cf-f14df6e41ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:08:12 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d5b48cd7-43fc-4cd6-9714-05dac30ea4da tempest-GroupsTest-1593812186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55c6ec87-a880-4ca5-ae8b-aaf5879640cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:12 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d5b48cd7-43fc-4cd6-9714-05dac30ea4da tempest-GroupsTest-1593812186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55c6ec87-a880-4ca5-ae8b-aaf5879640cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2050875907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3a8bc4eb-db0a-4f4c-9892-3172ece66ae4,host='devstack@QuobyteHD#QuobyteHD',id=1a5154f4-62ae-4356-bdad-56b0b2aa4942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b3d5183e4904775bf988b6c80155730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:08:12Z,use_quota=True,user_id='2a0b40ef0b564c04b56427f80ecdda7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62da406b-f566-4a3d-bc7f-11f99b422a4e),volume_type_id=62da406b-f566-4a3d-bc7f-11f99b422a4e)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:12 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d5b48cd7-43fc-4cd6-9714-05dac30ea4da tempest-GroupsTest-1593812186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ddde8b2-57ad-4eb9-b214-d9d62c47e2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:12 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d5b48cd7-43fc-4cd6-9714-05dac30ea4da tempest-GroupsTest-1593812186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ddde8b2-57ad-4eb9-b214-d9d62c47e2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:12 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d5b48cd7-43fc-4cd6-9714-05dac30ea4da tempest-GroupsTest-1593812186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4afd69a-4433-494f-ac19-6dff678781be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:12 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d5b48cd7-43fc-4cd6-9714-05dac30ea4da tempest-GroupsTest-1593812186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4afd69a-4433-494f-ac19-6dff678781be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a5154f4-62ae-4356-bdad-56b0b2aa4942', 'volume_name': 'volume-1a5154f4-62ae-4356-bdad-56b0b2aa4942', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:12 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d5b48cd7-43fc-4cd6-9714-05dac30ea4da tempest-GroupsTest-1593812186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (638e451f-1b42-4171-a909-98f1a449abd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:12 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d5b48cd7-43fc-4cd6-9714-05dac30ea4da tempest-GroupsTest-1593812186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (638e451f-1b42-4171-a909-98f1a449abd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:12 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d5b48cd7-43fc-4cd6-9714-05dac30ea4da tempest-GroupsTest-1593812186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3b9810e-170d-4370-add9-423992707c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:12 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-d5b48cd7-43fc-4cd6-9714-05dac30ea4da tempest-GroupsTest-1593812186 None] Volume 1a5154f4-62ae-4356-bdad-56b0b2aa4942: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a5154f4-62ae-4356-bdad-56b0b2aa4942', 'volume_size': 1}
Nov 06 17:08:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d5b48cd7-43fc-4cd6-9714-05dac30ea4da tempest-GroupsTest-1593812186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:08:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d5b48cd7-43fc-4cd6-9714-05dac30ea4da tempest-GroupsTest-1593812186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:08:12 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d5b48cd7-43fc-4cd6-9714-05dac30ea4da tempest-GroupsTest-1593812186 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=3a8bc4eb-db0a-4f4c-9892-3172ece66ae4,created_at=2026-11-06T16:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2050875907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3a8bc4eb-db0a-4f4c-9892-3172ece66ae4,host='devstack@QuobyteHD#QuobyteHD',id=1a5154f4-62ae-4356-bdad-56b0b2aa4942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b3d5183e4904775bf988b6c80155730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:08:12Z,use_quota=True,user_id='2a0b40ef0b564c04b56427f80ecdda7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62da406b-f566-4a3d-bc7f-11f99b422a4e),volume_type_id=62da406b-f566-4a3d-bc7f-11f99b422a4e)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:08:12 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-d5b48cd7-43fc-4cd6-9714-05dac30ea4da tempest-GroupsTest-1593812186 None] Creating volume 1a5154f4-62ae-4356-bdad-56b0b2aa4942 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:08:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d5b48cd7-43fc-4cd6-9714-05dac30ea4da tempest-GroupsTest-1593812186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:08:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d5b48cd7-43fc-4cd6-9714-05dac30ea4da tempest-GroupsTest-1593812186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:08:12 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d5b48cd7-43fc-4cd6-9714-05dac30ea4da tempest-GroupsTest-1593812186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:08:12 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d5b48cd7-43fc-4cd6-9714-05dac30ea4da tempest-GroupsTest-1593812186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:08:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d5b48cd7-43fc-4cd6-9714-05dac30ea4da tempest-GroupsTest-1593812186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:08:12 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d5b48cd7-43fc-4cd6-9714-05dac30ea4da tempest-GroupsTest-1593812186 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:08:12 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-d5b48cd7-43fc-4cd6-9714-05dac30ea4da tempest-GroupsTest-1593812186 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:08:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d5b48cd7-43fc-4cd6-9714-05dac30ea4da tempest-GroupsTest-1593812186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a5154f4-62ae-4356-bdad-56b0b2aa4942 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:12 devstack sudo[93847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a5154f4-62ae-4356-bdad-56b0b2aa4942 1073741824
Nov 06 17:08:12 devstack sudo[93847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:13 devstack sudo[93847]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d5b48cd7-43fc-4cd6-9714-05dac30ea4da tempest-GroupsTest-1593812186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a5154f4-62ae-4356-bdad-56b0b2aa4942 1073741824" returned: 0 in 0.616s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d5b48cd7-43fc-4cd6-9714-05dac30ea4da tempest-GroupsTest-1593812186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a5154f4-62ae-4356-bdad-56b0b2aa4942 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:13 devstack sudo[93853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a5154f4-62ae-4356-bdad-56b0b2aa4942
Nov 06 17:08:13 devstack sudo[93853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:13 devstack sudo[93853]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d5b48cd7-43fc-4cd6-9714-05dac30ea4da tempest-GroupsTest-1593812186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a5154f4-62ae-4356-bdad-56b0b2aa4942" returned: 0 in 0.306s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:13 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d5b48cd7-43fc-4cd6-9714-05dac30ea4da tempest-GroupsTest-1593812186 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:08:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d5b48cd7-43fc-4cd6-9714-05dac30ea4da tempest-GroupsTest-1593812186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:08:13 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d5b48cd7-43fc-4cd6-9714-05dac30ea4da tempest-GroupsTest-1593812186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3b9810e-170d-4370-add9-423992707c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a5154f4-62ae-4356-bdad-56b0b2aa4942', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:13 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d5b48cd7-43fc-4cd6-9714-05dac30ea4da tempest-GroupsTest-1593812186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c8ce879-8da9-45b3-953f-8755392d1ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:13 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-d5b48cd7-43fc-4cd6-9714-05dac30ea4da tempest-GroupsTest-1593812186 None] Volume volume-1a5154f4-62ae-4356-bdad-56b0b2aa4942 (1a5154f4-62ae-4356-bdad-56b0b2aa4942): created successfully
Nov 06 17:08:13 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d5b48cd7-43fc-4cd6-9714-05dac30ea4da tempest-GroupsTest-1593812186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c8ce879-8da9-45b3-953f-8755392d1ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:13 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d5b48cd7-43fc-4cd6-9714-05dac30ea4da tempest-GroupsTest-1593812186 None] Flow 'volume_create_manager' (77c6da22-f958-4dee-83cf-f14df6e41ad0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:08:13 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-d5b48cd7-43fc-4cd6-9714-05dac30ea4da tempest-GroupsTest-1593812186 None] Created volume successfully.
Nov 06 17:08:14 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=106,cinder:UPDATE=107,cinder:DELETE=6,cinder:INSERT=24 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:08:14 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=101,cinder:UPDATE=97,cinder:INSERT=19,cinder:DELETE=6 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:08:14 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-370c31d1-14b8-4f29-876a-5c48f0fccac0 tempest-GroupsTest-1593812186 None] Update group completed successfully.
Nov 06 17:08:16 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-0c3f5148-3df7-4c63-a798-9354aa7f64f0 tempest-GroupsTest-1593812186 None] Update group completed successfully.
Nov 06 17:08:18 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c7c15fec-1337-474e-83f9-aaa8adea826e tempest-GroupsTest-1593812186 None] Acquiring lock "cinder-quobyte-1a5154f4-62ae-4356-bdad-56b0b2aa4942" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:08:18 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c7c15fec-1337-474e-83f9-aaa8adea826e tempest-GroupsTest-1593812186 None] Lock "cinder-quobyte-1a5154f4-62ae-4356-bdad-56b0b2aa4942" acquired by "delete_volume" :: waited 0.017s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:08:18 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[07de0092-1441-4ae5-aff3-564977b44af2]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:08:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c7c15fec-1337-474e-83f9-aaa8adea826e tempest-GroupsTest-1593812186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a5154f4-62ae-4356-bdad-56b0b2aa4942 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:18 devstack sudo[93876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a5154f4-62ae-4356-bdad-56b0b2aa4942
Nov 06 17:08:18 devstack sudo[93876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:19 devstack sudo[93876]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c7c15fec-1337-474e-83f9-aaa8adea826e tempest-GroupsTest-1593812186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a5154f4-62ae-4356-bdad-56b0b2aa4942" returned: 0 in 0.590s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c7c15fec-1337-474e-83f9-aaa8adea826e tempest-GroupsTest-1593812186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a5154f4-62ae-4356-bdad-56b0b2aa4942 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:19 devstack sudo[93882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a5154f4-62ae-4356-bdad-56b0b2aa4942
Nov 06 17:08:19 devstack sudo[93882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:19 devstack sudo[93882]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c7c15fec-1337-474e-83f9-aaa8adea826e tempest-GroupsTest-1593812186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a5154f4-62ae-4356-bdad-56b0b2aa4942" returned: 0 in 0.446s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:19 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c7c15fec-1337-474e-83f9-aaa8adea826e tempest-GroupsTest-1593812186 None] Lock "cinder-quobyte-1a5154f4-62ae-4356-bdad-56b0b2aa4942" released by "delete_volume" :: held 1.090s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:08:19 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c7c15fec-1337-474e-83f9-aaa8adea826e tempest-GroupsTest-1593812186 None] Acquiring lock "cinder-quobyte-8753f866-ed31-47c3-bb71-e1eede8afdf7" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:08:19 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c7c15fec-1337-474e-83f9-aaa8adea826e tempest-GroupsTest-1593812186 None] Lock "cinder-quobyte-8753f866-ed31-47c3-bb71-e1eede8afdf7" acquired by "delete_volume" :: waited 0.022s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:08:19 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[63005b59-73a1-4a08-8baf-4d2817951239]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:08:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c7c15fec-1337-474e-83f9-aaa8adea826e tempest-GroupsTest-1593812186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8753f866-ed31-47c3-bb71-e1eede8afdf7 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:20 devstack sudo[93886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8753f866-ed31-47c3-bb71-e1eede8afdf7
Nov 06 17:08:20 devstack sudo[93886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:20 devstack sudo[93886]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c7c15fec-1337-474e-83f9-aaa8adea826e tempest-GroupsTest-1593812186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8753f866-ed31-47c3-bb71-e1eede8afdf7" returned: 0 in 0.777s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c7c15fec-1337-474e-83f9-aaa8adea826e tempest-GroupsTest-1593812186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8753f866-ed31-47c3-bb71-e1eede8afdf7 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:20 devstack sudo[93927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8753f866-ed31-47c3-bb71-e1eede8afdf7
Nov 06 17:08:20 devstack sudo[93927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:21 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [req-25a7382b-8057-4778-b1e8-0e7cdeb7ea8e req-e19dff34-c963-4fe9-a178-ccdc547f8e36 tempest-VolumesGetTestJSON-1658598216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:08:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-25a7382b-8057-4778-b1e8-0e7cdeb7ea8e req-e19dff34-c963-4fe9-a178-ccdc547f8e36 tempest-VolumesGetTestJSON-1658598216 None] Flow 'volume_create_manager' (9afb2e85-a899-4668-a829-a83f616f4f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:08:21 devstack sudo[93927]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-25a7382b-8057-4778-b1e8-0e7cdeb7ea8e req-e19dff34-c963-4fe9-a178-ccdc547f8e36 tempest-VolumesGetTestJSON-1658598216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (719b3d73-4794-4f1c-b3d3-5f68277fab5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c7c15fec-1337-474e-83f9-aaa8adea826e tempest-GroupsTest-1593812186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8753f866-ed31-47c3-bb71-e1eede8afdf7" returned: 0 in 0.969s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:21 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c7c15fec-1337-474e-83f9-aaa8adea826e tempest-GroupsTest-1593812186 None] Lock "cinder-quobyte-8753f866-ed31-47c3-bb71-e1eede8afdf7" released by "delete_volume" :: held 1.839s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:08:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-25a7382b-8057-4778-b1e8-0e7cdeb7ea8e req-e19dff34-c963-4fe9-a178-ccdc547f8e36 tempest-VolumesGetTestJSON-1658598216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (719b3d73-4794-4f1c-b3d3-5f68277fab5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-245831859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e156d03-d3db-4d85-9877-025f538cd68a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5023df058f394edabef38f817ff0a59c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:08:21Z,use_quota=True,user_id='e4f7fc7308c54d59a14cb9bf05f4231c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-25a7382b-8057-4778-b1e8-0e7cdeb7ea8e req-e19dff34-c963-4fe9-a178-ccdc547f8e36 tempest-VolumesGetTestJSON-1658598216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa51cd3b-dbf6-48a0-ac8e-b10722b0e1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-25a7382b-8057-4778-b1e8-0e7cdeb7ea8e req-e19dff34-c963-4fe9-a178-ccdc547f8e36 tempest-VolumesGetTestJSON-1658598216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa51cd3b-dbf6-48a0-ac8e-b10722b0e1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-25a7382b-8057-4778-b1e8-0e7cdeb7ea8e req-e19dff34-c963-4fe9-a178-ccdc547f8e36 tempest-VolumesGetTestJSON-1658598216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af8b234b-a4f5-4a56-8d1f-320bbe468a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-25a7382b-8057-4778-b1e8-0e7cdeb7ea8e req-e19dff34-c963-4fe9-a178-ccdc547f8e36 tempest-VolumesGetTestJSON-1658598216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af8b234b-a4f5-4a56-8d1f-320bbe468a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e156d03-d3db-4d85-9877-025f538cd68a', 'volume_name': 'volume-7e156d03-d3db-4d85-9877-025f538cd68a', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-25a7382b-8057-4778-b1e8-0e7cdeb7ea8e req-e19dff34-c963-4fe9-a178-ccdc547f8e36 tempest-VolumesGetTestJSON-1658598216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69b57553-df6f-40c8-9efd-7d85bf71f16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-25a7382b-8057-4778-b1e8-0e7cdeb7ea8e req-e19dff34-c963-4fe9-a178-ccdc547f8e36 tempest-VolumesGetTestJSON-1658598216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69b57553-df6f-40c8-9efd-7d85bf71f16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-25a7382b-8057-4778-b1e8-0e7cdeb7ea8e req-e19dff34-c963-4fe9-a178-ccdc547f8e36 tempest-VolumesGetTestJSON-1658598216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269a3296-b12c-4fc9-bcbe-06487210600b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:21 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [req-25a7382b-8057-4778-b1e8-0e7cdeb7ea8e req-e19dff34-c963-4fe9-a178-ccdc547f8e36 tempest-VolumesGetTestJSON-1658598216 None] Volume 7e156d03-d3db-4d85-9877-025f538cd68a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e156d03-d3db-4d85-9877-025f538cd68a', 'volume_size': 1}
Nov 06 17:08:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-25a7382b-8057-4778-b1e8-0e7cdeb7ea8e req-e19dff34-c963-4fe9-a178-ccdc547f8e36 tempest-VolumesGetTestJSON-1658598216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:08:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-25a7382b-8057-4778-b1e8-0e7cdeb7ea8e req-e19dff34-c963-4fe9-a178-ccdc547f8e36 tempest-VolumesGetTestJSON-1658598216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:08:21 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [req-25a7382b-8057-4778-b1e8-0e7cdeb7ea8e req-e19dff34-c963-4fe9-a178-ccdc547f8e36 tempest-VolumesGetTestJSON-1658598216 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-245831859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e156d03-d3db-4d85-9877-025f538cd68a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5023df058f394edabef38f817ff0a59c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:08:21Z,use_quota=True,user_id='e4f7fc7308c54d59a14cb9bf05f4231c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:08:21 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [req-25a7382b-8057-4778-b1e8-0e7cdeb7ea8e req-e19dff34-c963-4fe9-a178-ccdc547f8e36 tempest-VolumesGetTestJSON-1658598216 None] Creating volume 7e156d03-d3db-4d85-9877-025f538cd68a {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:08:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-25a7382b-8057-4778-b1e8-0e7cdeb7ea8e req-e19dff34-c963-4fe9-a178-ccdc547f8e36 tempest-VolumesGetTestJSON-1658598216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:08:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-25a7382b-8057-4778-b1e8-0e7cdeb7ea8e req-e19dff34-c963-4fe9-a178-ccdc547f8e36 tempest-VolumesGetTestJSON-1658598216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:08:21 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [req-25a7382b-8057-4778-b1e8-0e7cdeb7ea8e req-e19dff34-c963-4fe9-a178-ccdc547f8e36 tempest-VolumesGetTestJSON-1658598216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:08:21 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [req-25a7382b-8057-4778-b1e8-0e7cdeb7ea8e req-e19dff34-c963-4fe9-a178-ccdc547f8e36 tempest-VolumesGetTestJSON-1658598216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:08:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-25a7382b-8057-4778-b1e8-0e7cdeb7ea8e req-e19dff34-c963-4fe9-a178-ccdc547f8e36 tempest-VolumesGetTestJSON-1658598216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:08:21 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [req-25a7382b-8057-4778-b1e8-0e7cdeb7ea8e req-e19dff34-c963-4fe9-a178-ccdc547f8e36 tempest-VolumesGetTestJSON-1658598216 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:08:21 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [req-25a7382b-8057-4778-b1e8-0e7cdeb7ea8e req-e19dff34-c963-4fe9-a178-ccdc547f8e36 tempest-VolumesGetTestJSON-1658598216 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:08:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-25a7382b-8057-4778-b1e8-0e7cdeb7ea8e req-e19dff34-c963-4fe9-a178-ccdc547f8e36 tempest-VolumesGetTestJSON-1658598216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7e156d03-d3db-4d85-9877-025f538cd68a 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:21 devstack sudo[93962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7e156d03-d3db-4d85-9877-025f538cd68a 1073741824
Nov 06 17:08:21 devstack sudo[93962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:21 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-c7c15fec-1337-474e-83f9-aaa8adea826e tempest-GroupsTest-1593812186 None] Created reservations ['d7d696d1-36cd-4402-9114-03a60b1e1c3c'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:08:21 devstack cinder-volume[86856]: WARNING cinder.quota [None req-c7c15fec-1337-474e-83f9-aaa8adea826e tempest-GroupsTest-1593812186 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-503957316 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-503957316, it is now deprecated. Please use the default quota class for default quota.
Nov 06 17:08:21 devstack cinder-volume[86856]: WARNING cinder.quota [None req-c7c15fec-1337-474e-83f9-aaa8adea826e tempest-GroupsTest-1593812186 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-503957316 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-503957316, it is now deprecated. Please use the default quota class for default quota.
Nov 06 17:08:21 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-c7c15fec-1337-474e-83f9-aaa8adea826e tempest-GroupsTest-1593812186 None] Created reservations ['15055de1-523c-4683-a3d6-2dca10c626ba', 'efbbf109-657b-44ad-b347-e2a1054995ce', '087febc6-483d-4ed0-9bc9-3813629a1eb0', '8f85b790-bf39-4170-b48b-20fd9bbb2a4f'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:08:22 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-c7c15fec-1337-474e-83f9-aaa8adea826e tempest-GroupsTest-1593812186 None] Created reservations ['051fe9d3-159c-4116-b68f-5a8ee91d2ee3', 'a714d755-a1bb-44e2-b60d-1fcc43ba8445', '9951e75b-2d91-4116-a0c7-893f596ea71d', 'ebc3bc99-8a61-4855-8a47-49fa811a0c38'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:08:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c7c15fec-1337-474e-83f9-aaa8adea826e tempest-GroupsTest-1593812186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:08:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c7c15fec-1337-474e-83f9-aaa8adea826e tempest-GroupsTest-1593812186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:08:22 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c7c15fec-1337-474e-83f9-aaa8adea826e tempest-GroupsTest-1593812186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:08:22 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c7c15fec-1337-474e-83f9-aaa8adea826e tempest-GroupsTest-1593812186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:08:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c7c15fec-1337-474e-83f9-aaa8adea826e tempest-GroupsTest-1593812186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:08:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c7c15fec-1337-474e-83f9-aaa8adea826e tempest-GroupsTest-1593812186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:22 devstack sudo[93970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:08:22 devstack sudo[93970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:22 devstack sudo[93962]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-25a7382b-8057-4778-b1e8-0e7cdeb7ea8e req-e19dff34-c963-4fe9-a178-ccdc547f8e36 tempest-VolumesGetTestJSON-1658598216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7e156d03-d3db-4d85-9877-025f538cd68a 1073741824" returned: 0 in 0.922s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-25a7382b-8057-4778-b1e8-0e7cdeb7ea8e req-e19dff34-c963-4fe9-a178-ccdc547f8e36 tempest-VolumesGetTestJSON-1658598216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7e156d03-d3db-4d85-9877-025f538cd68a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:22 devstack sudo[93972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7e156d03-d3db-4d85-9877-025f538cd68a
Nov 06 17:08:22 devstack sudo[93972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:23 devstack sudo[93970]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c7c15fec-1337-474e-83f9-aaa8adea826e tempest-GroupsTest-1593812186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.785s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:23 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-c7c15fec-1337-474e-83f9-aaa8adea826e tempest-GroupsTest-1593812186 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:08:23 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-c7c15fec-1337-474e-83f9-aaa8adea826e tempest-GroupsTest-1593812186 None] Delete group completed successfully.
Nov 06 17:08:23 devstack sudo[93972]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-25a7382b-8057-4778-b1e8-0e7cdeb7ea8e req-e19dff34-c963-4fe9-a178-ccdc547f8e36 tempest-VolumesGetTestJSON-1658598216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7e156d03-d3db-4d85-9877-025f538cd68a" returned: 0 in 0.388s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:23 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [req-25a7382b-8057-4778-b1e8-0e7cdeb7ea8e req-e19dff34-c963-4fe9-a178-ccdc547f8e36 tempest-VolumesGetTestJSON-1658598216 None] <== create_volume: return (1380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:08:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-25a7382b-8057-4778-b1e8-0e7cdeb7ea8e req-e19dff34-c963-4fe9-a178-ccdc547f8e36 tempest-VolumesGetTestJSON-1658598216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.383s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:08:23 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-25a7382b-8057-4778-b1e8-0e7cdeb7ea8e req-e19dff34-c963-4fe9-a178-ccdc547f8e36 tempest-VolumesGetTestJSON-1658598216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269a3296-b12c-4fc9-bcbe-06487210600b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e156d03-d3db-4d85-9877-025f538cd68a', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:23 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-25a7382b-8057-4778-b1e8-0e7cdeb7ea8e req-e19dff34-c963-4fe9-a178-ccdc547f8e36 tempest-VolumesGetTestJSON-1658598216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d92ee68-ff58-444e-b0e6-a265df9e3b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:23 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [req-25a7382b-8057-4778-b1e8-0e7cdeb7ea8e req-e19dff34-c963-4fe9-a178-ccdc547f8e36 tempest-VolumesGetTestJSON-1658598216 None] Volume volume-7e156d03-d3db-4d85-9877-025f538cd68a (7e156d03-d3db-4d85-9877-025f538cd68a): created successfully
Nov 06 17:08:23 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-25a7382b-8057-4778-b1e8-0e7cdeb7ea8e req-e19dff34-c963-4fe9-a178-ccdc547f8e36 tempest-VolumesGetTestJSON-1658598216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d92ee68-ff58-444e-b0e6-a265df9e3b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:23 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-25a7382b-8057-4778-b1e8-0e7cdeb7ea8e req-e19dff34-c963-4fe9-a178-ccdc547f8e36 tempest-VolumesGetTestJSON-1658598216 None] Flow 'volume_create_manager' (9afb2e85-a899-4668-a829-a83f616f4f4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:08:23 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-25a7382b-8057-4778-b1e8-0e7cdeb7ea8e req-e19dff34-c963-4fe9-a178-ccdc547f8e36 tempest-VolumesGetTestJSON-1658598216 None] Created volume successfully.
Nov 06 17:08:24 devstack cinder-volume[86856]: DEBUG cinder.coordination [req-5b5420c7-0a68-42e0-bab3-2a2b24d7e2bf req-f21da1d2-c33c-409a-b753-593821f1ef3e tempest-VolumesGetTestJSON-1658598216 None] Acquiring lock "cinder-7e156d03-d3db-4d85-9877-025f538cd68a-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:08:24 devstack cinder-volume[86856]: DEBUG cinder.coordination [req-5b5420c7-0a68-42e0-bab3-2a2b24d7e2bf req-f21da1d2-c33c-409a-b753-593821f1ef3e tempest-VolumesGetTestJSON-1658598216 None] Lock "cinder-7e156d03-d3db-4d85-9877-025f538cd68a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:08:24 devstack cinder-volume[86856]: DEBUG cinder.coordination [req-5b5420c7-0a68-42e0-bab3-2a2b24d7e2bf req-f21da1d2-c33c-409a-b753-593821f1ef3e tempest-VolumesGetTestJSON-1658598216 None] Acquiring lock "cinder-quobyte-7e156d03-d3db-4d85-9877-025f538cd68a" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:08:24 devstack cinder-volume[86856]: DEBUG cinder.coordination [req-5b5420c7-0a68-42e0-bab3-2a2b24d7e2bf req-f21da1d2-c33c-409a-b753-593821f1ef3e tempest-VolumesGetTestJSON-1658598216 None] Lock "cinder-quobyte-7e156d03-d3db-4d85-9877-025f538cd68a" acquired by "delete_volume" :: waited 0.046s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:08:24 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4f1ed9-ed90-4b10-8a76-b3723934c984]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:08:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-5b5420c7-0a68-42e0-bab3-2a2b24d7e2bf req-f21da1d2-c33c-409a-b753-593821f1ef3e tempest-VolumesGetTestJSON-1658598216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7e156d03-d3db-4d85-9877-025f538cd68a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:24 devstack sudo[93976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7e156d03-d3db-4d85-9877-025f538cd68a
Nov 06 17:08:24 devstack sudo[93976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:25 devstack sudo[93976]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-5b5420c7-0a68-42e0-bab3-2a2b24d7e2bf req-f21da1d2-c33c-409a-b753-593821f1ef3e tempest-VolumesGetTestJSON-1658598216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7e156d03-d3db-4d85-9877-025f538cd68a" returned: 0 in 0.594s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-5b5420c7-0a68-42e0-bab3-2a2b24d7e2bf req-f21da1d2-c33c-409a-b753-593821f1ef3e tempest-VolumesGetTestJSON-1658598216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7e156d03-d3db-4d85-9877-025f538cd68a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:25 devstack sudo[93982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7e156d03-d3db-4d85-9877-025f538cd68a
Nov 06 17:08:25 devstack sudo[93982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:25 devstack sudo[93982]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-5b5420c7-0a68-42e0-bab3-2a2b24d7e2bf req-f21da1d2-c33c-409a-b753-593821f1ef3e tempest-VolumesGetTestJSON-1658598216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7e156d03-d3db-4d85-9877-025f538cd68a" returned: 0 in 0.364s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:25 devstack cinder-volume[86856]: DEBUG cinder.coordination [req-5b5420c7-0a68-42e0-bab3-2a2b24d7e2bf req-f21da1d2-c33c-409a-b753-593821f1ef3e tempest-VolumesGetTestJSON-1658598216 None] Lock "cinder-quobyte-7e156d03-d3db-4d85-9877-025f538cd68a" released by "delete_volume" :: held 1.084s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:08:25 devstack cinder-volume[86856]: DEBUG cinder.quota [req-5b5420c7-0a68-42e0-bab3-2a2b24d7e2bf req-f21da1d2-c33c-409a-b753-593821f1ef3e tempest-VolumesGetTestJSON-1658598216 None] Created reservations ['d0de06b6-1d01-4148-9f4c-c935e2c460ac', 'a0412389-c75a-47e2-a11a-a35df5e156c1', '3b76ec90-038f-4ee8-8fdc-d8241aeb7fb9', 'c8cedfbd-d958-4d6d-b65e-91ca1e5a9f07'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:08:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-5b5420c7-0a68-42e0-bab3-2a2b24d7e2bf req-f21da1d2-c33c-409a-b753-593821f1ef3e tempest-VolumesGetTestJSON-1658598216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:08:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-5b5420c7-0a68-42e0-bab3-2a2b24d7e2bf req-f21da1d2-c33c-409a-b753-593821f1ef3e tempest-VolumesGetTestJSON-1658598216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:08:26 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [req-5b5420c7-0a68-42e0-bab3-2a2b24d7e2bf req-f21da1d2-c33c-409a-b753-593821f1ef3e tempest-VolumesGetTestJSON-1658598216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:08:26 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [req-5b5420c7-0a68-42e0-bab3-2a2b24d7e2bf req-f21da1d2-c33c-409a-b753-593821f1ef3e tempest-VolumesGetTestJSON-1658598216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:08:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-5b5420c7-0a68-42e0-bab3-2a2b24d7e2bf req-f21da1d2-c33c-409a-b753-593821f1ef3e tempest-VolumesGetTestJSON-1658598216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:08:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-5b5420c7-0a68-42e0-bab3-2a2b24d7e2bf req-f21da1d2-c33c-409a-b753-593821f1ef3e tempest-VolumesGetTestJSON-1658598216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:26 devstack sudo[93985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:08:26 devstack sudo[93985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:26 devstack sudo[93985]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-5b5420c7-0a68-42e0-bab3-2a2b24d7e2bf req-f21da1d2-c33c-409a-b753-593821f1ef3e tempest-VolumesGetTestJSON-1658598216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.573s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:26 devstack cinder-volume[86856]: DEBUG cinder.manager [req-5b5420c7-0a68-42e0-bab3-2a2b24d7e2bf req-f21da1d2-c33c-409a-b753-593821f1ef3e tempest-VolumesGetTestJSON-1658598216 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:08:26 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-5b5420c7-0a68-42e0-bab3-2a2b24d7e2bf req-f21da1d2-c33c-409a-b753-593821f1ef3e tempest-VolumesGetTestJSON-1658598216 None] Deleted volume successfully.
Nov 06 17:08:26 devstack cinder-volume[86856]: DEBUG cinder.coordination [req-5b5420c7-0a68-42e0-bab3-2a2b24d7e2bf req-f21da1d2-c33c-409a-b753-593821f1ef3e tempest-VolumesGetTestJSON-1658598216 None] Lock "cinder-7e156d03-d3db-4d85-9877-025f538cd68a-delete_volume" released by "delete_volume" :: held 2.152s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:08:36 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=20,cinder:UPDATE=33,cinder:INSERT=8 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:08:36 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=26,cinder:UPDATE=30,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:08:36 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-ff518555-44e4-4ebd-8ee7-081c1f22f1cc tempest-GroupsV314Test-235906422 None] Group tempest-GroupsV314Test-Group-40252760: creating
Nov 06 17:08:36 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-ff518555-44e4-4ebd-8ee7-081c1f22f1cc tempest-GroupsV314Test-235906422 None] Group tempest-GroupsV314Test-Group-40252760: created successfully
Nov 06 17:08:37 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-ff518555-44e4-4ebd-8ee7-081c1f22f1cc tempest-GroupsV314Test-235906422 None] Create group completed successfully.
Nov 06 17:08:37 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b856f2c-763b-49a5-ad29-eb0d487dc6a3 tempest-VolumesTestJSON-1688072124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:08:37 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8b856f2c-763b-49a5-ad29-eb0d487dc6a3 tempest-VolumesTestJSON-1688072124 None] Flow 'volume_create_manager' (a21ca778-7879-4aea-a161-b0d1ae2e47a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:08:37 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8b856f2c-763b-49a5-ad29-eb0d487dc6a3 tempest-VolumesTestJSON-1688072124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (118cbd7c-555d-4664-b8d6-3a06ca73593e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:37 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8b856f2c-763b-49a5-ad29-eb0d487dc6a3 tempest-VolumesTestJSON-1688072124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (118cbd7c-555d-4664-b8d6-3a06ca73593e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1630421693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9698277-fdc3-41ce-a575-9931eb711f67,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='630ab5b1939f4c3482e24c7f4a10ff23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:08:38Z,use_quota=True,user_id='0f7fcbebcf374febb37875a09a489fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:37 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8b856f2c-763b-49a5-ad29-eb0d487dc6a3 tempest-VolumesTestJSON-1688072124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cd255df-e292-4901-ac8a-3ad42726d1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:37 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8b856f2c-763b-49a5-ad29-eb0d487dc6a3 tempest-VolumesTestJSON-1688072124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cd255df-e292-4901-ac8a-3ad42726d1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:37 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8b856f2c-763b-49a5-ad29-eb0d487dc6a3 tempest-VolumesTestJSON-1688072124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce87abae-3953-408e-bd67-151d6f2f2258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:37 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8b856f2c-763b-49a5-ad29-eb0d487dc6a3 tempest-VolumesTestJSON-1688072124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce87abae-3953-408e-bd67-151d6f2f2258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9698277-fdc3-41ce-a575-9931eb711f67', 'volume_name': 'volume-f9698277-fdc3-41ce-a575-9931eb711f67', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:37 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8b856f2c-763b-49a5-ad29-eb0d487dc6a3 tempest-VolumesTestJSON-1688072124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b430504-4d24-4a1b-bb50-d4f6092db759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:37 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8b856f2c-763b-49a5-ad29-eb0d487dc6a3 tempest-VolumesTestJSON-1688072124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b430504-4d24-4a1b-bb50-d4f6092db759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:37 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8b856f2c-763b-49a5-ad29-eb0d487dc6a3 tempest-VolumesTestJSON-1688072124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (932ee6d7-0619-4b52-b5cc-b49ac118c499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:37 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-8b856f2c-763b-49a5-ad29-eb0d487dc6a3 tempest-VolumesTestJSON-1688072124 None] Volume f9698277-fdc3-41ce-a575-9931eb711f67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9698277-fdc3-41ce-a575-9931eb711f67', 'volume_size': 1}
Nov 06 17:08:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-8b856f2c-763b-49a5-ad29-eb0d487dc6a3 tempest-VolumesTestJSON-1688072124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:08:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-8b856f2c-763b-49a5-ad29-eb0d487dc6a3 tempest-VolumesTestJSON-1688072124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:08:37 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-8b856f2c-763b-49a5-ad29-eb0d487dc6a3 tempest-VolumesTestJSON-1688072124 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1630421693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9698277-fdc3-41ce-a575-9931eb711f67,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='630ab5b1939f4c3482e24c7f4a10ff23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:08:38Z,use_quota=True,user_id='0f7fcbebcf374febb37875a09a489fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:08:37 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-8b856f2c-763b-49a5-ad29-eb0d487dc6a3 tempest-VolumesTestJSON-1688072124 None] Creating volume f9698277-fdc3-41ce-a575-9931eb711f67 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:08:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-8b856f2c-763b-49a5-ad29-eb0d487dc6a3 tempest-VolumesTestJSON-1688072124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:08:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-8b856f2c-763b-49a5-ad29-eb0d487dc6a3 tempest-VolumesTestJSON-1688072124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:08:37 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-8b856f2c-763b-49a5-ad29-eb0d487dc6a3 tempest-VolumesTestJSON-1688072124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:08:37 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-8b856f2c-763b-49a5-ad29-eb0d487dc6a3 tempest-VolumesTestJSON-1688072124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:08:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-8b856f2c-763b-49a5-ad29-eb0d487dc6a3 tempest-VolumesTestJSON-1688072124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:08:37 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-8b856f2c-763b-49a5-ad29-eb0d487dc6a3 tempest-VolumesTestJSON-1688072124 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:08:37 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-8b856f2c-763b-49a5-ad29-eb0d487dc6a3 tempest-VolumesTestJSON-1688072124 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:08:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8b856f2c-763b-49a5-ad29-eb0d487dc6a3 tempest-VolumesTestJSON-1688072124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9698277-fdc3-41ce-a575-9931eb711f67 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:38 devstack sudo[94094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9698277-fdc3-41ce-a575-9931eb711f67 1073741824
Nov 06 17:08:38 devstack sudo[94094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:38 devstack sudo[94094]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8b856f2c-763b-49a5-ad29-eb0d487dc6a3 tempest-VolumesTestJSON-1688072124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9698277-fdc3-41ce-a575-9931eb711f67 1073741824" returned: 0 in 0.861s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8b856f2c-763b-49a5-ad29-eb0d487dc6a3 tempest-VolumesTestJSON-1688072124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9698277-fdc3-41ce-a575-9931eb711f67 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:38 devstack sudo[94124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9698277-fdc3-41ce-a575-9931eb711f67
Nov 06 17:08:38 devstack sudo[94124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:39 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aa13bee-0554-4654-b060-c4784a54bd75 tempest-GroupsV314Test-235906422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:08:39 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1aa13bee-0554-4654-b060-c4784a54bd75 tempest-GroupsV314Test-235906422 None] Flow 'volume_create_manager' (f5d2c32e-ab3e-49fe-8051-0f1237360f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:08:39 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1aa13bee-0554-4654-b060-c4784a54bd75 tempest-GroupsV314Test-235906422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5637219f-da8a-4e1e-b48e-2b1a322a5b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:39 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1aa13bee-0554-4654-b060-c4784a54bd75 tempest-GroupsV314Test-235906422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5637219f-da8a-4e1e-b48e-2b1a322a5b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1250181014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e21304a8-1b7b-4a64-b6f7-85c8cea16dec,host='devstack@QuobyteHD#QuobyteHD',id=00eb8914-32f1-40e0-9af2-a14ff6876e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a0ae80459e40bea7707f83a175955e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:08:39Z,use_quota=True,user_id='12c95ea80fec4e9ca3ae5dd624f05133',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07c79f56-08ea-40e1-a2d4-7783cbd7cfcc),volume_type_id=07c79f56-08ea-40e1-a2d4-7783cbd7cfcc)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:39 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1aa13bee-0554-4654-b060-c4784a54bd75 tempest-GroupsV314Test-235906422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (970d418c-9528-49a1-9487-988a0377827d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:39 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1aa13bee-0554-4654-b060-c4784a54bd75 tempest-GroupsV314Test-235906422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (970d418c-9528-49a1-9487-988a0377827d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:39 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1aa13bee-0554-4654-b060-c4784a54bd75 tempest-GroupsV314Test-235906422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abd6f018-d8e3-4bcb-b1af-05124f2bb13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:39 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1aa13bee-0554-4654-b060-c4784a54bd75 tempest-GroupsV314Test-235906422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abd6f018-d8e3-4bcb-b1af-05124f2bb13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00eb8914-32f1-40e0-9af2-a14ff6876e66', 'volume_name': 'volume-00eb8914-32f1-40e0-9af2-a14ff6876e66', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:39 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1aa13bee-0554-4654-b060-c4784a54bd75 tempest-GroupsV314Test-235906422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5190064-e958-42a0-a244-119f4411ed41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:39 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1aa13bee-0554-4654-b060-c4784a54bd75 tempest-GroupsV314Test-235906422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5190064-e958-42a0-a244-119f4411ed41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:39 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1aa13bee-0554-4654-b060-c4784a54bd75 tempest-GroupsV314Test-235906422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d231850d-bcf5-4763-b3df-9153469dd2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:39 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-1aa13bee-0554-4654-b060-c4784a54bd75 tempest-GroupsV314Test-235906422 None] Volume 00eb8914-32f1-40e0-9af2-a14ff6876e66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00eb8914-32f1-40e0-9af2-a14ff6876e66', 'volume_size': 1}
Nov 06 17:08:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1aa13bee-0554-4654-b060-c4784a54bd75 tempest-GroupsV314Test-235906422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:08:39 devstack sudo[94124]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8b856f2c-763b-49a5-ad29-eb0d487dc6a3 tempest-VolumesTestJSON-1688072124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9698277-fdc3-41ce-a575-9931eb711f67" returned: 0 in 0.391s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:39 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-8b856f2c-763b-49a5-ad29-eb0d487dc6a3 tempest-VolumesTestJSON-1688072124 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:08:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-8b856f2c-763b-49a5-ad29-eb0d487dc6a3 tempest-VolumesTestJSON-1688072124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.320s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:08:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1aa13bee-0554-4654-b060-c4784a54bd75 tempest-GroupsV314Test-235906422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.036s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:08:39 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1aa13bee-0554-4654-b060-c4784a54bd75 tempest-GroupsV314Test-235906422 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=e21304a8-1b7b-4a64-b6f7-85c8cea16dec,created_at=2026-11-06T16:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1250181014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e21304a8-1b7b-4a64-b6f7-85c8cea16dec,host='devstack@QuobyteHD#QuobyteHD',id=00eb8914-32f1-40e0-9af2-a14ff6876e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a0ae80459e40bea7707f83a175955e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:08:39Z,use_quota=True,user_id='12c95ea80fec4e9ca3ae5dd624f05133',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07c79f56-08ea-40e1-a2d4-7783cbd7cfcc),volume_type_id=07c79f56-08ea-40e1-a2d4-7783cbd7cfcc)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:08:39 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-1aa13bee-0554-4654-b060-c4784a54bd75 tempest-GroupsV314Test-235906422 None] Creating volume 00eb8914-32f1-40e0-9af2-a14ff6876e66 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:08:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1aa13bee-0554-4654-b060-c4784a54bd75 tempest-GroupsV314Test-235906422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:08:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1aa13bee-0554-4654-b060-c4784a54bd75 tempest-GroupsV314Test-235906422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:08:39 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1aa13bee-0554-4654-b060-c4784a54bd75 tempest-GroupsV314Test-235906422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:08:39 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1aa13bee-0554-4654-b060-c4784a54bd75 tempest-GroupsV314Test-235906422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:08:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1aa13bee-0554-4654-b060-c4784a54bd75 tempest-GroupsV314Test-235906422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:08:39 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1aa13bee-0554-4654-b060-c4784a54bd75 tempest-GroupsV314Test-235906422 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:08:39 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-1aa13bee-0554-4654-b060-c4784a54bd75 tempest-GroupsV314Test-235906422 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:08:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1aa13bee-0554-4654-b060-c4784a54bd75 tempest-GroupsV314Test-235906422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:39 devstack sudo[94138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66 1073741824
Nov 06 17:08:39 devstack sudo[94138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:39 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8b856f2c-763b-49a5-ad29-eb0d487dc6a3 tempest-VolumesTestJSON-1688072124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (932ee6d7-0619-4b52-b5cc-b49ac118c499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9698277-fdc3-41ce-a575-9931eb711f67', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:39 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8b856f2c-763b-49a5-ad29-eb0d487dc6a3 tempest-VolumesTestJSON-1688072124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d704d977-5721-4637-9d70-9afc91d4dc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:39 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-8b856f2c-763b-49a5-ad29-eb0d487dc6a3 tempest-VolumesTestJSON-1688072124 None] Volume volume-f9698277-fdc3-41ce-a575-9931eb711f67 (f9698277-fdc3-41ce-a575-9931eb711f67): created successfully
Nov 06 17:08:39 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8b856f2c-763b-49a5-ad29-eb0d487dc6a3 tempest-VolumesTestJSON-1688072124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d704d977-5721-4637-9d70-9afc91d4dc8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:39 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8b856f2c-763b-49a5-ad29-eb0d487dc6a3 tempest-VolumesTestJSON-1688072124 None] Flow 'volume_create_manager' (a21ca778-7879-4aea-a161-b0d1ae2e47a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:08:39 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-8b856f2c-763b-49a5-ad29-eb0d487dc6a3 tempest-VolumesTestJSON-1688072124 None] Created volume successfully.
Nov 06 17:08:39 devstack sudo[94138]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1aa13bee-0554-4654-b060-c4784a54bd75 tempest-GroupsV314Test-235906422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66 1073741824" returned: 0 in 0.680s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1aa13bee-0554-4654-b060-c4784a54bd75 tempest-GroupsV314Test-235906422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:40 devstack sudo[94171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66
Nov 06 17:08:40 devstack sudo[94171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:40 devstack sudo[94171]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1aa13bee-0554-4654-b060-c4784a54bd75 tempest-GroupsV314Test-235906422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66" returned: 0 in 0.396s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:40 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1aa13bee-0554-4654-b060-c4784a54bd75 tempest-GroupsV314Test-235906422 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:08:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1aa13bee-0554-4654-b060-c4784a54bd75 tempest-GroupsV314Test-235906422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:08:40 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1aa13bee-0554-4654-b060-c4784a54bd75 tempest-GroupsV314Test-235906422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d231850d-bcf5-4763-b3df-9153469dd2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00eb8914-32f1-40e0-9af2-a14ff6876e66', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:40 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1aa13bee-0554-4654-b060-c4784a54bd75 tempest-GroupsV314Test-235906422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14ba80ad-3e16-47f2-96e5-f0fb244dba5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:40 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-1aa13bee-0554-4654-b060-c4784a54bd75 tempest-GroupsV314Test-235906422 None] Volume volume-00eb8914-32f1-40e0-9af2-a14ff6876e66 (00eb8914-32f1-40e0-9af2-a14ff6876e66): created successfully
Nov 06 17:08:40 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1aa13bee-0554-4654-b060-c4784a54bd75 tempest-GroupsV314Test-235906422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14ba80ad-3e16-47f2-96e5-f0fb244dba5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:40 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1aa13bee-0554-4654-b060-c4784a54bd75 tempest-GroupsV314Test-235906422 None] Flow 'volume_create_manager' (f5d2c32e-ab3e-49fe-8051-0f1237360f4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:08:40 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-1aa13bee-0554-4654-b060-c4784a54bd75 tempest-GroupsV314Test-235906422 None] Created volume successfully.
Nov 06 17:08:40 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2b5d287-9797-4353-8e68-f818bc1bd99f tempest-VolumesTestJSON-1688072124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:08:40 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c2b5d287-9797-4353-8e68-f818bc1bd99f tempest-VolumesTestJSON-1688072124 None] Flow 'volume_create_manager' (7c51ad4d-917d-4a1c-a209-64856473c63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:08:40 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c2b5d287-9797-4353-8e68-f818bc1bd99f tempest-VolumesTestJSON-1688072124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9884b654-3a3b-4dc0-a4fb-e31299b2b537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:40 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c2b5d287-9797-4353-8e68-f818bc1bd99f tempest-VolumesTestJSON-1688072124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9884b654-3a3b-4dc0-a4fb-e31299b2b537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1873981574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ba21b32-fb51-43cf-a835-f775c155acf2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='630ab5b1939f4c3482e24c7f4a10ff23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:08:41Z,use_quota=True,user_id='0f7fcbebcf374febb37875a09a489fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:40 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c2b5d287-9797-4353-8e68-f818bc1bd99f tempest-VolumesTestJSON-1688072124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4491587e-9adb-4952-898f-b76a7ceb4733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:40 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c2b5d287-9797-4353-8e68-f818bc1bd99f tempest-VolumesTestJSON-1688072124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4491587e-9adb-4952-898f-b76a7ceb4733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:40 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c2b5d287-9797-4353-8e68-f818bc1bd99f tempest-VolumesTestJSON-1688072124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f193c7ff-90a3-41f4-9838-4e4872a0e1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:40 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c2b5d287-9797-4353-8e68-f818bc1bd99f tempest-VolumesTestJSON-1688072124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f193c7ff-90a3-41f4-9838-4e4872a0e1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ba21b32-fb51-43cf-a835-f775c155acf2', 'volume_name': 'volume-8ba21b32-fb51-43cf-a835-f775c155acf2', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:40 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c2b5d287-9797-4353-8e68-f818bc1bd99f tempest-VolumesTestJSON-1688072124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e51379cb-5018-43e3-90a7-5ca65874f168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:40 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c2b5d287-9797-4353-8e68-f818bc1bd99f tempest-VolumesTestJSON-1688072124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e51379cb-5018-43e3-90a7-5ca65874f168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:40 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c2b5d287-9797-4353-8e68-f818bc1bd99f tempest-VolumesTestJSON-1688072124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11df23d5-ca8f-46b6-9dff-d125ad5d9037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:40 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-c2b5d287-9797-4353-8e68-f818bc1bd99f tempest-VolumesTestJSON-1688072124 None] Volume 8ba21b32-fb51-43cf-a835-f775c155acf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ba21b32-fb51-43cf-a835-f775c155acf2', 'volume_size': 1}
Nov 06 17:08:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c2b5d287-9797-4353-8e68-f818bc1bd99f tempest-VolumesTestJSON-1688072124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:08:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c2b5d287-9797-4353-8e68-f818bc1bd99f tempest-VolumesTestJSON-1688072124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:08:40 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c2b5d287-9797-4353-8e68-f818bc1bd99f tempest-VolumesTestJSON-1688072124 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1873981574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ba21b32-fb51-43cf-a835-f775c155acf2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='630ab5b1939f4c3482e24c7f4a10ff23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:08:41Z,use_quota=True,user_id='0f7fcbebcf374febb37875a09a489fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:08:40 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-c2b5d287-9797-4353-8e68-f818bc1bd99f tempest-VolumesTestJSON-1688072124 None] Creating volume 8ba21b32-fb51-43cf-a835-f775c155acf2 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:08:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c2b5d287-9797-4353-8e68-f818bc1bd99f tempest-VolumesTestJSON-1688072124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:08:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c2b5d287-9797-4353-8e68-f818bc1bd99f tempest-VolumesTestJSON-1688072124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:08:40 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c2b5d287-9797-4353-8e68-f818bc1bd99f tempest-VolumesTestJSON-1688072124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:08:40 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c2b5d287-9797-4353-8e68-f818bc1bd99f tempest-VolumesTestJSON-1688072124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:08:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c2b5d287-9797-4353-8e68-f818bc1bd99f tempest-VolumesTestJSON-1688072124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:08:40 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c2b5d287-9797-4353-8e68-f818bc1bd99f tempest-VolumesTestJSON-1688072124 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:08:40 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-c2b5d287-9797-4353-8e68-f818bc1bd99f tempest-VolumesTestJSON-1688072124 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:08:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c2b5d287-9797-4353-8e68-f818bc1bd99f tempest-VolumesTestJSON-1688072124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8ba21b32-fb51-43cf-a835-f775c155acf2 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:40 devstack sudo[94174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8ba21b32-fb51-43cf-a835-f775c155acf2 1073741824
Nov 06 17:08:40 devstack sudo[94174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:41 devstack sudo[94174]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c2b5d287-9797-4353-8e68-f818bc1bd99f tempest-VolumesTestJSON-1688072124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8ba21b32-fb51-43cf-a835-f775c155acf2 1073741824" returned: 0 in 0.438s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c2b5d287-9797-4353-8e68-f818bc1bd99f tempest-VolumesTestJSON-1688072124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8ba21b32-fb51-43cf-a835-f775c155acf2 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:41 devstack sudo[94180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8ba21b32-fb51-43cf-a835-f775c155acf2
Nov 06 17:08:41 devstack sudo[94180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:41 devstack sudo[94180]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c2b5d287-9797-4353-8e68-f818bc1bd99f tempest-VolumesTestJSON-1688072124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8ba21b32-fb51-43cf-a835-f775c155acf2" returned: 0 in 0.262s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:41 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c2b5d287-9797-4353-8e68-f818bc1bd99f tempest-VolumesTestJSON-1688072124 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:08:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c2b5d287-9797-4353-8e68-f818bc1bd99f tempest-VolumesTestJSON-1688072124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:08:41 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c2b5d287-9797-4353-8e68-f818bc1bd99f tempest-VolumesTestJSON-1688072124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11df23d5-ca8f-46b6-9dff-d125ad5d9037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ba21b32-fb51-43cf-a835-f775c155acf2', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:41 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c2b5d287-9797-4353-8e68-f818bc1bd99f tempest-VolumesTestJSON-1688072124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (256b6d27-91a2-47f9-b744-67e4514b2dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:41 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-c2b5d287-9797-4353-8e68-f818bc1bd99f tempest-VolumesTestJSON-1688072124 None] Volume volume-8ba21b32-fb51-43cf-a835-f775c155acf2 (8ba21b32-fb51-43cf-a835-f775c155acf2): created successfully
Nov 06 17:08:41 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c2b5d287-9797-4353-8e68-f818bc1bd99f tempest-VolumesTestJSON-1688072124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (256b6d27-91a2-47f9-b744-67e4514b2dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:41 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c2b5d287-9797-4353-8e68-f818bc1bd99f tempest-VolumesTestJSON-1688072124 None] Flow 'volume_create_manager' (7c51ad4d-917d-4a1c-a209-64856473c63e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:08:41 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-c2b5d287-9797-4353-8e68-f818bc1bd99f tempest-VolumesTestJSON-1688072124 None] Created volume successfully.
Nov 06 17:08:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:08:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:08:42 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] Cloning volume 00eb8914-32f1-40e0-9af2-a14ff6876e66 to volume b6a9ccd7-30b7-4e5e-88e9-b854ec6a8b5c
Nov 06 17:08:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] Creating offline snapshot da3e4eb8-aece-49ff-ac7e-9277b6f352b1 of volume 00eb8914-32f1-40e0-9af2-a14ff6876e66 {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:08:42 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[79925613-6b32-46aa-b2b9-49a570e99a0a]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:08:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:42 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:08:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:08:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:08:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:08:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:08:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:08:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:42 devstack sudo[94184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:08:42 devstack sudo[94184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:42 devstack sudo[94183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66
Nov 06 17:08:42 devstack sudo[94183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:43 devstack sudo[94184]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.542s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:43 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:08:43 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager._thread_info {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:08:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread count: 28 {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 17:08:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread info: [<_MainThread(MainThread, started 125183137599616)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125183027608256)>, <Thread(Thread-3 (stat_writer), started daemon 125183025243776)>, <Thread(Rabbit-heartbeat, started daemon 125183023512896)>, <Thread(Thread-5 (_runner), started daemon 125183023357120)>, <Thread(Thread-7 (_runner), started daemon 125183021306496)>, <Thread(fd_logger, started daemon 125183018711616)>, <Thread(privsep_reader, started daemon 125183017484224)>, <Thread(tpool_thread_0, started daemon 125183013742272)>, <Thread(tpool_thread_1, started daemon 125183005349568)>, <Thread(tpool_thread_2, started daemon 125182996956864)>, <Thread(tpool_thread_3, started daemon 125182988564160)>, <Thread(tpool_thread_4, started daemon 125182980171456)>, <Thread(tpool_thread_5, started daemon 125182971778752)>, <Thread(tpool_thread_6, started daemon 125182963386048)>, <Thread(tpool_thread_7, started daemon 125182954993344)>, <Thread(tpool_thread_8, started daemon 125182946600640)>, <Thread(tpool_thread_9, started daemon 125182938207936)>, <Thread(tpool_thread_10, started daemon 125182929815232)>, <Thread(tpool_thread_11, started daemon 125182921422528)>, <Thread(tpool_thread_12, started daemon 125182913013440)>, <Thread(tpool_thread_13, started daemon 125182904604352)>, <Thread(tpool_thread_14, started daemon 125182896195264)>, <Thread(tpool_thread_15, started daemon 125182887786176)>, <Thread(tpool_thread_16, started daemon 125182879377088)>, <Thread(tpool_thread_17, started daemon 125182870968000)>, <Thread(tpool_thread_18, started daemon 125182862558912)>, <Thread(tpool_thread_19, started daemon 125182854149824)>] {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 17:08:43 devstack sudo[94183]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66" returned: 0 in 0.693s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66.da3e4eb8-aece-49ff-ac7e-9277b6f352b1 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:43 devstack sudo[94191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66.da3e4eb8-aece-49ff-ac7e-9277b6f352b1 1G
Nov 06 17:08:43 devstack sudo[94191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:43 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c14b3c8-194a-4e6a-841d-03022f7ff5c2 tempest-ServersNegativeTestJSON-1121676809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:08:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0c14b3c8-194a-4e6a-841d-03022f7ff5c2 tempest-ServersNegativeTestJSON-1121676809 None] Flow 'volume_create_manager' (e0791943-f5f9-4867-9387-9e841c19868a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:08:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0c14b3c8-194a-4e6a-841d-03022f7ff5c2 tempest-ServersNegativeTestJSON-1121676809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6596063-ce8f-4803-a8d4-4f76ac5f7276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0c14b3c8-194a-4e6a-841d-03022f7ff5c2 tempest-ServersNegativeTestJSON-1121676809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6596063-ce8f-4803-a8d4-4f76ac5f7276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-383927925',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=572b04ce-3c93-4609-abc4-ccdbc00e22c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ae5a000eeb9474ea67e1b94e421487a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:08:43Z,use_quota=True,user_id='5014d18e523f45c2ab2a0c7008697d84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0c14b3c8-194a-4e6a-841d-03022f7ff5c2 tempest-ServersNegativeTestJSON-1121676809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee6f6e1a-5337-4a34-a99a-21c3652999de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0c14b3c8-194a-4e6a-841d-03022f7ff5c2 tempest-ServersNegativeTestJSON-1121676809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee6f6e1a-5337-4a34-a99a-21c3652999de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0c14b3c8-194a-4e6a-841d-03022f7ff5c2 tempest-ServersNegativeTestJSON-1121676809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cfc246d-4e9e-4292-bd16-19f984552555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0c14b3c8-194a-4e6a-841d-03022f7ff5c2 tempest-ServersNegativeTestJSON-1121676809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cfc246d-4e9e-4292-bd16-19f984552555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '572b04ce-3c93-4609-abc4-ccdbc00e22c8', 'volume_name': 'volume-572b04ce-3c93-4609-abc4-ccdbc00e22c8', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0c14b3c8-194a-4e6a-841d-03022f7ff5c2 tempest-ServersNegativeTestJSON-1121676809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be0cf97c-a80c-405e-bacd-e2a67fe01574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0c14b3c8-194a-4e6a-841d-03022f7ff5c2 tempest-ServersNegativeTestJSON-1121676809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be0cf97c-a80c-405e-bacd-e2a67fe01574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0c14b3c8-194a-4e6a-841d-03022f7ff5c2 tempest-ServersNegativeTestJSON-1121676809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d29eb9-7d2d-403b-95c1-c8df9ab4c3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:43 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-0c14b3c8-194a-4e6a-841d-03022f7ff5c2 tempest-ServersNegativeTestJSON-1121676809 None] Volume 572b04ce-3c93-4609-abc4-ccdbc00e22c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-572b04ce-3c93-4609-abc4-ccdbc00e22c8', 'volume_size': 1}
Nov 06 17:08:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0c14b3c8-194a-4e6a-841d-03022f7ff5c2 tempest-ServersNegativeTestJSON-1121676809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:08:43 devstack sudo[94191]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66.da3e4eb8-aece-49ff-ac7e-9277b6f352b1 1G" returned: 0 in 0.685s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00eb8914-32f1-40e0-9af2-a14ff6876e66 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66.da3e4eb8-aece-49ff-ac7e-9277b6f352b1 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:43 devstack sudo[94196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00eb8914-32f1-40e0-9af2-a14ff6876e66 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66.da3e4eb8-aece-49ff-ac7e-9277b6f352b1
Nov 06 17:08:43 devstack sudo[94196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:44 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-690281a8-7c27-4ab0-8c48-c752d1f1afc9 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:08:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-690281a8-7c27-4ab0-8c48-c752d1f1afc9 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Flow 'volume_create_manager' (f7e5693e-09da-4c94-8275-c6ee99cb33d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:08:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-690281a8-7c27-4ab0-8c48-c752d1f1afc9 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5d50901-54ca-4d75-92f2-f69e4f1f77c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-690281a8-7c27-4ab0-8c48-c752d1f1afc9 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5d50901-54ca-4d75-92f2-f69e4f1f77c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1499456871',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27142f40-ac63-40e9-8a10-fc2c80699228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aabf1ebcd4e14cc9913f5bddf8dd6600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:08:44Z,use_quota=True,user_id='5603e89380fd44dfb204831b9ce3b736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-690281a8-7c27-4ab0-8c48-c752d1f1afc9 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (842907c1-9526-40f8-bb38-08328283aeaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-690281a8-7c27-4ab0-8c48-c752d1f1afc9 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (842907c1-9526-40f8-bb38-08328283aeaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-690281a8-7c27-4ab0-8c48-c752d1f1afc9 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db7cc40-96b8-4645-80c5-83fe878e1ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-690281a8-7c27-4ab0-8c48-c752d1f1afc9 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db7cc40-96b8-4645-80c5-83fe878e1ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27142f40-ac63-40e9-8a10-fc2c80699228', 'volume_name': 'volume-27142f40-ac63-40e9-8a10-fc2c80699228', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-690281a8-7c27-4ab0-8c48-c752d1f1afc9 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6ae4916-b68e-4066-888b-7e929b15a6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-690281a8-7c27-4ab0-8c48-c752d1f1afc9 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6ae4916-b68e-4066-888b-7e929b15a6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-690281a8-7c27-4ab0-8c48-c752d1f1afc9 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a2edf0-cb01-44f2-93c9-318bce1c56ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:44 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-690281a8-7c27-4ab0-8c48-c752d1f1afc9 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Volume 27142f40-ac63-40e9-8a10-fc2c80699228: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27142f40-ac63-40e9-8a10-fc2c80699228', 'volume_size': 1}
Nov 06 17:08:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-690281a8-7c27-4ab0-8c48-c752d1f1afc9 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:08:44 devstack sudo[94196]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00eb8914-32f1-40e0-9af2-a14ff6876e66 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66.da3e4eb8-aece-49ff-ac7e-9277b6f352b1" returned: 0 in 0.382s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:44 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66.da3e4eb8-aece-49ff-ac7e-9277b6f352b1 is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 17:08:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66.da3e4eb8-aece-49ff-ac7e-9277b6f352b1 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:44 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0224ab5-40f6-491b-af1f-7d38e003d9c6 tempest-VolumesTestJSON-1688072124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:08:44 devstack sudo[94202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66.da3e4eb8-aece-49ff-ac7e-9277b6f352b1
Nov 06 17:08:44 devstack sudo[94202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d0224ab5-40f6-491b-af1f-7d38e003d9c6 tempest-VolumesTestJSON-1688072124 None] Flow 'volume_create_manager' (c2310a63-d2f7-4cc8-947d-2c61a7e0be5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:08:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d0224ab5-40f6-491b-af1f-7d38e003d9c6 tempest-VolumesTestJSON-1688072124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cfe2517-3626-47b0-a70e-e17398d9c60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d0224ab5-40f6-491b-af1f-7d38e003d9c6 tempest-VolumesTestJSON-1688072124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cfe2517-3626-47b0-a70e-e17398d9c60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-522993420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaa4b113-ac44-4213-8bc4-45dd6a4a5071,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='630ab5b1939f4c3482e24c7f4a10ff23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:08:44Z,use_quota=True,user_id='0f7fcbebcf374febb37875a09a489fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d0224ab5-40f6-491b-af1f-7d38e003d9c6 tempest-VolumesTestJSON-1688072124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9340d828-fe85-4e62-a6c2-3923b4e5edc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d0224ab5-40f6-491b-af1f-7d38e003d9c6 tempest-VolumesTestJSON-1688072124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9340d828-fe85-4e62-a6c2-3923b4e5edc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d0224ab5-40f6-491b-af1f-7d38e003d9c6 tempest-VolumesTestJSON-1688072124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f89fff4-7db0-4312-b340-6c50c24ec2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d0224ab5-40f6-491b-af1f-7d38e003d9c6 tempest-VolumesTestJSON-1688072124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f89fff4-7db0-4312-b340-6c50c24ec2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaa4b113-ac44-4213-8bc4-45dd6a4a5071', 'volume_name': 'volume-eaa4b113-ac44-4213-8bc4-45dd6a4a5071', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d0224ab5-40f6-491b-af1f-7d38e003d9c6 tempest-VolumesTestJSON-1688072124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcc53ffd-5cf2-4097-ba95-bed60670a12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d0224ab5-40f6-491b-af1f-7d38e003d9c6 tempest-VolumesTestJSON-1688072124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcc53ffd-5cf2-4097-ba95-bed60670a12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d0224ab5-40f6-491b-af1f-7d38e003d9c6 tempest-VolumesTestJSON-1688072124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc6e219-9245-4d66-ac3d-2f33bd3e9a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:44 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-d0224ab5-40f6-491b-af1f-7d38e003d9c6 tempest-VolumesTestJSON-1688072124 None] Volume eaa4b113-ac44-4213-8bc4-45dd6a4a5071: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaa4b113-ac44-4213-8bc4-45dd6a4a5071', 'volume_size': 1}
Nov 06 17:08:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d0224ab5-40f6-491b-af1f-7d38e003d9c6 tempest-VolumesTestJSON-1688072124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:08:44 devstack sudo[94202]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66.da3e4eb8-aece-49ff-ac7e-9277b6f352b1" returned: 0 in 0.266s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:44 devstack sudo[94211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66.info
Nov 06 17:08:44 devstack sudo[94211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:44 devstack sudo[94211]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66.info" returned: 0 in 0.267s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:44 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 17:08:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:44 devstack sudo[94214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66.info
Nov 06 17:08:44 devstack sudo[94214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:45 devstack sudo[94214]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66.info" returned: 0 in 0.241s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:45 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] Acquiring lock "cinder-quobyte-b6a9ccd7-30b7-4e5e-88e9-b854ec6a8b5c" by "_copy_volume_from_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:08:45 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] Lock "cinder-quobyte-b6a9ccd7-30b7-4e5e-88e9-b854ec6a8b5c" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:08:45 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] snapshot: da3e4eb8-aece-49ff-ac7e-9277b6f352b1, volume: b6a9ccd7-30b7-4e5e-88e9-b854ec6a8b5c,  {{(pid=86856) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 06 17:08:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:08:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:08:45 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:08:45 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:08:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:08:45 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[73be750c-fc16-4439-a752-31dfbf21efd9]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:08:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66.da3e4eb8-aece-49ff-ac7e-9277b6f352b1 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:45 devstack sudo[94217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66.da3e4eb8-aece-49ff-ac7e-9277b6f352b1
Nov 06 17:08:45 devstack sudo[94217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:45 devstack sudo[94217]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66.da3e4eb8-aece-49ff-ac7e-9277b6f352b1" returned: 0 in 0.364s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:45 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00eb8914-32f1-40e0-9af2-a14ff6876e66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:08:45 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb66a8a-7c94-4d7f-ab0e-f4a087267df4]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:08:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:45 devstack sudo[94222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66
Nov 06 17:08:45 devstack sudo[94222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:45 devstack sudo[94222]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66" returned: 0 in 0.356s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:45 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66 {{(pid=86856) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 06 17:08:45 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] Creating direct copy from snapshot {{(pid=86856) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 06 17:08:45 devstack cinder-volume[86856]: DEBUG cinder.utils [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] Path /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b6a9ccd7-30b7-4e5e-88e9-b854ec6a8b5c not found in is_blk_device check {{(pid=86856) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 06 17:08:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b6a9ccd7-30b7-4e5e-88e9-b854ec6a8b5c {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:45 devstack sudo[94227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b6a9ccd7-30b7-4e5e-88e9-b854ec6a8b5c
Nov 06 17:08:45 devstack sudo[94227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:52 devstack sudo[94227]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b6a9ccd7-30b7-4e5e-88e9-b854ec6a8b5c" returned: 0 in 6.342s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:52 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] Image conversion details: src /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66, size 1024.00 MB, duration 6.34 sec, destination /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b6a9ccd7-30b7-4e5e-88e9-b854ec6a8b5c {{(pid=86856) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 17:08:52 devstack cinder-volume[86856]: INFO cinder.image.image_utils [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] Converted 1024.00 MB image at 161.44 MB/s
Nov 06 17:08:52 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b6a9ccd7-30b7-4e5e-88e9-b854ec6a8b5c is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 17:08:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b6a9ccd7-30b7-4e5e-88e9-b854ec6a8b5c {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:52 devstack sudo[94256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b6a9ccd7-30b7-4e5e-88e9-b854ec6a8b5c
Nov 06 17:08:52 devstack sudo[94256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:52 devstack sudo[94256]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b6a9ccd7-30b7-4e5e-88e9-b854ec6a8b5c" returned: 0 in 0.258s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:52 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] Lock "cinder-quobyte-b6a9ccd7-30b7-4e5e-88e9-b854ec6a8b5c" released by "_copy_volume_from_snapshot" :: held 7.390s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:08:52 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] Acquiring lock "cinder-quobyte-da3e4eb8-aece-49ff-ac7e-9277b6f352b1" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:08:52 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] Lock "cinder-quobyte-da3e4eb8-aece-49ff-ac7e-9277b6f352b1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:08:52 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] Deleting offline snapshot da3e4eb8-aece-49ff-ac7e-9277b6f352b1 of volume 00eb8914-32f1-40e0-9af2-a14ff6876e66 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:08:52 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] snapshot_file for this snap is: volume-00eb8914-32f1-40e0-9af2-a14ff6876e66.da3e4eb8-aece-49ff-ac7e-9277b6f352b1 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:08:52 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5330a98-c4b9-4676-9fcd-1ade615a94ba]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:08:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66.da3e4eb8-aece-49ff-ac7e-9277b6f352b1 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:52 devstack sudo[94259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66.da3e4eb8-aece-49ff-ac7e-9277b6f352b1
Nov 06 17:08:52 devstack sudo[94259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:52 devstack sudo[94259]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66.da3e4eb8-aece-49ff-ac7e-9277b6f352b1" returned: 0 in 0.357s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:52 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00eb8914-32f1-40e0-9af2-a14ff6876e66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:08:52 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b752ca4-6a2c-4503-b1ee-2549f30ed1dc]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:08:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:53 devstack sudo[94264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66
Nov 06 17:08:53 devstack sudo[94264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:53 devstack sudo[94264]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66" returned: 0 in 0.511s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66.da3e4eb8-aece-49ff-ac7e-9277b6f352b1 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:53 devstack sudo[94269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66.da3e4eb8-aece-49ff-ac7e-9277b6f352b1
Nov 06 17:08:53 devstack sudo[94269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:53 devstack sudo[94269]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66.da3e4eb8-aece-49ff-ac7e-9277b6f352b1" returned: 0 in 0.332s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66.da3e4eb8-aece-49ff-ac7e-9277b6f352b1 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:53 devstack sudo[94274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66.da3e4eb8-aece-49ff-ac7e-9277b6f352b1
Nov 06 17:08:53 devstack sudo[94274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:53 devstack sudo[94274]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66.da3e4eb8-aece-49ff-ac7e-9277b6f352b1" returned: 0 in 0.241s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:54 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] Lock "cinder-quobyte-da3e4eb8-aece-49ff-ac7e-9277b6f352b1" released by "_delete_snapshot" :: held 1.537s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:08:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.672s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:08:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0c14b3c8-194a-4e6a-841d-03022f7ff5c2 tempest-ServersNegativeTestJSON-1121676809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.715s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:08:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0c14b3c8-194a-4e6a-841d-03022f7ff5c2 tempest-ServersNegativeTestJSON-1121676809 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-383927925',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=572b04ce-3c93-4609-abc4-ccdbc00e22c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ae5a000eeb9474ea67e1b94e421487a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:08:43Z,use_quota=True,user_id='5014d18e523f45c2ab2a0c7008697d84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:08:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-0c14b3c8-194a-4e6a-841d-03022f7ff5c2 tempest-ServersNegativeTestJSON-1121676809 None] Creating volume 572b04ce-3c93-4609-abc4-ccdbc00e22c8 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:08:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0c14b3c8-194a-4e6a-841d-03022f7ff5c2 tempest-ServersNegativeTestJSON-1121676809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:08:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0c14b3c8-194a-4e6a-841d-03022f7ff5c2 tempest-ServersNegativeTestJSON-1121676809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:08:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0c14b3c8-194a-4e6a-841d-03022f7ff5c2 tempest-ServersNegativeTestJSON-1121676809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:08:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0c14b3c8-194a-4e6a-841d-03022f7ff5c2 tempest-ServersNegativeTestJSON-1121676809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:08:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0c14b3c8-194a-4e6a-841d-03022f7ff5c2 tempest-ServersNegativeTestJSON-1121676809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:08:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0c14b3c8-194a-4e6a-841d-03022f7ff5c2 tempest-ServersNegativeTestJSON-1121676809 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:08:54 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-0c14b3c8-194a-4e6a-841d-03022f7ff5c2 tempest-ServersNegativeTestJSON-1121676809 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:08:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0c14b3c8-194a-4e6a-841d-03022f7ff5c2 tempest-ServersNegativeTestJSON-1121676809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-572b04ce-3c93-4609-abc4-ccdbc00e22c8 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:54 devstack sudo[94277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-572b04ce-3c93-4609-abc4-ccdbc00e22c8 1073741824
Nov 06 17:08:54 devstack sudo[94277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:54 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-6bef2d28-a9b4-4b08-be95-0d1b38a6e147 tempest-GroupsV314Test-235906422 None] Create group from source-group-e21304a8-1b7b-4a64-b6f7-85c8cea16dec completed successfully.
Nov 06 17:08:54 devstack sudo[94277]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0c14b3c8-194a-4e6a-841d-03022f7ff5c2 tempest-ServersNegativeTestJSON-1121676809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-572b04ce-3c93-4609-abc4-ccdbc00e22c8 1073741824" returned: 0 in 0.449s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0c14b3c8-194a-4e6a-841d-03022f7ff5c2 tempest-ServersNegativeTestJSON-1121676809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-572b04ce-3c93-4609-abc4-ccdbc00e22c8 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:54 devstack sudo[94283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-572b04ce-3c93-4609-abc4-ccdbc00e22c8
Nov 06 17:08:54 devstack sudo[94283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:54 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-01552f8e-46b5-4c61-a8f9-501f840d717f tempest-GroupsV314Test-235906422 None] Acquiring lock "cinder-quobyte-b6a9ccd7-30b7-4e5e-88e9-b854ec6a8b5c" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:08:54 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-01552f8e-46b5-4c61-a8f9-501f840d717f tempest-GroupsV314Test-235906422 None] Lock "cinder-quobyte-b6a9ccd7-30b7-4e5e-88e9-b854ec6a8b5c" acquired by "delete_volume" :: waited 0.017s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:08:54 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[255c3e22-3bb2-433c-ac91-aecc88c8086c]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:08:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-01552f8e-46b5-4c61-a8f9-501f840d717f tempest-GroupsV314Test-235906422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b6a9ccd7-30b7-4e5e-88e9-b854ec6a8b5c {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:54 devstack sudo[94283]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0c14b3c8-194a-4e6a-841d-03022f7ff5c2 tempest-ServersNegativeTestJSON-1121676809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-572b04ce-3c93-4609-abc4-ccdbc00e22c8" returned: 0 in 0.268s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0c14b3c8-194a-4e6a-841d-03022f7ff5c2 tempest-ServersNegativeTestJSON-1121676809 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:08:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0c14b3c8-194a-4e6a-841d-03022f7ff5c2 tempest-ServersNegativeTestJSON-1121676809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:08:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-690281a8-7c27-4ab0-8c48-c752d1f1afc9 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.612s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:08:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-690281a8-7c27-4ab0-8c48-c752d1f1afc9 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1499456871',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27142f40-ac63-40e9-8a10-fc2c80699228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aabf1ebcd4e14cc9913f5bddf8dd6600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:08:44Z,use_quota=True,user_id='5603e89380fd44dfb204831b9ce3b736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:08:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-690281a8-7c27-4ab0-8c48-c752d1f1afc9 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Creating volume 27142f40-ac63-40e9-8a10-fc2c80699228 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:08:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-690281a8-7c27-4ab0-8c48-c752d1f1afc9 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:08:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-690281a8-7c27-4ab0-8c48-c752d1f1afc9 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:08:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-690281a8-7c27-4ab0-8c48-c752d1f1afc9 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:08:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-690281a8-7c27-4ab0-8c48-c752d1f1afc9 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:08:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-690281a8-7c27-4ab0-8c48-c752d1f1afc9 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:08:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-690281a8-7c27-4ab0-8c48-c752d1f1afc9 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:08:54 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-690281a8-7c27-4ab0-8c48-c752d1f1afc9 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:08:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-690281a8-7c27-4ab0-8c48-c752d1f1afc9 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-27142f40-ac63-40e9-8a10-fc2c80699228 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:54 devstack sudo[94285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b6a9ccd7-30b7-4e5e-88e9-b854ec6a8b5c
Nov 06 17:08:54 devstack sudo[94285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0c14b3c8-194a-4e6a-841d-03022f7ff5c2 tempest-ServersNegativeTestJSON-1121676809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d29eb9-7d2d-403b-95c1-c8df9ab4c3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-572b04ce-3c93-4609-abc4-ccdbc00e22c8', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:54 devstack sudo[94287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-27142f40-ac63-40e9-8a10-fc2c80699228 1073741824
Nov 06 17:08:54 devstack sudo[94287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0c14b3c8-194a-4e6a-841d-03022f7ff5c2 tempest-ServersNegativeTestJSON-1121676809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15025a0b-812f-4200-a557-189b3b021a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:54 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-0c14b3c8-194a-4e6a-841d-03022f7ff5c2 tempest-ServersNegativeTestJSON-1121676809 None] Volume volume-572b04ce-3c93-4609-abc4-ccdbc00e22c8 (572b04ce-3c93-4609-abc4-ccdbc00e22c8): created successfully
Nov 06 17:08:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0c14b3c8-194a-4e6a-841d-03022f7ff5c2 tempest-ServersNegativeTestJSON-1121676809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15025a0b-812f-4200-a557-189b3b021a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0c14b3c8-194a-4e6a-841d-03022f7ff5c2 tempest-ServersNegativeTestJSON-1121676809 None] Flow 'volume_create_manager' (e0791943-f5f9-4867-9387-9e841c19868a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:08:54 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-0c14b3c8-194a-4e6a-841d-03022f7ff5c2 tempest-ServersNegativeTestJSON-1121676809 None] Created volume successfully.
Nov 06 17:08:55 devstack sudo[94285]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-01552f8e-46b5-4c61-a8f9-501f840d717f tempest-GroupsV314Test-235906422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b6a9ccd7-30b7-4e5e-88e9-b854ec6a8b5c" returned: 0 in 0.438s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-01552f8e-46b5-4c61-a8f9-501f840d717f tempest-GroupsV314Test-235906422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b6a9ccd7-30b7-4e5e-88e9-b854ec6a8b5c {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:55 devstack sudo[94296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b6a9ccd7-30b7-4e5e-88e9-b854ec6a8b5c
Nov 06 17:08:55 devstack sudo[94296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:55 devstack sudo[94287]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-690281a8-7c27-4ab0-8c48-c752d1f1afc9 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-27142f40-ac63-40e9-8a10-fc2c80699228 1073741824" returned: 0 in 0.496s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-690281a8-7c27-4ab0-8c48-c752d1f1afc9 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-27142f40-ac63-40e9-8a10-fc2c80699228 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:55 devstack sudo[94299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-27142f40-ac63-40e9-8a10-fc2c80699228
Nov 06 17:08:55 devstack sudo[94299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:55 devstack sudo[94296]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-01552f8e-46b5-4c61-a8f9-501f840d717f tempest-GroupsV314Test-235906422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b6a9ccd7-30b7-4e5e-88e9-b854ec6a8b5c" returned: 0 in 0.290s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:55 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-01552f8e-46b5-4c61-a8f9-501f840d717f tempest-GroupsV314Test-235906422 None] Lock "cinder-quobyte-b6a9ccd7-30b7-4e5e-88e9-b854ec6a8b5c" released by "delete_volume" :: held 0.786s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:08:55 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-01552f8e-46b5-4c61-a8f9-501f840d717f tempest-GroupsV314Test-235906422 None] Created reservations ['7a3c4fc2-f5fb-4ce6-8046-8d4c8188b39c'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:08:55 devstack cinder-volume[86856]: WARNING cinder.quota [None req-01552f8e-46b5-4c61-a8f9-501f840d717f tempest-GroupsV314Test-235906422 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-108965221 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-108965221, it is now deprecated. Please use the default quota class for default quota.
Nov 06 17:08:55 devstack cinder-volume[86856]: WARNING cinder.quota [None req-01552f8e-46b5-4c61-a8f9-501f840d717f tempest-GroupsV314Test-235906422 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-108965221 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-108965221, it is now deprecated. Please use the default quota class for default quota.
Nov 06 17:08:55 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-01552f8e-46b5-4c61-a8f9-501f840d717f tempest-GroupsV314Test-235906422 None] Created reservations ['bc55e64c-97e2-477c-92f5-6f3c9f80a1ff', '6c13dad6-54b0-47ee-9ce1-4977fba60b83', 'dd86cd05-3e19-41f8-a531-bd595253341b', '6b4e54db-59ca-40ea-a9ba-2335d635c12f'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:08:55 devstack sudo[94299]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-690281a8-7c27-4ab0-8c48-c752d1f1afc9 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-27142f40-ac63-40e9-8a10-fc2c80699228" returned: 0 in 0.281s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:55 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-690281a8-7c27-4ab0-8c48-c752d1f1afc9 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:08:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-690281a8-7c27-4ab0-8c48-c752d1f1afc9 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:08:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d0224ab5-40f6-491b-af1f-7d38e003d9c6 tempest-VolumesTestJSON-1688072124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.335s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:08:55 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d0224ab5-40f6-491b-af1f-7d38e003d9c6 tempest-VolumesTestJSON-1688072124 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-522993420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaa4b113-ac44-4213-8bc4-45dd6a4a5071,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='630ab5b1939f4c3482e24c7f4a10ff23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:08:44Z,use_quota=True,user_id='0f7fcbebcf374febb37875a09a489fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:08:55 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-d0224ab5-40f6-491b-af1f-7d38e003d9c6 tempest-VolumesTestJSON-1688072124 None] Creating volume eaa4b113-ac44-4213-8bc4-45dd6a4a5071 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:08:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d0224ab5-40f6-491b-af1f-7d38e003d9c6 tempest-VolumesTestJSON-1688072124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:08:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d0224ab5-40f6-491b-af1f-7d38e003d9c6 tempest-VolumesTestJSON-1688072124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:08:55 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d0224ab5-40f6-491b-af1f-7d38e003d9c6 tempest-VolumesTestJSON-1688072124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:08:55 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d0224ab5-40f6-491b-af1f-7d38e003d9c6 tempest-VolumesTestJSON-1688072124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:08:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d0224ab5-40f6-491b-af1f-7d38e003d9c6 tempest-VolumesTestJSON-1688072124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:08:55 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d0224ab5-40f6-491b-af1f-7d38e003d9c6 tempest-VolumesTestJSON-1688072124 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:08:55 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-d0224ab5-40f6-491b-af1f-7d38e003d9c6 tempest-VolumesTestJSON-1688072124 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:08:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d0224ab5-40f6-491b-af1f-7d38e003d9c6 tempest-VolumesTestJSON-1688072124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-eaa4b113-ac44-4213-8bc4-45dd6a4a5071 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:55 devstack sudo[94303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-eaa4b113-ac44-4213-8bc4-45dd6a4a5071 1073741824
Nov 06 17:08:55 devstack sudo[94303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-690281a8-7c27-4ab0-8c48-c752d1f1afc9 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a2edf0-cb01-44f2-93c9-318bce1c56ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27142f40-ac63-40e9-8a10-fc2c80699228', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-690281a8-7c27-4ab0-8c48-c752d1f1afc9 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bdcd040-9f6a-4925-aa96-20d4ea2fc4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:55 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-690281a8-7c27-4ab0-8c48-c752d1f1afc9 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Volume volume-27142f40-ac63-40e9-8a10-fc2c80699228 (27142f40-ac63-40e9-8a10-fc2c80699228): created successfully
Nov 06 17:08:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-690281a8-7c27-4ab0-8c48-c752d1f1afc9 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bdcd040-9f6a-4925-aa96-20d4ea2fc4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-690281a8-7c27-4ab0-8c48-c752d1f1afc9 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Flow 'volume_create_manager' (f7e5693e-09da-4c94-8275-c6ee99cb33d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:08:55 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-690281a8-7c27-4ab0-8c48-c752d1f1afc9 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Created volume successfully.
Nov 06 17:08:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-01552f8e-46b5-4c61-a8f9-501f840d717f tempest-GroupsV314Test-235906422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:08:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-01552f8e-46b5-4c61-a8f9-501f840d717f tempest-GroupsV314Test-235906422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:08:55 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-01552f8e-46b5-4c61-a8f9-501f840d717f tempest-GroupsV314Test-235906422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:08:55 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-01552f8e-46b5-4c61-a8f9-501f840d717f tempest-GroupsV314Test-235906422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:08:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-01552f8e-46b5-4c61-a8f9-501f840d717f tempest-GroupsV314Test-235906422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:08:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-01552f8e-46b5-4c61-a8f9-501f840d717f tempest-GroupsV314Test-235906422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:55 devstack sudo[94305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:08:55 devstack sudo[94305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:56 devstack sudo[94305]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-01552f8e-46b5-4c61-a8f9-501f840d717f tempest-GroupsV314Test-235906422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.362s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:56 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-01552f8e-46b5-4c61-a8f9-501f840d717f tempest-GroupsV314Test-235906422 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:08:56 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-01552f8e-46b5-4c61-a8f9-501f840d717f tempest-GroupsV314Test-235906422 None] Delete group completed successfully.
Nov 06 17:08:56 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f678859f-daac-4ef6-beab-5856c8ee90cf tempest-GroupsV314Test-235906422 None] Acquiring lock "cinder-quobyte-00eb8914-32f1-40e0-9af2-a14ff6876e66" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:08:56 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f678859f-daac-4ef6-beab-5856c8ee90cf tempest-GroupsV314Test-235906422 None] Lock "cinder-quobyte-00eb8914-32f1-40e0-9af2-a14ff6876e66" acquired by "delete_volume" :: waited 0.022s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:08:56 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7ae7a3-396d-4ce4-937b-dbb1e25ed9e9]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:08:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f678859f-daac-4ef6-beab-5856c8ee90cf tempest-GroupsV314Test-235906422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:56 devstack sudo[94303]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d0224ab5-40f6-491b-af1f-7d38e003d9c6 tempest-VolumesTestJSON-1688072124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-eaa4b113-ac44-4213-8bc4-45dd6a4a5071 1073741824" returned: 0 in 0.590s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d0224ab5-40f6-491b-af1f-7d38e003d9c6 tempest-VolumesTestJSON-1688072124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-eaa4b113-ac44-4213-8bc4-45dd6a4a5071 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:56 devstack sudo[94314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-eaa4b113-ac44-4213-8bc4-45dd6a4a5071
Nov 06 17:08:56 devstack sudo[94314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:56 devstack sudo[94313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66
Nov 06 17:08:56 devstack sudo[94313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:56 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f3d69ba-b673-4e5c-8a1b-87713204e82e tempest-ServersNegativeTestJSON-1121676809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:08:56 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f3d69ba-b673-4e5c-8a1b-87713204e82e tempest-ServersNegativeTestJSON-1121676809 None] Flow 'volume_create_manager' (9ec49b13-1005-4218-877f-2523f8528998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:08:56 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f3d69ba-b673-4e5c-8a1b-87713204e82e tempest-ServersNegativeTestJSON-1121676809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5c6cd8f-897b-4e48-9dc6-c63afc89bc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:56 devstack sudo[94314]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:56 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f3d69ba-b673-4e5c-8a1b-87713204e82e tempest-ServersNegativeTestJSON-1121676809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5c6cd8f-897b-4e48-9dc6-c63afc89bc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1745596541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba334e32-c339-407c-b59c-97c911c98009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ae5a000eeb9474ea67e1b94e421487a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:08:56Z,use_quota=True,user_id='5014d18e523f45c2ab2a0c7008697d84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:56 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f3d69ba-b673-4e5c-8a1b-87713204e82e tempest-ServersNegativeTestJSON-1121676809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b511b99-712b-437d-9209-d97f0453aa2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:56 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f3d69ba-b673-4e5c-8a1b-87713204e82e tempest-ServersNegativeTestJSON-1121676809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b511b99-712b-437d-9209-d97f0453aa2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:56 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f3d69ba-b673-4e5c-8a1b-87713204e82e tempest-ServersNegativeTestJSON-1121676809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21138d34-4349-436b-8eee-4d146cd80ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:56 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f3d69ba-b673-4e5c-8a1b-87713204e82e tempest-ServersNegativeTestJSON-1121676809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21138d34-4349-436b-8eee-4d146cd80ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba334e32-c339-407c-b59c-97c911c98009', 'volume_name': 'volume-ba334e32-c339-407c-b59c-97c911c98009', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:56 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f3d69ba-b673-4e5c-8a1b-87713204e82e tempest-ServersNegativeTestJSON-1121676809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93acef28-bba1-42cd-80a3-a8bdeba5193e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:56 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f3d69ba-b673-4e5c-8a1b-87713204e82e tempest-ServersNegativeTestJSON-1121676809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93acef28-bba1-42cd-80a3-a8bdeba5193e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:56 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f3d69ba-b673-4e5c-8a1b-87713204e82e tempest-ServersNegativeTestJSON-1121676809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eddf55e2-e673-4ef2-a572-cbd8b47112f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:56 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-4f3d69ba-b673-4e5c-8a1b-87713204e82e tempest-ServersNegativeTestJSON-1121676809 None] Volume ba334e32-c339-407c-b59c-97c911c98009: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba334e32-c339-407c-b59c-97c911c98009', 'volume_size': 1}
Nov 06 17:08:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f3d69ba-b673-4e5c-8a1b-87713204e82e tempest-ServersNegativeTestJSON-1121676809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:08:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d0224ab5-40f6-491b-af1f-7d38e003d9c6 tempest-VolumesTestJSON-1688072124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-eaa4b113-ac44-4213-8bc4-45dd6a4a5071" returned: 0 in 0.331s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:56 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d0224ab5-40f6-491b-af1f-7d38e003d9c6 tempest-VolumesTestJSON-1688072124 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:08:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d0224ab5-40f6-491b-af1f-7d38e003d9c6 tempest-VolumesTestJSON-1688072124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:08:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f3d69ba-b673-4e5c-8a1b-87713204e82e tempest-ServersNegativeTestJSON-1121676809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:08:56 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f3d69ba-b673-4e5c-8a1b-87713204e82e tempest-ServersNegativeTestJSON-1121676809 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1745596541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba334e32-c339-407c-b59c-97c911c98009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ae5a000eeb9474ea67e1b94e421487a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:08:56Z,use_quota=True,user_id='5014d18e523f45c2ab2a0c7008697d84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:08:56 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-4f3d69ba-b673-4e5c-8a1b-87713204e82e tempest-ServersNegativeTestJSON-1121676809 None] Creating volume ba334e32-c339-407c-b59c-97c911c98009 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:08:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f3d69ba-b673-4e5c-8a1b-87713204e82e tempest-ServersNegativeTestJSON-1121676809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:08:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f3d69ba-b673-4e5c-8a1b-87713204e82e tempest-ServersNegativeTestJSON-1121676809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:08:56 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f3d69ba-b673-4e5c-8a1b-87713204e82e tempest-ServersNegativeTestJSON-1121676809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:08:56 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f3d69ba-b673-4e5c-8a1b-87713204e82e tempest-ServersNegativeTestJSON-1121676809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:08:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f3d69ba-b673-4e5c-8a1b-87713204e82e tempest-ServersNegativeTestJSON-1121676809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:08:56 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f3d69ba-b673-4e5c-8a1b-87713204e82e tempest-ServersNegativeTestJSON-1121676809 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:08:56 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-4f3d69ba-b673-4e5c-8a1b-87713204e82e tempest-ServersNegativeTestJSON-1121676809 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:08:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f3d69ba-b673-4e5c-8a1b-87713204e82e tempest-ServersNegativeTestJSON-1121676809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ba334e32-c339-407c-b59c-97c911c98009 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:56 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d0224ab5-40f6-491b-af1f-7d38e003d9c6 tempest-VolumesTestJSON-1688072124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc6e219-9245-4d66-ac3d-2f33bd3e9a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaa4b113-ac44-4213-8bc4-45dd6a4a5071', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:56 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d0224ab5-40f6-491b-af1f-7d38e003d9c6 tempest-VolumesTestJSON-1688072124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4745f098-e8bf-4587-b560-4fd971104bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:56 devstack sudo[94321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ba334e32-c339-407c-b59c-97c911c98009 1073741824
Nov 06 17:08:56 devstack sudo[94321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:56 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-d0224ab5-40f6-491b-af1f-7d38e003d9c6 tempest-VolumesTestJSON-1688072124 None] Volume volume-eaa4b113-ac44-4213-8bc4-45dd6a4a5071 (eaa4b113-ac44-4213-8bc4-45dd6a4a5071): created successfully
Nov 06 17:08:56 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d0224ab5-40f6-491b-af1f-7d38e003d9c6 tempest-VolumesTestJSON-1688072124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4745f098-e8bf-4587-b560-4fd971104bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:56 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d0224ab5-40f6-491b-af1f-7d38e003d9c6 tempest-VolumesTestJSON-1688072124 None] Flow 'volume_create_manager' (c2310a63-d2f7-4cc8-947d-2c61a7e0be5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:08:56 devstack sudo[94313]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f678859f-daac-4ef6-beab-5856c8ee90cf tempest-GroupsV314Test-235906422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66" returned: 0 in 0.498s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f678859f-daac-4ef6-beab-5856c8ee90cf tempest-GroupsV314Test-235906422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:56 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-d0224ab5-40f6-491b-af1f-7d38e003d9c6 tempest-VolumesTestJSON-1688072124 None] Created volume successfully.
Nov 06 17:08:56 devstack sudo[94324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66
Nov 06 17:08:56 devstack sudo[94324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:57 devstack sudo[94324]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f678859f-daac-4ef6-beab-5856c8ee90cf tempest-GroupsV314Test-235906422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-00eb8914-32f1-40e0-9af2-a14ff6876e66" returned: 0 in 0.299s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:57 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f678859f-daac-4ef6-beab-5856c8ee90cf tempest-GroupsV314Test-235906422 None] Lock "cinder-quobyte-00eb8914-32f1-40e0-9af2-a14ff6876e66" released by "delete_volume" :: held 0.879s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:08:57 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-f678859f-daac-4ef6-beab-5856c8ee90cf tempest-GroupsV314Test-235906422 None] Created reservations ['7f0e6d27-3687-4b98-827a-23ac2bb913bf'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:08:57 devstack sudo[94321]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f3d69ba-b673-4e5c-8a1b-87713204e82e tempest-ServersNegativeTestJSON-1121676809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ba334e32-c339-407c-b59c-97c911c98009 1073741824" returned: 0 in 0.568s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:57 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-f678859f-daac-4ef6-beab-5856c8ee90cf tempest-GroupsV314Test-235906422 None] Created reservations ['3d662a05-22b4-444d-9ee8-c1e51234e932', '40f08f9f-fe4e-4d7f-a20d-955605bb85b3', '2a598ef9-6d1b-4279-9714-d5395c7bc899', '8234c1f9-b131-429a-82f9-dbab9ce330b2'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:08:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f3d69ba-b673-4e5c-8a1b-87713204e82e tempest-ServersNegativeTestJSON-1121676809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ba334e32-c339-407c-b59c-97c911c98009 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:57 devstack sudo[94331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ba334e32-c339-407c-b59c-97c911c98009
Nov 06 17:08:57 devstack sudo[94331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f678859f-daac-4ef6-beab-5856c8ee90cf tempest-GroupsV314Test-235906422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:08:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f678859f-daac-4ef6-beab-5856c8ee90cf tempest-GroupsV314Test-235906422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:08:57 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-f678859f-daac-4ef6-beab-5856c8ee90cf tempest-GroupsV314Test-235906422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:08:57 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-f678859f-daac-4ef6-beab-5856c8ee90cf tempest-GroupsV314Test-235906422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:08:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f678859f-daac-4ef6-beab-5856c8ee90cf tempest-GroupsV314Test-235906422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:08:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f678859f-daac-4ef6-beab-5856c8ee90cf tempest-GroupsV314Test-235906422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:57 devstack sudo[94333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:08:57 devstack sudo[94333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:57 devstack sudo[94331]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f3d69ba-b673-4e5c-8a1b-87713204e82e tempest-ServersNegativeTestJSON-1121676809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ba334e32-c339-407c-b59c-97c911c98009" returned: 0 in 0.294s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:57 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f3d69ba-b673-4e5c-8a1b-87713204e82e tempest-ServersNegativeTestJSON-1121676809 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:08:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f3d69ba-b673-4e5c-8a1b-87713204e82e tempest-ServersNegativeTestJSON-1121676809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:08:57 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f3d69ba-b673-4e5c-8a1b-87713204e82e tempest-ServersNegativeTestJSON-1121676809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eddf55e2-e673-4ef2-a572-cbd8b47112f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba334e32-c339-407c-b59c-97c911c98009', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:57 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f3d69ba-b673-4e5c-8a1b-87713204e82e tempest-ServersNegativeTestJSON-1121676809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d38298b9-7a34-445f-9fd7-4c7ca42c6050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:08:57 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-4f3d69ba-b673-4e5c-8a1b-87713204e82e tempest-ServersNegativeTestJSON-1121676809 None] Volume volume-ba334e32-c339-407c-b59c-97c911c98009 (ba334e32-c339-407c-b59c-97c911c98009): created successfully
Nov 06 17:08:57 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f3d69ba-b673-4e5c-8a1b-87713204e82e tempest-ServersNegativeTestJSON-1121676809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d38298b9-7a34-445f-9fd7-4c7ca42c6050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:08:57 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f3d69ba-b673-4e5c-8a1b-87713204e82e tempest-ServersNegativeTestJSON-1121676809 None] Flow 'volume_create_manager' (9ec49b13-1005-4218-877f-2523f8528998) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:08:57 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-4f3d69ba-b673-4e5c-8a1b-87713204e82e tempest-ServersNegativeTestJSON-1121676809 None] Created volume successfully.
Nov 06 17:08:57 devstack sudo[94333]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f678859f-daac-4ef6-beab-5856c8ee90cf tempest-GroupsV314Test-235906422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.340s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:57 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-f678859f-daac-4ef6-beab-5856c8ee90cf tempest-GroupsV314Test-235906422 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:08:57 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-f678859f-daac-4ef6-beab-5856c8ee90cf tempest-GroupsV314Test-235906422 None] Delete group completed successfully.
Nov 06 17:08:58 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-92528d83-5bf3-4b6b-bd00-6cab6c2ce1dc tempest-VolumesTestJSON-1688072124 None] Acquiring lock "cinder-eaa4b113-ac44-4213-8bc4-45dd6a4a5071-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:08:58 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-92528d83-5bf3-4b6b-bd00-6cab6c2ce1dc tempest-VolumesTestJSON-1688072124 None] Lock "cinder-eaa4b113-ac44-4213-8bc4-45dd6a4a5071-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:08:58 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bce94b9f-9d12-4e32-9a30-c81a1472b695 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Acquiring lock "cinder-27142f40-ac63-40e9-8a10-fc2c80699228-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:08:58 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-92528d83-5bf3-4b6b-bd00-6cab6c2ce1dc tempest-VolumesTestJSON-1688072124 None] Acquiring lock "cinder-quobyte-eaa4b113-ac44-4213-8bc4-45dd6a4a5071" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:08:58 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bce94b9f-9d12-4e32-9a30-c81a1472b695 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Lock "cinder-27142f40-ac63-40e9-8a10-fc2c80699228-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:08:58 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-92528d83-5bf3-4b6b-bd00-6cab6c2ce1dc tempest-VolumesTestJSON-1688072124 None] Lock "cinder-quobyte-eaa4b113-ac44-4213-8bc4-45dd6a4a5071" acquired by "delete_volume" :: waited 0.034s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:08:58 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bce94b9f-9d12-4e32-9a30-c81a1472b695 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Acquiring lock "cinder-quobyte-27142f40-ac63-40e9-8a10-fc2c80699228" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:08:58 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[422fa122-b0db-4af8-a250-48382ad56b70]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:08:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-92528d83-5bf3-4b6b-bd00-6cab6c2ce1dc tempest-VolumesTestJSON-1688072124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-eaa4b113-ac44-4213-8bc4-45dd6a4a5071 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:58 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bce94b9f-9d12-4e32-9a30-c81a1472b695 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Lock "cinder-quobyte-27142f40-ac63-40e9-8a10-fc2c80699228" acquired by "delete_volume" :: waited 0.032s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:08:58 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5f2aac-d2c3-4e6c-a338-b3b70ba42353]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:08:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bce94b9f-9d12-4e32-9a30-c81a1472b695 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-27142f40-ac63-40e9-8a10-fc2c80699228 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:58 devstack sudo[94337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-eaa4b113-ac44-4213-8bc4-45dd6a4a5071
Nov 06 17:08:58 devstack sudo[94337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:58 devstack sudo[94338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-27142f40-ac63-40e9-8a10-fc2c80699228
Nov 06 17:08:58 devstack sudo[94338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:58 devstack sudo[94337]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-92528d83-5bf3-4b6b-bd00-6cab6c2ce1dc tempest-VolumesTestJSON-1688072124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-eaa4b113-ac44-4213-8bc4-45dd6a4a5071" returned: 0 in 0.438s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-92528d83-5bf3-4b6b-bd00-6cab6c2ce1dc tempest-VolumesTestJSON-1688072124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-eaa4b113-ac44-4213-8bc4-45dd6a4a5071 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:58 devstack sudo[94347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-eaa4b113-ac44-4213-8bc4-45dd6a4a5071
Nov 06 17:08:58 devstack sudo[94347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:58 devstack sudo[94338]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bce94b9f-9d12-4e32-9a30-c81a1472b695 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-27142f40-ac63-40e9-8a10-fc2c80699228" returned: 0 in 0.438s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bce94b9f-9d12-4e32-9a30-c81a1472b695 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-27142f40-ac63-40e9-8a10-fc2c80699228 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:58 devstack sudo[94349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-27142f40-ac63-40e9-8a10-fc2c80699228
Nov 06 17:08:58 devstack sudo[94349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:59 devstack sudo[94347]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-92528d83-5bf3-4b6b-bd00-6cab6c2ce1dc tempest-VolumesTestJSON-1688072124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-eaa4b113-ac44-4213-8bc4-45dd6a4a5071" returned: 0 in 0.319s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:59 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-92528d83-5bf3-4b6b-bd00-6cab6c2ce1dc tempest-VolumesTestJSON-1688072124 None] Lock "cinder-quobyte-eaa4b113-ac44-4213-8bc4-45dd6a4a5071" released by "delete_volume" :: held 0.827s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:08:59 devstack sudo[94349]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bce94b9f-9d12-4e32-9a30-c81a1472b695 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-27142f40-ac63-40e9-8a10-fc2c80699228" returned: 0 in 0.311s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:59 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bce94b9f-9d12-4e32-9a30-c81a1472b695 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Lock "cinder-quobyte-27142f40-ac63-40e9-8a10-fc2c80699228" released by "delete_volume" :: held 0.811s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:08:59 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-92528d83-5bf3-4b6b-bd00-6cab6c2ce1dc tempest-VolumesTestJSON-1688072124 None] Created reservations ['bdad93da-4efc-4843-8f00-967b6938fea5', '90f09593-a2d9-47c9-90fa-84da44bdf6a1', '4939aa1e-036d-4bdf-b185-1a1b14449074', '61f80af4-1271-4051-bf0f-b5671330d18f'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:08:59 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-bce94b9f-9d12-4e32-9a30-c81a1472b695 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Created reservations ['415bdbc3-906d-4676-87bf-2491f76add4a', '5243f7c3-60c0-4fa5-a839-bba231a16a65', '7fe20947-240a-4c78-9149-5dd996394a36', '27fb9430-18e1-483b-9915-b5759fb23c61'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:08:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-92528d83-5bf3-4b6b-bd00-6cab6c2ce1dc tempest-VolumesTestJSON-1688072124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:08:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-92528d83-5bf3-4b6b-bd00-6cab6c2ce1dc tempest-VolumesTestJSON-1688072124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:08:59 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-92528d83-5bf3-4b6b-bd00-6cab6c2ce1dc tempest-VolumesTestJSON-1688072124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:08:59 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-92528d83-5bf3-4b6b-bd00-6cab6c2ce1dc tempest-VolumesTestJSON-1688072124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:08:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-92528d83-5bf3-4b6b-bd00-6cab6c2ce1dc tempest-VolumesTestJSON-1688072124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:08:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-92528d83-5bf3-4b6b-bd00-6cab6c2ce1dc tempest-VolumesTestJSON-1688072124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:59 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-0b8ed87b-db99-4f58-9fa7-a49a83562ff2 tempest-ServersNegativeTestJSON-1121676809 None] Acquiring lock "cinder-ba334e32-c339-407c-b59c-97c911c98009-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:08:59 devstack sudo[94353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:08:59 devstack sudo[94353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:59 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-0b8ed87b-db99-4f58-9fa7-a49a83562ff2 tempest-ServersNegativeTestJSON-1121676809 None] Lock "cinder-ba334e32-c339-407c-b59c-97c911c98009-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:08:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bce94b9f-9d12-4e32-9a30-c81a1472b695 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:08:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bce94b9f-9d12-4e32-9a30-c81a1472b695 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:08:59 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bce94b9f-9d12-4e32-9a30-c81a1472b695 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:08:59 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bce94b9f-9d12-4e32-9a30-c81a1472b695 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:08:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bce94b9f-9d12-4e32-9a30-c81a1472b695 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:08:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bce94b9f-9d12-4e32-9a30-c81a1472b695 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:59 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-42adb700-8b88-4751-8f9a-6227a31e8ee6 tempest-VolumesTestJSON-1688072124 None] Acquiring lock "cinder-8ba21b32-fb51-43cf-a835-f775c155acf2-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:08:59 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-42adb700-8b88-4751-8f9a-6227a31e8ee6 tempest-VolumesTestJSON-1688072124 None] Lock "cinder-8ba21b32-fb51-43cf-a835-f775c155acf2-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:08:59 devstack sudo[94355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:08:59 devstack sudo[94355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:59 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-0b8ed87b-db99-4f58-9fa7-a49a83562ff2 tempest-ServersNegativeTestJSON-1121676809 None] Acquiring lock "cinder-quobyte-ba334e32-c339-407c-b59c-97c911c98009" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:08:59 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-42adb700-8b88-4751-8f9a-6227a31e8ee6 tempest-VolumesTestJSON-1688072124 None] Acquiring lock "cinder-quobyte-8ba21b32-fb51-43cf-a835-f775c155acf2" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:08:59 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-0b8ed87b-db99-4f58-9fa7-a49a83562ff2 tempest-ServersNegativeTestJSON-1121676809 None] Lock "cinder-quobyte-ba334e32-c339-407c-b59c-97c911c98009" acquired by "delete_volume" :: waited 0.071s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:08:59 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-42adb700-8b88-4751-8f9a-6227a31e8ee6 tempest-VolumesTestJSON-1688072124 None] Lock "cinder-quobyte-8ba21b32-fb51-43cf-a835-f775c155acf2" acquired by "delete_volume" :: waited 0.055s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:08:59 devstack sudo[94353]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:59 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[db59d7c0-ab69-4d6b-96a3-dadab76b25c8]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:08:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0b8ed87b-db99-4f58-9fa7-a49a83562ff2 tempest-ServersNegativeTestJSON-1121676809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ba334e32-c339-407c-b59c-97c911c98009 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:59 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c13dc0d-7302-4272-aae1-d7809bf0af4b]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:08:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-42adb700-8b88-4751-8f9a-6227a31e8ee6 tempest-VolumesTestJSON-1688072124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8ba21b32-fb51-43cf-a835-f775c155acf2 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:08:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-92528d83-5bf3-4b6b-bd00-6cab6c2ce1dc tempest-VolumesTestJSON-1688072124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.463s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:59 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-92528d83-5bf3-4b6b-bd00-6cab6c2ce1dc tempest-VolumesTestJSON-1688072124 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:08:59 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-92528d83-5bf3-4b6b-bd00-6cab6c2ce1dc tempest-VolumesTestJSON-1688072124 None] Deleted volume successfully.
Nov 06 17:08:59 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-92528d83-5bf3-4b6b-bd00-6cab6c2ce1dc tempest-VolumesTestJSON-1688072124 None] Lock "cinder-eaa4b113-ac44-4213-8bc4-45dd6a4a5071-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:08:59 devstack sudo[94355]: pam_unix(sudo:session): session closed for user root
Nov 06 17:08:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bce94b9f-9d12-4e32-9a30-c81a1472b695 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.445s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:08:59 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-bce94b9f-9d12-4e32-9a30-c81a1472b695 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:08:59 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-bce94b9f-9d12-4e32-9a30-c81a1472b695 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Deleted volume successfully.
Nov 06 17:08:59 devstack sudo[94359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ba334e32-c339-407c-b59c-97c911c98009
Nov 06 17:08:59 devstack sudo[94359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:08:59 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bce94b9f-9d12-4e32-9a30-c81a1472b695 tempest-VolumeQuotasNegativeTestJSON-1215034759 None] Lock "cinder-27142f40-ac63-40e9-8a10-fc2c80699228-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:09:00 devstack sudo[94360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8ba21b32-fb51-43cf-a835-f775c155acf2
Nov 06 17:09:00 devstack sudo[94360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:00 devstack sudo[94359]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0b8ed87b-db99-4f58-9fa7-a49a83562ff2 tempest-ServersNegativeTestJSON-1121676809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ba334e32-c339-407c-b59c-97c911c98009" returned: 0 in 0.522s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0b8ed87b-db99-4f58-9fa7-a49a83562ff2 tempest-ServersNegativeTestJSON-1121676809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ba334e32-c339-407c-b59c-97c911c98009 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:00 devstack sudo[94369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ba334e32-c339-407c-b59c-97c911c98009
Nov 06 17:09:00 devstack sudo[94369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:00 devstack sudo[94360]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-42adb700-8b88-4751-8f9a-6227a31e8ee6 tempest-VolumesTestJSON-1688072124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8ba21b32-fb51-43cf-a835-f775c155acf2" returned: 0 in 0.583s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-42adb700-8b88-4751-8f9a-6227a31e8ee6 tempest-VolumesTestJSON-1688072124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8ba21b32-fb51-43cf-a835-f775c155acf2 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:00 devstack sudo[94372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8ba21b32-fb51-43cf-a835-f775c155acf2
Nov 06 17:09:00 devstack sudo[94372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:00 devstack sudo[94369]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0b8ed87b-db99-4f58-9fa7-a49a83562ff2 tempest-ServersNegativeTestJSON-1121676809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ba334e32-c339-407c-b59c-97c911c98009" returned: 0 in 0.330s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:00 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-0b8ed87b-db99-4f58-9fa7-a49a83562ff2 tempest-ServersNegativeTestJSON-1121676809 None] Lock "cinder-quobyte-ba334e32-c339-407c-b59c-97c911c98009" released by "delete_volume" :: held 0.961s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:09:00 devstack sudo[94372]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-42adb700-8b88-4751-8f9a-6227a31e8ee6 tempest-VolumesTestJSON-1688072124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8ba21b32-fb51-43cf-a835-f775c155acf2" returned: 0 in 0.338s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:00 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-42adb700-8b88-4751-8f9a-6227a31e8ee6 tempest-VolumesTestJSON-1688072124 None] Lock "cinder-quobyte-8ba21b32-fb51-43cf-a835-f775c155acf2" released by "delete_volume" :: held 1.013s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:09:00 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-0b8ed87b-db99-4f58-9fa7-a49a83562ff2 tempest-ServersNegativeTestJSON-1121676809 None] Created reservations ['5075410d-b369-47b2-8375-4daa4c0d7cd7', '20768105-b0e4-4283-839b-63ece440f7d3', '72f1023e-c18a-44aa-beec-4f4ae6e187cf', 'e24060af-674e-4a05-b9d8-9882d3c78f0c'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:09:00 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-42adb700-8b88-4751-8f9a-6227a31e8ee6 tempest-VolumesTestJSON-1688072124 None] Created reservations ['f5e32041-8071-4f0e-a7b2-e8ffce7c2068', '64f6207a-a061-4b0f-b705-a631d239057d', '9265b82d-2d09-4005-a1a0-0ed77a3205e4', '9d202604-9507-4229-9b4f-ab79a43a5790'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:09:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0b8ed87b-db99-4f58-9fa7-a49a83562ff2 tempest-ServersNegativeTestJSON-1121676809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:09:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0b8ed87b-db99-4f58-9fa7-a49a83562ff2 tempest-ServersNegativeTestJSON-1121676809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:09:00 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0b8ed87b-db99-4f58-9fa7-a49a83562ff2 tempest-ServersNegativeTestJSON-1121676809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:09:00 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0b8ed87b-db99-4f58-9fa7-a49a83562ff2 tempest-ServersNegativeTestJSON-1121676809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:09:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0b8ed87b-db99-4f58-9fa7-a49a83562ff2 tempest-ServersNegativeTestJSON-1121676809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:09:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0b8ed87b-db99-4f58-9fa7-a49a83562ff2 tempest-ServersNegativeTestJSON-1121676809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:00 devstack sudo[94376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:09:00 devstack sudo[94376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-42adb700-8b88-4751-8f9a-6227a31e8ee6 tempest-VolumesTestJSON-1688072124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:09:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-42adb700-8b88-4751-8f9a-6227a31e8ee6 tempest-VolumesTestJSON-1688072124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:09:00 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-42adb700-8b88-4751-8f9a-6227a31e8ee6 tempest-VolumesTestJSON-1688072124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:09:00 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-42adb700-8b88-4751-8f9a-6227a31e8ee6 tempest-VolumesTestJSON-1688072124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:09:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-42adb700-8b88-4751-8f9a-6227a31e8ee6 tempest-VolumesTestJSON-1688072124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:09:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-42adb700-8b88-4751-8f9a-6227a31e8ee6 tempest-VolumesTestJSON-1688072124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:00 devstack sudo[94379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:09:00 devstack sudo[94379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:01 devstack sudo[94376]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0b8ed87b-db99-4f58-9fa7-a49a83562ff2 tempest-ServersNegativeTestJSON-1121676809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.323s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:01 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-0b8ed87b-db99-4f58-9fa7-a49a83562ff2 tempest-ServersNegativeTestJSON-1121676809 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:09:01 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-0b8ed87b-db99-4f58-9fa7-a49a83562ff2 tempest-ServersNegativeTestJSON-1121676809 None] Deleted volume successfully.
Nov 06 17:09:01 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-0b8ed87b-db99-4f58-9fa7-a49a83562ff2 tempest-ServersNegativeTestJSON-1121676809 None] Lock "cinder-ba334e32-c339-407c-b59c-97c911c98009-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:09:01 devstack sudo[94379]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-42adb700-8b88-4751-8f9a-6227a31e8ee6 tempest-VolumesTestJSON-1688072124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.326s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:01 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-42adb700-8b88-4751-8f9a-6227a31e8ee6 tempest-VolumesTestJSON-1688072124 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:09:01 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-42adb700-8b88-4751-8f9a-6227a31e8ee6 tempest-VolumesTestJSON-1688072124 None] Deleted volume successfully.
Nov 06 17:09:01 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-42adb700-8b88-4751-8f9a-6227a31e8ee6 tempest-VolumesTestJSON-1688072124 None] Lock "cinder-8ba21b32-fb51-43cf-a835-f775c155acf2-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:09:01 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1b2a3f7a-26ae-4244-859d-4a9d1388bbed tempest-ServersNegativeTestJSON-1121676809 None] Acquiring lock "cinder-572b04ce-3c93-4609-abc4-ccdbc00e22c8-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:09:01 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1b2a3f7a-26ae-4244-859d-4a9d1388bbed tempest-ServersNegativeTestJSON-1121676809 None] Lock "cinder-572b04ce-3c93-4609-abc4-ccdbc00e22c8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:09:01 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1b2a3f7a-26ae-4244-859d-4a9d1388bbed tempest-ServersNegativeTestJSON-1121676809 None] Acquiring lock "cinder-quobyte-572b04ce-3c93-4609-abc4-ccdbc00e22c8" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:09:01 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1b2a3f7a-26ae-4244-859d-4a9d1388bbed tempest-ServersNegativeTestJSON-1121676809 None] Lock "cinder-quobyte-572b04ce-3c93-4609-abc4-ccdbc00e22c8" acquired by "delete_volume" :: waited 0.028s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:09:01 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89e25e6-4245-4f57-8a69-54e4a8c199f5]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:09:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1b2a3f7a-26ae-4244-859d-4a9d1388bbed tempest-ServersNegativeTestJSON-1121676809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-572b04ce-3c93-4609-abc4-ccdbc00e22c8 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:01 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-90480f21-a516-4ad7-a6a4-8cc2a4ae6776 tempest-VolumesTestJSON-1688072124 None] Acquiring lock "cinder-f9698277-fdc3-41ce-a575-9931eb711f67-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:09:01 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-90480f21-a516-4ad7-a6a4-8cc2a4ae6776 tempest-VolumesTestJSON-1688072124 None] Lock "cinder-f9698277-fdc3-41ce-a575-9931eb711f67-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:09:02 devstack sudo[94383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-572b04ce-3c93-4609-abc4-ccdbc00e22c8
Nov 06 17:09:02 devstack sudo[94383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:02 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-90480f21-a516-4ad7-a6a4-8cc2a4ae6776 tempest-VolumesTestJSON-1688072124 None] Acquiring lock "cinder-quobyte-f9698277-fdc3-41ce-a575-9931eb711f67" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:09:02 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-90480f21-a516-4ad7-a6a4-8cc2a4ae6776 tempest-VolumesTestJSON-1688072124 None] Lock "cinder-quobyte-f9698277-fdc3-41ce-a575-9931eb711f67" acquired by "delete_volume" :: waited 0.022s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:09:02 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[7177067f-334a-4318-8214-66d1e05b479d]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:09:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-90480f21-a516-4ad7-a6a4-8cc2a4ae6776 tempest-VolumesTestJSON-1688072124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9698277-fdc3-41ce-a575-9931eb711f67 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:02 devstack sudo[94385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9698277-fdc3-41ce-a575-9931eb711f67
Nov 06 17:09:02 devstack sudo[94385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:02 devstack sudo[94383]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1b2a3f7a-26ae-4244-859d-4a9d1388bbed tempest-ServersNegativeTestJSON-1121676809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-572b04ce-3c93-4609-abc4-ccdbc00e22c8" returned: 0 in 0.492s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1b2a3f7a-26ae-4244-859d-4a9d1388bbed tempest-ServersNegativeTestJSON-1121676809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-572b04ce-3c93-4609-abc4-ccdbc00e22c8 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:02 devstack sudo[94390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-572b04ce-3c93-4609-abc4-ccdbc00e22c8
Nov 06 17:09:02 devstack sudo[94390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:02 devstack sudo[94385]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-90480f21-a516-4ad7-a6a4-8cc2a4ae6776 tempest-VolumesTestJSON-1688072124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9698277-fdc3-41ce-a575-9931eb711f67" returned: 0 in 0.481s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-90480f21-a516-4ad7-a6a4-8cc2a4ae6776 tempest-VolumesTestJSON-1688072124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9698277-fdc3-41ce-a575-9931eb711f67 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:02 devstack sudo[94397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9698277-fdc3-41ce-a575-9931eb711f67
Nov 06 17:09:02 devstack sudo[94397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:02 devstack sudo[94390]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1b2a3f7a-26ae-4244-859d-4a9d1388bbed tempest-ServersNegativeTestJSON-1121676809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-572b04ce-3c93-4609-abc4-ccdbc00e22c8" returned: 0 in 0.364s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:02 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1b2a3f7a-26ae-4244-859d-4a9d1388bbed tempest-ServersNegativeTestJSON-1121676809 None] Lock "cinder-quobyte-572b04ce-3c93-4609-abc4-ccdbc00e22c8" released by "delete_volume" :: held 0.923s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:09:02 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-1b2a3f7a-26ae-4244-859d-4a9d1388bbed tempest-ServersNegativeTestJSON-1121676809 None] Created reservations ['bce42278-34b0-45ba-93c1-2575e0a89f2b', '8e7df78b-6122-415f-8d7d-f3f5dc76bc30', '82f6d0db-463c-49be-a7b3-c80c51ba029d', 'bc807185-2749-4e7c-9fa0-ce2c19ce5007'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:09:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1b2a3f7a-26ae-4244-859d-4a9d1388bbed tempest-ServersNegativeTestJSON-1121676809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:09:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1b2a3f7a-26ae-4244-859d-4a9d1388bbed tempest-ServersNegativeTestJSON-1121676809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:09:02 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1b2a3f7a-26ae-4244-859d-4a9d1388bbed tempest-ServersNegativeTestJSON-1121676809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:09:02 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1b2a3f7a-26ae-4244-859d-4a9d1388bbed tempest-ServersNegativeTestJSON-1121676809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:09:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1b2a3f7a-26ae-4244-859d-4a9d1388bbed tempest-ServersNegativeTestJSON-1121676809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:09:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1b2a3f7a-26ae-4244-859d-4a9d1388bbed tempest-ServersNegativeTestJSON-1121676809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:02 devstack sudo[94397]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-90480f21-a516-4ad7-a6a4-8cc2a4ae6776 tempest-VolumesTestJSON-1688072124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9698277-fdc3-41ce-a575-9931eb711f67" returned: 0 in 0.339s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:02 devstack sudo[94400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:09:02 devstack sudo[94400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:02 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-90480f21-a516-4ad7-a6a4-8cc2a4ae6776 tempest-VolumesTestJSON-1688072124 None] Lock "cinder-quobyte-f9698277-fdc3-41ce-a575-9931eb711f67" released by "delete_volume" :: held 0.915s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:09:03 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-90480f21-a516-4ad7-a6a4-8cc2a4ae6776 tempest-VolumesTestJSON-1688072124 None] Created reservations ['d5807ba9-2e88-49a0-9e99-b4649483aad0', 'f0562989-3314-491e-9289-effc9e03529c', '36b2c513-6254-42ff-ac88-c1689bf64fad', 'a2dbfe15-e59e-4bcf-b64c-c07260ac8831'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:09:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-90480f21-a516-4ad7-a6a4-8cc2a4ae6776 tempest-VolumesTestJSON-1688072124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:09:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-90480f21-a516-4ad7-a6a4-8cc2a4ae6776 tempest-VolumesTestJSON-1688072124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:09:03 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-90480f21-a516-4ad7-a6a4-8cc2a4ae6776 tempest-VolumesTestJSON-1688072124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:09:03 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-90480f21-a516-4ad7-a6a4-8cc2a4ae6776 tempest-VolumesTestJSON-1688072124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:09:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-90480f21-a516-4ad7-a6a4-8cc2a4ae6776 tempest-VolumesTestJSON-1688072124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:09:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-90480f21-a516-4ad7-a6a4-8cc2a4ae6776 tempest-VolumesTestJSON-1688072124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:03 devstack sudo[94402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:09:03 devstack sudo[94402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:03 devstack sudo[94400]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1b2a3f7a-26ae-4244-859d-4a9d1388bbed tempest-ServersNegativeTestJSON-1121676809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.490s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:03 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-1b2a3f7a-26ae-4244-859d-4a9d1388bbed tempest-ServersNegativeTestJSON-1121676809 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:09:03 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-1b2a3f7a-26ae-4244-859d-4a9d1388bbed tempest-ServersNegativeTestJSON-1121676809 None] Deleted volume successfully.
Nov 06 17:09:03 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1b2a3f7a-26ae-4244-859d-4a9d1388bbed tempest-ServersNegativeTestJSON-1121676809 None] Lock "cinder-572b04ce-3c93-4609-abc4-ccdbc00e22c8-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:09:03 devstack sudo[94402]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-90480f21-a516-4ad7-a6a4-8cc2a4ae6776 tempest-VolumesTestJSON-1688072124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.364s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:03 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-90480f21-a516-4ad7-a6a4-8cc2a4ae6776 tempest-VolumesTestJSON-1688072124 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:09:03 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-90480f21-a516-4ad7-a6a4-8cc2a4ae6776 tempest-VolumesTestJSON-1688072124 None] Deleted volume successfully.
Nov 06 17:09:03 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-90480f21-a516-4ad7-a6a4-8cc2a4ae6776 tempest-VolumesTestJSON-1688072124 None] Lock "cinder-f9698277-fdc3-41ce-a575-9931eb711f67-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:09:06 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d8af79a-c249-4dd3-88b2-085a04ad5895 tempest-SnapshotsActionsTest-2144663578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:09:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6d8af79a-c249-4dd3-88b2-085a04ad5895 tempest-SnapshotsActionsTest-2144663578 None] Flow 'volume_create_manager' (18ecb482-def0-4257-b671-35836270c6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:09:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6d8af79a-c249-4dd3-88b2-085a04ad5895 tempest-SnapshotsActionsTest-2144663578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cac4238d-a3b6-455a-bfd9-1aa23b3c0716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6d8af79a-c249-4dd3-88b2-085a04ad5895 tempest-SnapshotsActionsTest-2144663578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cac4238d-a3b6-455a-bfd9-1aa23b3c0716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1544118455',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=731c0d83-cea5-4222-8b14-66e27e7b3b48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1083ef22e3044be85f2ebf3115e2026',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:09:07Z,use_quota=True,user_id='ee9b575351754933892b31d10d502e10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6d8af79a-c249-4dd3-88b2-085a04ad5895 tempest-SnapshotsActionsTest-2144663578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (699d3a93-5b36-4973-a188-a6b37ba216d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6d8af79a-c249-4dd3-88b2-085a04ad5895 tempest-SnapshotsActionsTest-2144663578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (699d3a93-5b36-4973-a188-a6b37ba216d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6d8af79a-c249-4dd3-88b2-085a04ad5895 tempest-SnapshotsActionsTest-2144663578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd38283-e263-457a-bda6-123a81685bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6d8af79a-c249-4dd3-88b2-085a04ad5895 tempest-SnapshotsActionsTest-2144663578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd38283-e263-457a-bda6-123a81685bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '731c0d83-cea5-4222-8b14-66e27e7b3b48', 'volume_name': 'volume-731c0d83-cea5-4222-8b14-66e27e7b3b48', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6d8af79a-c249-4dd3-88b2-085a04ad5895 tempest-SnapshotsActionsTest-2144663578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d50da8-36f0-4ef2-9dd1-07412b5a2aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6d8af79a-c249-4dd3-88b2-085a04ad5895 tempest-SnapshotsActionsTest-2144663578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d50da8-36f0-4ef2-9dd1-07412b5a2aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6d8af79a-c249-4dd3-88b2-085a04ad5895 tempest-SnapshotsActionsTest-2144663578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f59bcc7-789c-424a-beac-a2bf02877609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:06 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-6d8af79a-c249-4dd3-88b2-085a04ad5895 tempest-SnapshotsActionsTest-2144663578 None] Volume 731c0d83-cea5-4222-8b14-66e27e7b3b48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-731c0d83-cea5-4222-8b14-66e27e7b3b48', 'volume_size': 1}
Nov 06 17:09:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6d8af79a-c249-4dd3-88b2-085a04ad5895 tempest-SnapshotsActionsTest-2144663578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:09:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6d8af79a-c249-4dd3-88b2-085a04ad5895 tempest-SnapshotsActionsTest-2144663578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:09:06 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-6d8af79a-c249-4dd3-88b2-085a04ad5895 tempest-SnapshotsActionsTest-2144663578 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1544118455',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=731c0d83-cea5-4222-8b14-66e27e7b3b48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1083ef22e3044be85f2ebf3115e2026',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:09:07Z,use_quota=True,user_id='ee9b575351754933892b31d10d502e10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:09:06 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-6d8af79a-c249-4dd3-88b2-085a04ad5895 tempest-SnapshotsActionsTest-2144663578 None] Creating volume 731c0d83-cea5-4222-8b14-66e27e7b3b48 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:09:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6d8af79a-c249-4dd3-88b2-085a04ad5895 tempest-SnapshotsActionsTest-2144663578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:09:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6d8af79a-c249-4dd3-88b2-085a04ad5895 tempest-SnapshotsActionsTest-2144663578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:09:06 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-6d8af79a-c249-4dd3-88b2-085a04ad5895 tempest-SnapshotsActionsTest-2144663578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:09:06 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-6d8af79a-c249-4dd3-88b2-085a04ad5895 tempest-SnapshotsActionsTest-2144663578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:09:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6d8af79a-c249-4dd3-88b2-085a04ad5895 tempest-SnapshotsActionsTest-2144663578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:09:06 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-6d8af79a-c249-4dd3-88b2-085a04ad5895 tempest-SnapshotsActionsTest-2144663578 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:09:06 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-6d8af79a-c249-4dd3-88b2-085a04ad5895 tempest-SnapshotsActionsTest-2144663578 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:09:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6d8af79a-c249-4dd3-88b2-085a04ad5895 tempest-SnapshotsActionsTest-2144663578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:06 devstack sudo[94430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48 1073741824
Nov 06 17:09:06 devstack sudo[94430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:07 devstack sudo[94430]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6d8af79a-c249-4dd3-88b2-085a04ad5895 tempest-SnapshotsActionsTest-2144663578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48 1073741824" returned: 0 in 0.585s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6d8af79a-c249-4dd3-88b2-085a04ad5895 tempest-SnapshotsActionsTest-2144663578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:07 devstack sudo[94436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48
Nov 06 17:09:07 devstack sudo[94436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:07 devstack sudo[94436]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6d8af79a-c249-4dd3-88b2-085a04ad5895 tempest-SnapshotsActionsTest-2144663578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48" returned: 0 in 0.318s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:07 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-6d8af79a-c249-4dd3-88b2-085a04ad5895 tempest-SnapshotsActionsTest-2144663578 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:09:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6d8af79a-c249-4dd3-88b2-085a04ad5895 tempest-SnapshotsActionsTest-2144663578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:09:07 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6d8af79a-c249-4dd3-88b2-085a04ad5895 tempest-SnapshotsActionsTest-2144663578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f59bcc7-789c-424a-beac-a2bf02877609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-731c0d83-cea5-4222-8b14-66e27e7b3b48', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:07 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6d8af79a-c249-4dd3-88b2-085a04ad5895 tempest-SnapshotsActionsTest-2144663578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e0032db-85c5-4846-a5d7-f137206766aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:07 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-6d8af79a-c249-4dd3-88b2-085a04ad5895 tempest-SnapshotsActionsTest-2144663578 None] Volume volume-731c0d83-cea5-4222-8b14-66e27e7b3b48 (731c0d83-cea5-4222-8b14-66e27e7b3b48): created successfully
Nov 06 17:09:07 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6d8af79a-c249-4dd3-88b2-085a04ad5895 tempest-SnapshotsActionsTest-2144663578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e0032db-85c5-4846-a5d7-f137206766aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:07 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6d8af79a-c249-4dd3-88b2-085a04ad5895 tempest-SnapshotsActionsTest-2144663578 None] Flow 'volume_create_manager' (18ecb482-def0-4257-b671-35836270c6ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:09:07 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-6d8af79a-c249-4dd3-88b2-085a04ad5895 tempest-SnapshotsActionsTest-2144663578 None] Created volume successfully.
Nov 06 17:09:08 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-b07c3334-f5b3-4f32-aeb9-ff30008ec74a tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:09:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b07c3334-f5b3-4f32-aeb9-ff30008ec74a tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Flow 'volume_create_manager' (97dc497c-6a98-45d2-9cc3-3a33be51e78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:09:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b07c3334-f5b3-4f32-aeb9-ff30008ec74a tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee59f6dc-46de-4c19-8e59-305266278dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b07c3334-f5b3-4f32-aeb9-ff30008ec74a tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee59f6dc-46de-4c19-8e59-305266278dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-257814300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb22fd69-f3c7-45db-8090-0aae416525ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19433ccd88c548a5bd8b720d80d17aca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:09:09Z,use_quota=True,user_id='520223a4716b44f1b1cdee456bf5f34a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(216e3e49-42fc-4979-8348-b81f71aa897f),volume_type_id=216e3e49-42fc-4979-8348-b81f71aa897f)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b07c3334-f5b3-4f32-aeb9-ff30008ec74a tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8ac7337-918b-452f-bda4-701152e27d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b07c3334-f5b3-4f32-aeb9-ff30008ec74a tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8ac7337-918b-452f-bda4-701152e27d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b07c3334-f5b3-4f32-aeb9-ff30008ec74a tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88328968-bb07-4340-92ef-acd9898603ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b07c3334-f5b3-4f32-aeb9-ff30008ec74a tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88328968-bb07-4340-92ef-acd9898603ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb22fd69-f3c7-45db-8090-0aae416525ff', 'volume_name': 'volume-fb22fd69-f3c7-45db-8090-0aae416525ff', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b07c3334-f5b3-4f32-aeb9-ff30008ec74a tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06826790-b5e0-4c54-a88f-2bf8c83e3d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b07c3334-f5b3-4f32-aeb9-ff30008ec74a tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06826790-b5e0-4c54-a88f-2bf8c83e3d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b07c3334-f5b3-4f32-aeb9-ff30008ec74a tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bc17459-2603-4d52-ad2c-32f7c2b41354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:08 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-b07c3334-f5b3-4f32-aeb9-ff30008ec74a tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Volume fb22fd69-f3c7-45db-8090-0aae416525ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb22fd69-f3c7-45db-8090-0aae416525ff', 'volume_size': 1}
Nov 06 17:09:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b07c3334-f5b3-4f32-aeb9-ff30008ec74a tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:09:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b07c3334-f5b3-4f32-aeb9-ff30008ec74a tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:09:08 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-b07c3334-f5b3-4f32-aeb9-ff30008ec74a tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-257814300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb22fd69-f3c7-45db-8090-0aae416525ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19433ccd88c548a5bd8b720d80d17aca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:09:09Z,use_quota=True,user_id='520223a4716b44f1b1cdee456bf5f34a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(216e3e49-42fc-4979-8348-b81f71aa897f),volume_type_id=216e3e49-42fc-4979-8348-b81f71aa897f)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:09:08 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-b07c3334-f5b3-4f32-aeb9-ff30008ec74a tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Creating volume fb22fd69-f3c7-45db-8090-0aae416525ff {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:09:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b07c3334-f5b3-4f32-aeb9-ff30008ec74a tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:09:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b07c3334-f5b3-4f32-aeb9-ff30008ec74a tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:09:08 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-b07c3334-f5b3-4f32-aeb9-ff30008ec74a tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:09:08 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-b07c3334-f5b3-4f32-aeb9-ff30008ec74a tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:09:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b07c3334-f5b3-4f32-aeb9-ff30008ec74a tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:09:08 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-b07c3334-f5b3-4f32-aeb9-ff30008ec74a tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:09:08 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-b07c3334-f5b3-4f32-aeb9-ff30008ec74a tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:09:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b07c3334-f5b3-4f32-aeb9-ff30008ec74a tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fb22fd69-f3c7-45db-8090-0aae416525ff 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:08 devstack sudo[94439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fb22fd69-f3c7-45db-8090-0aae416525ff 1073741824
Nov 06 17:09:08 devstack sudo[94439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b4a24595-2b52-4d5d-a126-f7b48e175045 tempest-SnapshotsActionsTest-2144663578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:09:09 devstack sudo[94439]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b07c3334-f5b3-4f32-aeb9-ff30008ec74a tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fb22fd69-f3c7-45db-8090-0aae416525ff 1073741824" returned: 0 in 0.594s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b07c3334-f5b3-4f32-aeb9-ff30008ec74a tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fb22fd69-f3c7-45db-8090-0aae416525ff {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:09 devstack sudo[94446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fb22fd69-f3c7-45db-8090-0aae416525ff
Nov 06 17:09:09 devstack sudo[94446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:09 devstack sudo[94446]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b07c3334-f5b3-4f32-aeb9-ff30008ec74a tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fb22fd69-f3c7-45db-8090-0aae416525ff" returned: 0 in 0.279s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:09 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-b07c3334-f5b3-4f32-aeb9-ff30008ec74a tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:09:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b07c3334-f5b3-4f32-aeb9-ff30008ec74a tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:09:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b4a24595-2b52-4d5d-a126-f7b48e175045 tempest-SnapshotsActionsTest-2144663578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.698s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:09:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b07c3334-f5b3-4f32-aeb9-ff30008ec74a tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bc17459-2603-4d52-ad2c-32f7c2b41354) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb22fd69-f3c7-45db-8090-0aae416525ff', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b07c3334-f5b3-4f32-aeb9-ff30008ec74a tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb20688b-82cd-439d-99c1-a4e6d7d2779a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:09 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-b4a24595-2b52-4d5d-a126-f7b48e175045 tempest-SnapshotsActionsTest-2144663578 None] Creating offline snapshot bcf51a63-4349-4985-af62-e27a079ccf49 of volume 731c0d83-cea5-4222-8b14-66e27e7b3b48 {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:09:09 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-b07c3334-f5b3-4f32-aeb9-ff30008ec74a tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Volume volume-fb22fd69-f3c7-45db-8090-0aae416525ff (fb22fd69-f3c7-45db-8090-0aae416525ff): created successfully
Nov 06 17:09:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b07c3334-f5b3-4f32-aeb9-ff30008ec74a tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb20688b-82cd-439d-99c1-a4e6d7d2779a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b07c3334-f5b3-4f32-aeb9-ff30008ec74a tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Flow 'volume_create_manager' (97dc497c-6a98-45d2-9cc3-3a33be51e78f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:09:09 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6913a19-0f46-44fd-b763-656edbbb4082]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:09:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b4a24595-2b52-4d5d-a126-f7b48e175045 tempest-SnapshotsActionsTest-2144663578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:09 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-b07c3334-f5b3-4f32-aeb9-ff30008ec74a tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Created volume successfully.
Nov 06 17:09:10 devstack sudo[94450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48
Nov 06 17:09:10 devstack sudo[94450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:10 devstack sudo[94450]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b4a24595-2b52-4d5d-a126-f7b48e175045 tempest-SnapshotsActionsTest-2144663578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48" returned: 0 in 0.413s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b4a24595-2b52-4d5d-a126-f7b48e175045 tempest-SnapshotsActionsTest-2144663578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:10 devstack sudo[94455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49 1G
Nov 06 17:09:10 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:10 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b4a24595-2b52-4d5d-a126-f7b48e175045 tempest-SnapshotsActionsTest-2144663578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49 1G" returned: 0 in 0.520s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b4a24595-2b52-4d5d-a126-f7b48e175045 tempest-SnapshotsActionsTest-2144663578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-731c0d83-cea5-4222-8b14-66e27e7b3b48 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:10 devstack sudo[94461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-731c0d83-cea5-4222-8b14-66e27e7b3b48 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49
Nov 06 17:09:10 devstack sudo[94461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:11 devstack sudo[94461]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b4a24595-2b52-4d5d-a126-f7b48e175045 tempest-SnapshotsActionsTest-2144663578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-731c0d83-cea5-4222-8b14-66e27e7b3b48 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49" returned: 0 in 0.384s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:11 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-b4a24595-2b52-4d5d-a126-f7b48e175045 tempest-SnapshotsActionsTest-2144663578 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49 is being set with open permissions: ugo+rw
Nov 06 17:09:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b4a24595-2b52-4d5d-a126-f7b48e175045 tempest-SnapshotsActionsTest-2144663578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:11 devstack sudo[94468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49
Nov 06 17:09:11 devstack sudo[94468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-db59c9f6-7e07-4978-8c61-18e79c25faa7 tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:09:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-db59c9f6-7e07-4978-8c61-18e79c25faa7 tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:09:11 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-db59c9f6-7e07-4978-8c61-18e79c25faa7 tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:09:11 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-db59c9f6-7e07-4978-8c61-18e79c25faa7 tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:09:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-db59c9f6-7e07-4978-8c61-18e79c25faa7 tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:09:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-db59c9f6-7e07-4978-8c61-18e79c25faa7 tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:11 devstack sudo[94470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:09:11 devstack sudo[94470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:11 devstack sudo[94468]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b4a24595-2b52-4d5d-a126-f7b48e175045 tempest-SnapshotsActionsTest-2144663578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49" returned: 0 in 0.426s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b4a24595-2b52-4d5d-a126-f7b48e175045 tempest-SnapshotsActionsTest-2144663578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:11 devstack sudo[94474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.info
Nov 06 17:09:11 devstack sudo[94474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:11 devstack sudo[94470]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-db59c9f6-7e07-4978-8c61-18e79c25faa7 tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.432s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:11 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-db59c9f6-7e07-4978-8c61-18e79c25faa7 tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:09:11 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-db59c9f6-7e07-4978-8c61-18e79c25faa7 tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Retype volume completed successfully.
Nov 06 17:09:12 devstack sudo[94474]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b4a24595-2b52-4d5d-a126-f7b48e175045 tempest-SnapshotsActionsTest-2144663578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.info" returned: 0 in 0.288s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:12 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-b4a24595-2b52-4d5d-a126-f7b48e175045 tempest-SnapshotsActionsTest-2144663578 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.info is being set with open permissions: ugo+rw
Nov 06 17:09:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b4a24595-2b52-4d5d-a126-f7b48e175045 tempest-SnapshotsActionsTest-2144663578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:12 devstack sudo[94477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.info
Nov 06 17:09:12 devstack sudo[94477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:12 devstack sudo[94477]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b4a24595-2b52-4d5d-a126-f7b48e175045 tempest-SnapshotsActionsTest-2144663578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.info" returned: 0 in 0.314s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b4a24595-2b52-4d5d-a126-f7b48e175045 tempest-SnapshotsActionsTest-2144663578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.503s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:09:12 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-b4a24595-2b52-4d5d-a126-f7b48e175045 tempest-SnapshotsActionsTest-2144663578 None] Create snapshot completed successfully
Nov 06 17:09:12 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d5c8b8f0-89a9-4e8e-88df-d531c86d516e tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Acquiring lock "cinder-fb22fd69-f3c7-45db-8090-0aae416525ff-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:09:13 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d5c8b8f0-89a9-4e8e-88df-d531c86d516e tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Lock "cinder-fb22fd69-f3c7-45db-8090-0aae416525ff-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:09:13 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d5c8b8f0-89a9-4e8e-88df-d531c86d516e tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Acquiring lock "cinder-quobyte-fb22fd69-f3c7-45db-8090-0aae416525ff" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:09:13 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d5c8b8f0-89a9-4e8e-88df-d531c86d516e tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Lock "cinder-quobyte-fb22fd69-f3c7-45db-8090-0aae416525ff" acquired by "delete_volume" :: waited 0.038s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:09:13 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[153a3e42-ddd7-4b58-a2c7-39e5c50f34b5]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:09:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d5c8b8f0-89a9-4e8e-88df-d531c86d516e tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fb22fd69-f3c7-45db-8090-0aae416525ff {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:13 devstack sudo[94480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fb22fd69-f3c7-45db-8090-0aae416525ff
Nov 06 17:09:13 devstack sudo[94480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:13 devstack sudo[94480]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d5c8b8f0-89a9-4e8e-88df-d531c86d516e tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fb22fd69-f3c7-45db-8090-0aae416525ff" returned: 0 in 0.440s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d5c8b8f0-89a9-4e8e-88df-d531c86d516e tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fb22fd69-f3c7-45db-8090-0aae416525ff {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:13 devstack sudo[94487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fb22fd69-f3c7-45db-8090-0aae416525ff
Nov 06 17:09:13 devstack sudo[94487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:13 devstack sudo[94487]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d5c8b8f0-89a9-4e8e-88df-d531c86d516e tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fb22fd69-f3c7-45db-8090-0aae416525ff" returned: 0 in 0.305s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:13 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d5c8b8f0-89a9-4e8e-88df-d531c86d516e tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Lock "cinder-quobyte-fb22fd69-f3c7-45db-8090-0aae416525ff" released by "delete_volume" :: held 0.816s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:09:13 devstack cinder-volume[86856]: WARNING cinder.quota [None req-d5c8b8f0-89a9-4e8e-88df-d531c86d516e tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 06 17:09:13 devstack cinder-volume[86856]: WARNING cinder.quota [None req-d5c8b8f0-89a9-4e8e-88df-d531c86d516e tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 06 17:09:14 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-d5c8b8f0-89a9-4e8e-88df-d531c86d516e tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Created reservations ['a0f264bc-3561-4567-8730-1246be02dd44', '6246631b-9dcf-4327-9249-65db358cc8e8', '799c6811-fdfd-4c14-8bc2-e262b35c6521', 'f10ddf0b-b7fc-4754-8bc5-da9cbf597800'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:09:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d5c8b8f0-89a9-4e8e-88df-d531c86d516e tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:09:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d5c8b8f0-89a9-4e8e-88df-d531c86d516e tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:09:14 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d5c8b8f0-89a9-4e8e-88df-d531c86d516e tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:09:14 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d5c8b8f0-89a9-4e8e-88df-d531c86d516e tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:09:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d5c8b8f0-89a9-4e8e-88df-d531c86d516e tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:09:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d5c8b8f0-89a9-4e8e-88df-d531c86d516e tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:14 devstack sudo[94490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:09:14 devstack sudo[94490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f1537551-94fc-4fb3-909d-060551f5f540 tempest-SnapshotsActionsTest-2144663578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:09:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f1537551-94fc-4fb3-909d-060551f5f540 tempest-SnapshotsActionsTest-2144663578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:09:14 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-f1537551-94fc-4fb3-909d-060551f5f540 tempest-SnapshotsActionsTest-2144663578 None] Creating offline snapshot 9acc3b7a-61a2-4555-9d26-e028d6bdbd29 of volume 731c0d83-cea5-4222-8b14-66e27e7b3b48 {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:09:14 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab49d9e5-b6d5-441d-9094-5dfb64b7887a]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:09:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f1537551-94fc-4fb3-909d-060551f5f540 tempest-SnapshotsActionsTest-2144663578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:14 devstack sudo[94490]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d5c8b8f0-89a9-4e8e-88df-d531c86d516e tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.379s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:14 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-d5c8b8f0-89a9-4e8e-88df-d531c86d516e tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:09:14 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-d5c8b8f0-89a9-4e8e-88df-d531c86d516e tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Deleted volume successfully.
Nov 06 17:09:14 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d5c8b8f0-89a9-4e8e-88df-d531c86d516e tempest-VolumeRetypeWithoutMigrationTest-2117855814 None] Lock "cinder-fb22fd69-f3c7-45db-8090-0aae416525ff-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:09:14 devstack sudo[94493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49
Nov 06 17:09:14 devstack sudo[94493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:14 devstack sudo[94493]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f1537551-94fc-4fb3-909d-060551f5f540 tempest-SnapshotsActionsTest-2144663578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49" returned: 0 in 0.480s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:14 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-f1537551-94fc-4fb3-909d-060551f5f540 tempest-SnapshotsActionsTest-2144663578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-731c0d83-cea5-4222-8b14-66e27e7b3b48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:09:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f1537551-94fc-4fb3-909d-060551f5f540 tempest-SnapshotsActionsTest-2144663578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.9acc3b7a-61a2-4555-9d26-e028d6bdbd29 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:14 devstack sudo[94498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.9acc3b7a-61a2-4555-9d26-e028d6bdbd29 1G
Nov 06 17:09:14 devstack sudo[94498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:15 devstack sudo[94498]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f1537551-94fc-4fb3-909d-060551f5f540 tempest-SnapshotsActionsTest-2144663578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.9acc3b7a-61a2-4555-9d26-e028d6bdbd29 1G" returned: 0 in 0.524s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f1537551-94fc-4fb3-909d-060551f5f540 tempest-SnapshotsActionsTest-2144663578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.9acc3b7a-61a2-4555-9d26-e028d6bdbd29 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:15 devstack sudo[94503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.9acc3b7a-61a2-4555-9d26-e028d6bdbd29
Nov 06 17:09:15 devstack sudo[94503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:15 devstack sudo[94503]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f1537551-94fc-4fb3-909d-060551f5f540 tempest-SnapshotsActionsTest-2144663578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.9acc3b7a-61a2-4555-9d26-e028d6bdbd29" returned: 0 in 0.356s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:15 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-f1537551-94fc-4fb3-909d-060551f5f540 tempest-SnapshotsActionsTest-2144663578 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.9acc3b7a-61a2-4555-9d26-e028d6bdbd29 is being set with open permissions: ugo+rw
Nov 06 17:09:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f1537551-94fc-4fb3-909d-060551f5f540 tempest-SnapshotsActionsTest-2144663578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.9acc3b7a-61a2-4555-9d26-e028d6bdbd29 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:15 devstack sudo[94513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.9acc3b7a-61a2-4555-9d26-e028d6bdbd29
Nov 06 17:09:15 devstack sudo[94513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:16 devstack sudo[94513]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f1537551-94fc-4fb3-909d-060551f5f540 tempest-SnapshotsActionsTest-2144663578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.9acc3b7a-61a2-4555-9d26-e028d6bdbd29" returned: 0 in 0.262s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f1537551-94fc-4fb3-909d-060551f5f540 tempest-SnapshotsActionsTest-2144663578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.779s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:09:16 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-f1537551-94fc-4fb3-909d-060551f5f540 tempest-SnapshotsActionsTest-2144663578 None] Create snapshot completed successfully
Nov 06 17:09:16 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-dd7f1917-3d80-4684-a4b5-2355c0102966 tempest-SnapshotsActionsTest-1406578492 None] Acquiring lock "cinder-9acc3b7a-61a2-4555-9d26-e028d6bdbd29-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:09:16 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-dd7f1917-3d80-4684-a4b5-2355c0102966 tempest-SnapshotsActionsTest-1406578492 None] Lock "cinder-9acc3b7a-61a2-4555-9d26-e028d6bdbd29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:09:16 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-dd7f1917-3d80-4684-a4b5-2355c0102966 tempest-SnapshotsActionsTest-1406578492 None] Acquiring lock "cinder-quobyte-731c0d83-cea5-4222-8b14-66e27e7b3b48" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:09:16 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-dd7f1917-3d80-4684-a4b5-2355c0102966 tempest-SnapshotsActionsTest-1406578492 None] Lock "cinder-quobyte-731c0d83-cea5-4222-8b14-66e27e7b3b48" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:09:16 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-dd7f1917-3d80-4684-a4b5-2355c0102966 tempest-SnapshotsActionsTest-1406578492 None] Acquiring lock "cinder-quobyte-9acc3b7a-61a2-4555-9d26-e028d6bdbd29" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:09:16 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-dd7f1917-3d80-4684-a4b5-2355c0102966 tempest-SnapshotsActionsTest-1406578492 None] Lock "cinder-quobyte-9acc3b7a-61a2-4555-9d26-e028d6bdbd29" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:09:16 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-dd7f1917-3d80-4684-a4b5-2355c0102966 tempest-SnapshotsActionsTest-1406578492 None] Deleting offline snapshot 9acc3b7a-61a2-4555-9d26-e028d6bdbd29 of volume 731c0d83-cea5-4222-8b14-66e27e7b3b48 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:09:16 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-dd7f1917-3d80-4684-a4b5-2355c0102966 tempest-SnapshotsActionsTest-1406578492 None] snapshot_file for this snap is: volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.9acc3b7a-61a2-4555-9d26-e028d6bdbd29 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:09:16 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[333896f7-2dbd-4f23-b630-dc2ca92d8909]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:09:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-dd7f1917-3d80-4684-a4b5-2355c0102966 tempest-SnapshotsActionsTest-1406578492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.9acc3b7a-61a2-4555-9d26-e028d6bdbd29 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:16 devstack sudo[94516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.9acc3b7a-61a2-4555-9d26-e028d6bdbd29
Nov 06 17:09:16 devstack sudo[94516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:17 devstack sudo[94516]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-dd7f1917-3d80-4684-a4b5-2355c0102966 tempest-SnapshotsActionsTest-1406578492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.9acc3b7a-61a2-4555-9d26-e028d6bdbd29" returned: 0 in 0.462s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:17 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-dd7f1917-3d80-4684-a4b5-2355c0102966 tempest-SnapshotsActionsTest-1406578492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-731c0d83-cea5-4222-8b14-66e27e7b3b48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:09:17 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e649ddd-2743-4efa-bf9f-769991a1cf69]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:09:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-dd7f1917-3d80-4684-a4b5-2355c0102966 tempest-SnapshotsActionsTest-1406578492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:17 devstack sudo[94521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49
Nov 06 17:09:17 devstack sudo[94521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:17 devstack sudo[94521]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-dd7f1917-3d80-4684-a4b5-2355c0102966 tempest-SnapshotsActionsTest-1406578492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49" returned: 0 in 0.437s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:17 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-dd7f1917-3d80-4684-a4b5-2355c0102966 tempest-SnapshotsActionsTest-1406578492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-731c0d83-cea5-4222-8b14-66e27e7b3b48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:09:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-dd7f1917-3d80-4684-a4b5-2355c0102966 tempest-SnapshotsActionsTest-1406578492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.9acc3b7a-61a2-4555-9d26-e028d6bdbd29 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:17 devstack sudo[94527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.9acc3b7a-61a2-4555-9d26-e028d6bdbd29
Nov 06 17:09:17 devstack sudo[94527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:18 devstack sudo[94527]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-dd7f1917-3d80-4684-a4b5-2355c0102966 tempest-SnapshotsActionsTest-1406578492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.9acc3b7a-61a2-4555-9d26-e028d6bdbd29" returned: 0 in 0.561s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-dd7f1917-3d80-4684-a4b5-2355c0102966 tempest-SnapshotsActionsTest-1406578492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.9acc3b7a-61a2-4555-9d26-e028d6bdbd29 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:18 devstack sudo[94535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.9acc3b7a-61a2-4555-9d26-e028d6bdbd29
Nov 06 17:09:18 devstack sudo[94535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:18 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-d5cae64d-3407-4f75-84ae-636d40e3aca2 tempest-GroupsV320Test-1012219400 None] Group tempest-GroupsV320Test-Group-1287108566: creating
Nov 06 17:09:18 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-d5cae64d-3407-4f75-84ae-636d40e3aca2 tempest-GroupsV320Test-1012219400 None] Group tempest-GroupsV320Test-Group-1287108566: created successfully
Nov 06 17:09:18 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-d5cae64d-3407-4f75-84ae-636d40e3aca2 tempest-GroupsV320Test-1012219400 None] Create group completed successfully.
Nov 06 17:09:18 devstack sudo[94535]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-dd7f1917-3d80-4684-a4b5-2355c0102966 tempest-SnapshotsActionsTest-1406578492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.9acc3b7a-61a2-4555-9d26-e028d6bdbd29" returned: 0 in 0.294s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:18 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-dd7f1917-3d80-4684-a4b5-2355c0102966 tempest-SnapshotsActionsTest-1406578492 None] Lock "cinder-quobyte-9acc3b7a-61a2-4555-9d26-e028d6bdbd29" released by "_delete_snapshot" :: held 1.912s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:09:18 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-dd7f1917-3d80-4684-a4b5-2355c0102966 tempest-SnapshotsActionsTest-1406578492 None] Lock "cinder-quobyte-731c0d83-cea5-4222-8b14-66e27e7b3b48" released by "delete_snapshot" :: held 1.940s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:09:18 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-dd7f1917-3d80-4684-a4b5-2355c0102966 tempest-SnapshotsActionsTest-1406578492 None] Created reservations ['6c0b31fa-f2c7-493d-a200-0aac384cc1b6', 'a7514c53-3e06-4a70-9afc-b12a6db72efa', '02aec316-2268-4e67-a2c2-147a6fa986fb', '048699c2-8ad9-4aaa-ae50-c851203cbabb'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:09:18 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-dd7f1917-3d80-4684-a4b5-2355c0102966 tempest-SnapshotsActionsTest-1406578492 None] Delete snapshot completed successfully.
Nov 06 17:09:18 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-dd7f1917-3d80-4684-a4b5-2355c0102966 tempest-SnapshotsActionsTest-1406578492 None] Lock "cinder-9acc3b7a-61a2-4555-9d26-e028d6bdbd29-delete_snapshot" released by "delete_snapshot" :: held 2.118s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:09:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a52019f4-6cf4-4967-8e3b-720a0b08d236 tempest-SnapshotsActionsTest-2144663578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:09:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a52019f4-6cf4-4967-8e3b-720a0b08d236 tempest-SnapshotsActionsTest-2144663578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:09:19 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-a52019f4-6cf4-4967-8e3b-720a0b08d236 tempest-SnapshotsActionsTest-2144663578 None] Creating offline snapshot 7f064993-b2c2-4e4b-863a-9a1a24375c6d of volume 731c0d83-cea5-4222-8b14-66e27e7b3b48 {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:09:19 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c06062d-7705-40d8-87a0-9a468d7f6213]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:09:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a52019f4-6cf4-4967-8e3b-720a0b08d236 tempest-SnapshotsActionsTest-2144663578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:19 devstack sudo[94538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49
Nov 06 17:09:19 devstack sudo[94538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:19 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-763cdd5a-9f11-4b95-aad9-7b882faa3e82 tempest-GroupSnapshotsTest-1647710575 None] Group tempest-GroupSnapshotsTest-Group-1803864176: creating
Nov 06 17:09:19 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-763cdd5a-9f11-4b95-aad9-7b882faa3e82 tempest-GroupSnapshotsTest-1647710575 None] Group tempest-GroupSnapshotsTest-Group-1803864176: created successfully
Nov 06 17:09:19 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-763cdd5a-9f11-4b95-aad9-7b882faa3e82 tempest-GroupSnapshotsTest-1647710575 None] Create group completed successfully.
Nov 06 17:09:19 devstack sudo[94538]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a52019f4-6cf4-4967-8e3b-720a0b08d236 tempest-SnapshotsActionsTest-2144663578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49" returned: 0 in 0.480s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:19 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-a52019f4-6cf4-4967-8e3b-720a0b08d236 tempest-SnapshotsActionsTest-2144663578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-731c0d83-cea5-4222-8b14-66e27e7b3b48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:09:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a52019f4-6cf4-4967-8e3b-720a0b08d236 tempest-SnapshotsActionsTest-2144663578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7f064993-b2c2-4e4b-863a-9a1a24375c6d 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:19 devstack sudo[94544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7f064993-b2c2-4e4b-863a-9a1a24375c6d 1G
Nov 06 17:09:19 devstack sudo[94544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:20 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-0b0093e8-cfa0-4531-8622-dcccf77ca2ef tempest-GroupsV320Test-1012219400 None] Created reservations ['6d4e4428-ef2b-4699-9360-4c4f60258262'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:09:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0b0093e8-cfa0-4531-8622-dcccf77ca2ef tempest-GroupsV320Test-1012219400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:09:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0b0093e8-cfa0-4531-8622-dcccf77ca2ef tempest-GroupsV320Test-1012219400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:09:20 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0b0093e8-cfa0-4531-8622-dcccf77ca2ef tempest-GroupsV320Test-1012219400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:09:20 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0b0093e8-cfa0-4531-8622-dcccf77ca2ef tempest-GroupsV320Test-1012219400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:09:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0b0093e8-cfa0-4531-8622-dcccf77ca2ef tempest-GroupsV320Test-1012219400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:09:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0b0093e8-cfa0-4531-8622-dcccf77ca2ef tempest-GroupsV320Test-1012219400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:20 devstack sudo[94550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:09:20 devstack sudo[94550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:20 devstack sudo[94544]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a52019f4-6cf4-4967-8e3b-720a0b08d236 tempest-SnapshotsActionsTest-2144663578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7f064993-b2c2-4e4b-863a-9a1a24375c6d 1G" returned: 0 in 0.541s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a52019f4-6cf4-4967-8e3b-720a0b08d236 tempest-SnapshotsActionsTest-2144663578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7f064993-b2c2-4e4b-863a-9a1a24375c6d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:20 devstack sudo[94552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7f064993-b2c2-4e4b-863a-9a1a24375c6d
Nov 06 17:09:20 devstack sudo[94552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:20 devstack sudo[94550]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0b0093e8-cfa0-4531-8622-dcccf77ca2ef tempest-GroupsV320Test-1012219400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.268s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:20 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-0b0093e8-cfa0-4531-8622-dcccf77ca2ef tempest-GroupsV320Test-1012219400 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:09:20 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-0b0093e8-cfa0-4531-8622-dcccf77ca2ef tempest-GroupsV320Test-1012219400 None] Delete group completed successfully.
Nov 06 17:09:20 devstack sudo[94552]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a52019f4-6cf4-4967-8e3b-720a0b08d236 tempest-SnapshotsActionsTest-2144663578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7f064993-b2c2-4e4b-863a-9a1a24375c6d" returned: 0 in 0.312s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:20 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-a52019f4-6cf4-4967-8e3b-720a0b08d236 tempest-SnapshotsActionsTest-2144663578 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7f064993-b2c2-4e4b-863a-9a1a24375c6d is being set with open permissions: ugo+rw
Nov 06 17:09:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a52019f4-6cf4-4967-8e3b-720a0b08d236 tempest-SnapshotsActionsTest-2144663578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7f064993-b2c2-4e4b-863a-9a1a24375c6d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:20 devstack sudo[94559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7f064993-b2c2-4e4b-863a-9a1a24375c6d
Nov 06 17:09:20 devstack sudo[94559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:20 devstack sudo[94559]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a52019f4-6cf4-4967-8e3b-720a0b08d236 tempest-SnapshotsActionsTest-2144663578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7f064993-b2c2-4e4b-863a-9a1a24375c6d" returned: 0 in 0.279s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a52019f4-6cf4-4967-8e3b-720a0b08d236 tempest-SnapshotsActionsTest-2144663578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.741s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:09:20 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-a52019f4-6cf4-4967-8e3b-720a0b08d236 tempest-SnapshotsActionsTest-2144663578 None] Create snapshot completed successfully
Nov 06 17:09:21 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-97b5f56f-233a-4402-adec-70fe56cfbdcd tempest-GroupSnapshotsTest-1647710575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:09:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-97b5f56f-233a-4402-adec-70fe56cfbdcd tempest-GroupSnapshotsTest-1647710575 None] Flow 'volume_create_manager' (6753c2f6-27eb-407a-85cd-60bb556142cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:09:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-97b5f56f-233a-4402-adec-70fe56cfbdcd tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7ddae2b-ca71-4792-a29b-afd22f28813c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-97b5f56f-233a-4402-adec-70fe56cfbdcd tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7ddae2b-ca71-4792-a29b-afd22f28813c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1259800591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3c8dcae2-b044-4c86-b698-19f02e36e219,host='devstack@QuobyteHD#QuobyteHD',id=6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dd9c18dca9a4bb599b8d91b0f3816e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:09:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:09:21Z,use_quota=True,user_id='9a4d2f51c3094da4a21a4d29425ef175',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55c5f6bf-d1f9-4c78-b9a1-563efd2bb826),volume_type_id=55c5f6bf-d1f9-4c78-b9a1-563efd2bb826)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-97b5f56f-233a-4402-adec-70fe56cfbdcd tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a9ba72a-3dfe-4c48-861e-af6136618754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-97b5f56f-233a-4402-adec-70fe56cfbdcd tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a9ba72a-3dfe-4c48-861e-af6136618754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-97b5f56f-233a-4402-adec-70fe56cfbdcd tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (730bd1d0-baad-41e6-822e-3ef3429d0560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-97b5f56f-233a-4402-adec-70fe56cfbdcd tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (730bd1d0-baad-41e6-822e-3ef3429d0560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996', 'volume_name': 'volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-97b5f56f-233a-4402-adec-70fe56cfbdcd tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (462c01a2-3d23-446b-8fe1-526dd8609b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-97b5f56f-233a-4402-adec-70fe56cfbdcd tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (462c01a2-3d23-446b-8fe1-526dd8609b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-97b5f56f-233a-4402-adec-70fe56cfbdcd tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b04903-fedb-42b1-9cd8-3c04bb2e8ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:21 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-97b5f56f-233a-4402-adec-70fe56cfbdcd tempest-GroupSnapshotsTest-1647710575 None] Volume 6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996', 'volume_size': 1}
Nov 06 17:09:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-97b5f56f-233a-4402-adec-70fe56cfbdcd tempest-GroupSnapshotsTest-1647710575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:09:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-97b5f56f-233a-4402-adec-70fe56cfbdcd tempest-GroupSnapshotsTest-1647710575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:09:21 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-97b5f56f-233a-4402-adec-70fe56cfbdcd tempest-GroupSnapshotsTest-1647710575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=3c8dcae2-b044-4c86-b698-19f02e36e219,created_at=2026-11-06T16:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1259800591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3c8dcae2-b044-4c86-b698-19f02e36e219,host='devstack@QuobyteHD#QuobyteHD',id=6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dd9c18dca9a4bb599b8d91b0f3816e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:09:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:09:21Z,use_quota=True,user_id='9a4d2f51c3094da4a21a4d29425ef175',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55c5f6bf-d1f9-4c78-b9a1-563efd2bb826),volume_type_id=55c5f6bf-d1f9-4c78-b9a1-563efd2bb826)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:09:21 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-97b5f56f-233a-4402-adec-70fe56cfbdcd tempest-GroupSnapshotsTest-1647710575 None] Creating volume 6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:09:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-97b5f56f-233a-4402-adec-70fe56cfbdcd tempest-GroupSnapshotsTest-1647710575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:09:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-97b5f56f-233a-4402-adec-70fe56cfbdcd tempest-GroupSnapshotsTest-1647710575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:09:21 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-97b5f56f-233a-4402-adec-70fe56cfbdcd tempest-GroupSnapshotsTest-1647710575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:09:21 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-97b5f56f-233a-4402-adec-70fe56cfbdcd tempest-GroupSnapshotsTest-1647710575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:09:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-97b5f56f-233a-4402-adec-70fe56cfbdcd tempest-GroupSnapshotsTest-1647710575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:09:21 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-97b5f56f-233a-4402-adec-70fe56cfbdcd tempest-GroupSnapshotsTest-1647710575 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:09:21 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-97b5f56f-233a-4402-adec-70fe56cfbdcd tempest-GroupSnapshotsTest-1647710575 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:09:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-97b5f56f-233a-4402-adec-70fe56cfbdcd tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:21 devstack sudo[94563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996 1073741824
Nov 06 17:09:21 devstack sudo[94563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:21 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-06ac5db9-a237-42c1-9a93-b322512a20ea tempest-SnapshotsActionsTest-1406578492 None] Acquiring lock "cinder-7f064993-b2c2-4e4b-863a-9a1a24375c6d-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:09:21 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-06ac5db9-a237-42c1-9a93-b322512a20ea tempest-SnapshotsActionsTest-1406578492 None] Lock "cinder-7f064993-b2c2-4e4b-863a-9a1a24375c6d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:09:21 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-06ac5db9-a237-42c1-9a93-b322512a20ea tempest-SnapshotsActionsTest-1406578492 None] Acquiring lock "cinder-quobyte-731c0d83-cea5-4222-8b14-66e27e7b3b48" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:09:21 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-06ac5db9-a237-42c1-9a93-b322512a20ea tempest-SnapshotsActionsTest-1406578492 None] Lock "cinder-quobyte-731c0d83-cea5-4222-8b14-66e27e7b3b48" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:09:21 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-06ac5db9-a237-42c1-9a93-b322512a20ea tempest-SnapshotsActionsTest-1406578492 None] Acquiring lock "cinder-quobyte-7f064993-b2c2-4e4b-863a-9a1a24375c6d" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:09:21 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-06ac5db9-a237-42c1-9a93-b322512a20ea tempest-SnapshotsActionsTest-1406578492 None] Lock "cinder-quobyte-7f064993-b2c2-4e4b-863a-9a1a24375c6d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:09:21 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-06ac5db9-a237-42c1-9a93-b322512a20ea tempest-SnapshotsActionsTest-1406578492 None] Deleting offline snapshot 7f064993-b2c2-4e4b-863a-9a1a24375c6d of volume 731c0d83-cea5-4222-8b14-66e27e7b3b48 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:09:21 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-06ac5db9-a237-42c1-9a93-b322512a20ea tempest-SnapshotsActionsTest-1406578492 None] snapshot_file for this snap is: volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7f064993-b2c2-4e4b-863a-9a1a24375c6d {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:09:21 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[607c99f0-b073-4b12-81de-33221d0ca819]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:09:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-06ac5db9-a237-42c1-9a93-b322512a20ea tempest-SnapshotsActionsTest-1406578492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7f064993-b2c2-4e4b-863a-9a1a24375c6d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:21 devstack sudo[94567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7f064993-b2c2-4e4b-863a-9a1a24375c6d
Nov 06 17:09:21 devstack sudo[94567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:22 devstack sudo[94563]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-97b5f56f-233a-4402-adec-70fe56cfbdcd tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996 1073741824" returned: 0 in 0.697s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-97b5f56f-233a-4402-adec-70fe56cfbdcd tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:22 devstack sudo[94571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996
Nov 06 17:09:22 devstack sudo[94571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:22 devstack sudo[94567]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-06ac5db9-a237-42c1-9a93-b322512a20ea tempest-SnapshotsActionsTest-1406578492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7f064993-b2c2-4e4b-863a-9a1a24375c6d" returned: 0 in 0.542s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:22 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-06ac5db9-a237-42c1-9a93-b322512a20ea tempest-SnapshotsActionsTest-1406578492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-731c0d83-cea5-4222-8b14-66e27e7b3b48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:09:22 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ca4963-b45f-4809-beff-5c4a15766fe3]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:09:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-06ac5db9-a237-42c1-9a93-b322512a20ea tempest-SnapshotsActionsTest-1406578492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:22 devstack sudo[94576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49
Nov 06 17:09:22 devstack sudo[94576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:22 devstack sudo[94571]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:22 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-10cd2dd6-5b62-46d0-873f-0e85f30d2aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:09:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-10cd2dd6-5b62-46d0-873f-0e85f30d2aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Flow 'volume_create_manager' (c8dbdc9c-8960-4cfe-a3b3-acbbd11406d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:09:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-10cd2dd6-5b62-46d0-873f-0e85f30d2aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da8ec73b-634f-413b-be99-e039a1ed7801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-97b5f56f-233a-4402-adec-70fe56cfbdcd tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996" returned: 0 in 0.442s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:22 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-97b5f56f-233a-4402-adec-70fe56cfbdcd tempest-GroupSnapshotsTest-1647710575 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:09:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-97b5f56f-233a-4402-adec-70fe56cfbdcd tempest-GroupSnapshotsTest-1647710575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:09:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-10cd2dd6-5b62-46d0-873f-0e85f30d2aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da8ec73b-634f-413b-be99-e039a1ed7801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-622783037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb2cd71a-28a4-44b2-9e1f-8db24f5b1553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='798d6a40bb234387814b17667b9f8544',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:09:22Z,use_quota=True,user_id='ae4bf1fba1c641afac62d111dce0b7f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-10cd2dd6-5b62-46d0-873f-0e85f30d2aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c04b6198-b070-41bf-a3a8-63dd1cb9e90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-10cd2dd6-5b62-46d0-873f-0e85f30d2aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c04b6198-b070-41bf-a3a8-63dd1cb9e90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-10cd2dd6-5b62-46d0-873f-0e85f30d2aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8858bf0-29ec-4210-b676-5103674fd222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-10cd2dd6-5b62-46d0-873f-0e85f30d2aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8858bf0-29ec-4210-b676-5103674fd222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb2cd71a-28a4-44b2-9e1f-8db24f5b1553', 'volume_name': 'volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-10cd2dd6-5b62-46d0-873f-0e85f30d2aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd77955-e395-4309-960c-ec00d39ac8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-10cd2dd6-5b62-46d0-873f-0e85f30d2aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd77955-e395-4309-960c-ec00d39ac8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-10cd2dd6-5b62-46d0-873f-0e85f30d2aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5368896d-adea-4416-93fb-39d977bf812e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:22 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-10cd2dd6-5b62-46d0-873f-0e85f30d2aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Volume cb2cd71a-28a4-44b2-9e1f-8db24f5b1553: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553', 'volume_size': 1}
Nov 06 17:09:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-10cd2dd6-5b62-46d0-873f-0e85f30d2aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:09:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-10cd2dd6-5b62-46d0-873f-0e85f30d2aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:09:22 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-10cd2dd6-5b62-46d0-873f-0e85f30d2aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-622783037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb2cd71a-28a4-44b2-9e1f-8db24f5b1553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='798d6a40bb234387814b17667b9f8544',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:09:22Z,use_quota=True,user_id='ae4bf1fba1c641afac62d111dce0b7f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:09:22 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-10cd2dd6-5b62-46d0-873f-0e85f30d2aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Creating volume cb2cd71a-28a4-44b2-9e1f-8db24f5b1553 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:09:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-10cd2dd6-5b62-46d0-873f-0e85f30d2aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:09:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-10cd2dd6-5b62-46d0-873f-0e85f30d2aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:09:22 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-10cd2dd6-5b62-46d0-873f-0e85f30d2aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:09:22 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-10cd2dd6-5b62-46d0-873f-0e85f30d2aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:09:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-10cd2dd6-5b62-46d0-873f-0e85f30d2aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:09:22 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-10cd2dd6-5b62-46d0-873f-0e85f30d2aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:09:22 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-10cd2dd6-5b62-46d0-873f-0e85f30d2aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:09:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-10cd2dd6-5b62-46d0-873f-0e85f30d2aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-97b5f56f-233a-4402-adec-70fe56cfbdcd tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b04903-fedb-42b1-9cd8-3c04bb2e8ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-97b5f56f-233a-4402-adec-70fe56cfbdcd tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cb14489-b69a-4b7e-82ed-81b75031c7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:22 devstack sudo[94579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553 1073741824
Nov 06 17:09:22 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-97b5f56f-233a-4402-adec-70fe56cfbdcd tempest-GroupSnapshotsTest-1647710575 None] Volume volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996 (6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996): created successfully
Nov 06 17:09:22 devstack sudo[94579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-97b5f56f-233a-4402-adec-70fe56cfbdcd tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cb14489-b69a-4b7e-82ed-81b75031c7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-97b5f56f-233a-4402-adec-70fe56cfbdcd tempest-GroupSnapshotsTest-1647710575 None] Flow 'volume_create_manager' (6753c2f6-27eb-407a-85cd-60bb556142cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:09:22 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-97b5f56f-233a-4402-adec-70fe56cfbdcd tempest-GroupSnapshotsTest-1647710575 None] Created volume successfully.
Nov 06 17:09:22 devstack sudo[94576]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-06ac5db9-a237-42c1-9a93-b322512a20ea tempest-SnapshotsActionsTest-1406578492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49" returned: 0 in 0.524s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:22 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-06ac5db9-a237-42c1-9a93-b322512a20ea tempest-SnapshotsActionsTest-1406578492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-731c0d83-cea5-4222-8b14-66e27e7b3b48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:09:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-06ac5db9-a237-42c1-9a93-b322512a20ea tempest-SnapshotsActionsTest-1406578492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7f064993-b2c2-4e4b-863a-9a1a24375c6d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:22 devstack sudo[94584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7f064993-b2c2-4e4b-863a-9a1a24375c6d
Nov 06 17:09:22 devstack sudo[94584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:23 devstack sudo[94579]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-10cd2dd6-5b62-46d0-873f-0e85f30d2aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553 1073741824" returned: 0 in 0.562s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-10cd2dd6-5b62-46d0-873f-0e85f30d2aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:23 devstack sudo[94594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553
Nov 06 17:09:23 devstack sudo[94594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:23 devstack sudo[94584]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-06ac5db9-a237-42c1-9a93-b322512a20ea tempest-SnapshotsActionsTest-1406578492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7f064993-b2c2-4e4b-863a-9a1a24375c6d" returned: 0 in 0.436s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-06ac5db9-a237-42c1-9a93-b322512a20ea tempest-SnapshotsActionsTest-1406578492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7f064993-b2c2-4e4b-863a-9a1a24375c6d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:23 devstack sudo[94596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7f064993-b2c2-4e4b-863a-9a1a24375c6d
Nov 06 17:09:23 devstack sudo[94596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:23 devstack sudo[94594]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-10cd2dd6-5b62-46d0-873f-0e85f30d2aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553" returned: 0 in 0.275s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:23 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-10cd2dd6-5b62-46d0-873f-0e85f30d2aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:09:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-10cd2dd6-5b62-46d0-873f-0e85f30d2aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:09:23 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-10cd2dd6-5b62-46d0-873f-0e85f30d2aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5368896d-adea-4416-93fb-39d977bf812e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:23 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-10cd2dd6-5b62-46d0-873f-0e85f30d2aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81104ac7-a7a9-488a-b281-5147691e7347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:23 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-10cd2dd6-5b62-46d0-873f-0e85f30d2aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Volume volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553 (cb2cd71a-28a4-44b2-9e1f-8db24f5b1553): created successfully
Nov 06 17:09:23 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-10cd2dd6-5b62-46d0-873f-0e85f30d2aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81104ac7-a7a9-488a-b281-5147691e7347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:23 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-10cd2dd6-5b62-46d0-873f-0e85f30d2aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Flow 'volume_create_manager' (c8dbdc9c-8960-4cfe-a3b3-acbbd11406d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:09:23 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-10cd2dd6-5b62-46d0-873f-0e85f30d2aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Created volume successfully.
Nov 06 17:09:23 devstack sudo[94596]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-06ac5db9-a237-42c1-9a93-b322512a20ea tempest-SnapshotsActionsTest-1406578492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7f064993-b2c2-4e4b-863a-9a1a24375c6d" returned: 0 in 0.316s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:23 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-06ac5db9-a237-42c1-9a93-b322512a20ea tempest-SnapshotsActionsTest-1406578492 None] Lock "cinder-quobyte-7f064993-b2c2-4e4b-863a-9a1a24375c6d" released by "_delete_snapshot" :: held 1.992s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:09:23 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-06ac5db9-a237-42c1-9a93-b322512a20ea tempest-SnapshotsActionsTest-1406578492 None] Lock "cinder-quobyte-731c0d83-cea5-4222-8b14-66e27e7b3b48" released by "delete_snapshot" :: held 2.025s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:09:23 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-06ac5db9-a237-42c1-9a93-b322512a20ea tempest-SnapshotsActionsTest-1406578492 None] Created reservations ['fbe488d0-b028-4cd8-b912-858bf8bf33a8', '769ed50a-e039-45b3-acbb-49caef4714b5', '7e320dda-17b2-44da-8c6f-63029212e8af', '6764d94a-16da-49ec-8293-3355ce4df8fd'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:09:23 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-06ac5db9-a237-42c1-9a93-b322512a20ea tempest-SnapshotsActionsTest-1406578492 None] Delete snapshot completed successfully.
Nov 06 17:09:23 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-06ac5db9-a237-42c1-9a93-b322512a20ea tempest-SnapshotsActionsTest-1406578492 None] Lock "cinder-7f064993-b2c2-4e4b-863a-9a1a24375c6d-delete_snapshot" released by "delete_snapshot" :: held 2.196s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:09:23 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-49d3b3cd-5bd5-400a-9093-0e13864562e9 tempest-GroupSnapshotsTest-1647710575 None] GroupSnapshot 69bd32a5-161f-4ec1-b413-e52429350430: creating.
Nov 06 17:09:23 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-49d3b3cd-5bd5-400a-9093-0e13864562e9 tempest-GroupSnapshotsTest-1647710575 None] Group snapshot 69bd32a5-161f-4ec1-b413-e52429350430: creating. {{(pid=86856) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 06 17:09:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-49d3b3cd-5bd5-400a-9093-0e13864562e9 tempest-GroupSnapshotsTest-1647710575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:09:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-49d3b3cd-5bd5-400a-9093-0e13864562e9 tempest-GroupSnapshotsTest-1647710575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:09:23 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-49d3b3cd-5bd5-400a-9093-0e13864562e9 tempest-GroupSnapshotsTest-1647710575 None] Creating offline snapshot ac5b4161-1d58-44f1-a2ec-c9aa45c60ce4 of volume 6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996 {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:09:24 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfea4fed-a385-48eb-a225-890bdf703ca3]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:09:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-49d3b3cd-5bd5-400a-9093-0e13864562e9 tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:24 devstack sudo[94600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996
Nov 06 17:09:24 devstack sudo[94600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:24 devstack sudo[94600]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-49d3b3cd-5bd5-400a-9093-0e13864562e9 tempest-GroupSnapshotsTest-1647710575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996" returned: 0 in 0.374s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-49d3b3cd-5bd5-400a-9093-0e13864562e9 tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996.ac5b4161-1d58-44f1-a2ec-c9aa45c60ce4 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:24 devstack sudo[94605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996.ac5b4161-1d58-44f1-a2ec-c9aa45c60ce4 1G
Nov 06 17:09:24 devstack sudo[94605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:24 devstack sudo[94605]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-49d3b3cd-5bd5-400a-9093-0e13864562e9 tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996.ac5b4161-1d58-44f1-a2ec-c9aa45c60ce4 1G" returned: 0 in 0.603s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-49d3b3cd-5bd5-400a-9093-0e13864562e9 tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996.ac5b4161-1d58-44f1-a2ec-c9aa45c60ce4 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-70df201e-f9ab-4b84-a63f-0dcbf714e07a tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:09:25 devstack sudo[94611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996.ac5b4161-1d58-44f1-a2ec-c9aa45c60ce4
Nov 06 17:09:25 devstack sudo[94611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-8bb41b44-0f02-4dc0-b2be-6eaef0306270 tempest-SnapshotsActionsTest-2144663578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:09:25 devstack sudo[94611]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-49d3b3cd-5bd5-400a-9093-0e13864562e9 tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996.ac5b4161-1d58-44f1-a2ec-c9aa45c60ce4" returned: 0 in 0.350s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:25 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-49d3b3cd-5bd5-400a-9093-0e13864562e9 tempest-GroupSnapshotsTest-1647710575 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996.ac5b4161-1d58-44f1-a2ec-c9aa45c60ce4 is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 17:09:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-49d3b3cd-5bd5-400a-9093-0e13864562e9 tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996.ac5b4161-1d58-44f1-a2ec-c9aa45c60ce4 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:25 devstack sudo[94616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996.ac5b4161-1d58-44f1-a2ec-c9aa45c60ce4
Nov 06 17:09:25 devstack sudo[94616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:25 devstack sudo[94616]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-49d3b3cd-5bd5-400a-9093-0e13864562e9 tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996.ac5b4161-1d58-44f1-a2ec-c9aa45c60ce4" returned: 0 in 0.249s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-49d3b3cd-5bd5-400a-9093-0e13864562e9 tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:25 devstack sudo[94619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996.info
Nov 06 17:09:25 devstack sudo[94619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:25 devstack sudo[94619]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-49d3b3cd-5bd5-400a-9093-0e13864562e9 tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996.info" returned: 0 in 0.268s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:25 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-49d3b3cd-5bd5-400a-9093-0e13864562e9 tempest-GroupSnapshotsTest-1647710575 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 17:09:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-49d3b3cd-5bd5-400a-9093-0e13864562e9 tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:25 devstack sudo[94622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996.info
Nov 06 17:09:25 devstack sudo[94622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:26 devstack sudo[94622]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-49d3b3cd-5bd5-400a-9093-0e13864562e9 tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996.info" returned: 0 in 0.266s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-49d3b3cd-5bd5-400a-9093-0e13864562e9 tempest-GroupSnapshotsTest-1647710575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.225s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:09:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-70df201e-f9ab-4b84-a63f-0dcbf714e07a tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.165s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:09:26 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-70df201e-f9ab-4b84-a63f-0dcbf714e07a tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Creating offline snapshot 301cdbf9-f3e6-4ce8-817a-09359250e8f5 of volume cb2cd71a-28a4-44b2-9e1f-8db24f5b1553 {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:09:26 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[6478949d-ba1e-4de7-aa1a-a3d66f87742a]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:09:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-70df201e-f9ab-4b84-a63f-0dcbf714e07a tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:26 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-49d3b3cd-5bd5-400a-9093-0e13864562e9 tempest-GroupSnapshotsTest-1647710575 None] group_snapshot 69bd32a5-161f-4ec1-b413-e52429350430: created successfully
Nov 06 17:09:26 devstack sudo[94625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553
Nov 06 17:09:26 devstack sudo[94625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:26 devstack sudo[94625]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-70df201e-f9ab-4b84-a63f-0dcbf714e07a tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553" returned: 0 in 0.382s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-70df201e-f9ab-4b84-a63f-0dcbf714e07a tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553.301cdbf9-f3e6-4ce8-817a-09359250e8f5 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:26 devstack sudo[94630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553.301cdbf9-f3e6-4ce8-817a-09359250e8f5 1G
Nov 06 17:09:26 devstack sudo[94630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:27 devstack sudo[94630]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-70df201e-f9ab-4b84-a63f-0dcbf714e07a tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553.301cdbf9-f3e6-4ce8-817a-09359250e8f5 1G" returned: 0 in 0.455s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-70df201e-f9ab-4b84-a63f-0dcbf714e07a tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553.301cdbf9-f3e6-4ce8-817a-09359250e8f5 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:27 devstack sudo[94636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553.301cdbf9-f3e6-4ce8-817a-09359250e8f5
Nov 06 17:09:27 devstack sudo[94636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:27 devstack sudo[94636]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-70df201e-f9ab-4b84-a63f-0dcbf714e07a tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553.301cdbf9-f3e6-4ce8-817a-09359250e8f5" returned: 0 in 0.333s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:27 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-70df201e-f9ab-4b84-a63f-0dcbf714e07a tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553.301cdbf9-f3e6-4ce8-817a-09359250e8f5 is being set with open permissions: ugo+rw
Nov 06 17:09:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-70df201e-f9ab-4b84-a63f-0dcbf714e07a tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553.301cdbf9-f3e6-4ce8-817a-09359250e8f5 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:27 devstack sudo[94642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553.301cdbf9-f3e6-4ce8-817a-09359250e8f5
Nov 06 17:09:27 devstack sudo[94642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:27 devstack sudo[94642]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-70df201e-f9ab-4b84-a63f-0dcbf714e07a tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553.301cdbf9-f3e6-4ce8-817a-09359250e8f5" returned: 0 in 0.278s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-70df201e-f9ab-4b84-a63f-0dcbf714e07a tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:27 devstack sudo[94645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553.info
Nov 06 17:09:27 devstack sudo[94645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2a1a9eae-9403-4b4e-99a4-a887a514e9aa tempest-GroupSnapshotsTest-1647710575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:09:28 devstack sudo[94645]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-70df201e-f9ab-4b84-a63f-0dcbf714e07a tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553.info" returned: 0 in 0.301s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:28 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-70df201e-f9ab-4b84-a63f-0dcbf714e07a tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553.info is being set with open permissions: ugo+rw
Nov 06 17:09:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-70df201e-f9ab-4b84-a63f-0dcbf714e07a tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:28 devstack sudo[94648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553.info
Nov 06 17:09:28 devstack sudo[94648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:28 devstack sudo[94648]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-70df201e-f9ab-4b84-a63f-0dcbf714e07a tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553.info" returned: 0 in 0.274s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-70df201e-f9ab-4b84-a63f-0dcbf714e07a tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.144s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:09:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-8bb41b44-0f02-4dc0-b2be-6eaef0306270 tempest-SnapshotsActionsTest-2144663578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.152s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:09:28 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-8bb41b44-0f02-4dc0-b2be-6eaef0306270 tempest-SnapshotsActionsTest-2144663578 None] Creating offline snapshot 7275f1b5-7e00-47cb-ba5a-e631b4c8b5c6 of volume 731c0d83-cea5-4222-8b14-66e27e7b3b48 {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:09:28 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[be54e290-938a-46be-9acb-c315b23d58e8]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:09:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8bb41b44-0f02-4dc0-b2be-6eaef0306270 tempest-SnapshotsActionsTest-2144663578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:28 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-70df201e-f9ab-4b84-a63f-0dcbf714e07a tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Create snapshot completed successfully
Nov 06 17:09:28 devstack sudo[94651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49
Nov 06 17:09:28 devstack sudo[94651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:28 devstack sudo[94651]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8bb41b44-0f02-4dc0-b2be-6eaef0306270 tempest-SnapshotsActionsTest-2144663578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49" returned: 0 in 0.405s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:28 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-8bb41b44-0f02-4dc0-b2be-6eaef0306270 tempest-SnapshotsActionsTest-2144663578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-731c0d83-cea5-4222-8b14-66e27e7b3b48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:09:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8bb41b44-0f02-4dc0-b2be-6eaef0306270 tempest-SnapshotsActionsTest-2144663578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7275f1b5-7e00-47cb-ba5a-e631b4c8b5c6 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:28 devstack sudo[94656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7275f1b5-7e00-47cb-ba5a-e631b4c8b5c6 1G
Nov 06 17:09:28 devstack sudo[94656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:29 devstack sudo[94656]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8bb41b44-0f02-4dc0-b2be-6eaef0306270 tempest-SnapshotsActionsTest-2144663578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7275f1b5-7e00-47cb-ba5a-e631b4c8b5c6 1G" returned: 0 in 0.523s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8bb41b44-0f02-4dc0-b2be-6eaef0306270 tempest-SnapshotsActionsTest-2144663578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7275f1b5-7e00-47cb-ba5a-e631b4c8b5c6 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:29 devstack sudo[94661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7275f1b5-7e00-47cb-ba5a-e631b4c8b5c6
Nov 06 17:09:29 devstack sudo[94661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:29 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-8b58d9d5-1cdd-407b-b6bf-16ebcfd5706e tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Acquiring lock "cinder-301cdbf9-f3e6-4ce8-817a-09359250e8f5-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:09:29 devstack sudo[94661]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8bb41b44-0f02-4dc0-b2be-6eaef0306270 tempest-SnapshotsActionsTest-2144663578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7275f1b5-7e00-47cb-ba5a-e631b4c8b5c6" returned: 0 in 0.384s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:29 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-8bb41b44-0f02-4dc0-b2be-6eaef0306270 tempest-SnapshotsActionsTest-2144663578 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7275f1b5-7e00-47cb-ba5a-e631b4c8b5c6 is being set with open permissions: ugo+rw
Nov 06 17:09:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8bb41b44-0f02-4dc0-b2be-6eaef0306270 tempest-SnapshotsActionsTest-2144663578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7275f1b5-7e00-47cb-ba5a-e631b4c8b5c6 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:29 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-8b58d9d5-1cdd-407b-b6bf-16ebcfd5706e tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Lock "cinder-301cdbf9-f3e6-4ce8-817a-09359250e8f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:09:29 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-8b58d9d5-1cdd-407b-b6bf-16ebcfd5706e tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Acquiring lock "cinder-quobyte-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:09:29 devstack sudo[94669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7275f1b5-7e00-47cb-ba5a-e631b4c8b5c6
Nov 06 17:09:29 devstack sudo[94669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:29 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-8b58d9d5-1cdd-407b-b6bf-16ebcfd5706e tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Lock "cinder-quobyte-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:09:29 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-8b58d9d5-1cdd-407b-b6bf-16ebcfd5706e tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Acquiring lock "cinder-quobyte-301cdbf9-f3e6-4ce8-817a-09359250e8f5" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:09:29 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-8b58d9d5-1cdd-407b-b6bf-16ebcfd5706e tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Lock "cinder-quobyte-301cdbf9-f3e6-4ce8-817a-09359250e8f5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:09:29 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-8b58d9d5-1cdd-407b-b6bf-16ebcfd5706e tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Deleting offline snapshot 301cdbf9-f3e6-4ce8-817a-09359250e8f5 of volume cb2cd71a-28a4-44b2-9e1f-8db24f5b1553 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:09:29 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-8b58d9d5-1cdd-407b-b6bf-16ebcfd5706e tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] snapshot_file for this snap is: volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553.301cdbf9-f3e6-4ce8-817a-09359250e8f5 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:09:29 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d78e2d3-c53c-49c9-abf1-7e96306cfcb5]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:09:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8b58d9d5-1cdd-407b-b6bf-16ebcfd5706e tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553.301cdbf9-f3e6-4ce8-817a-09359250e8f5 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:29 devstack sudo[94671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553.301cdbf9-f3e6-4ce8-817a-09359250e8f5
Nov 06 17:09:29 devstack sudo[94671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:30 devstack sudo[94669]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8bb41b44-0f02-4dc0-b2be-6eaef0306270 tempest-SnapshotsActionsTest-2144663578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7275f1b5-7e00-47cb-ba5a-e631b4c8b5c6" returned: 0 in 0.270s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-8bb41b44-0f02-4dc0-b2be-6eaef0306270 tempest-SnapshotsActionsTest-2144663578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.724s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2a1a9eae-9403-4b4e-99a4-a887a514e9aa tempest-GroupSnapshotsTest-1647710575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.071s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-2a1a9eae-9403-4b4e-99a4-a887a514e9aa tempest-GroupSnapshotsTest-1647710575 None] Acquiring lock "cinder-quobyte-ac5b4161-1d58-44f1-a2ec-c9aa45c60ce4-80d0138c-3916-470a-bd04-01a8d225369f" by "_create_volume_from_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-2a1a9eae-9403-4b4e-99a4-a887a514e9aa tempest-GroupSnapshotsTest-1647710575 None] Lock "cinder-quobyte-ac5b4161-1d58-44f1-a2ec-c9aa45c60ce4-80d0138c-3916-470a-bd04-01a8d225369f" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-2a1a9eae-9403-4b4e-99a4-a887a514e9aa tempest-GroupSnapshotsTest-1647710575 None] Creating volume 80d0138c-3916-470a-bd04-01a8d225369f from snapshot ac5b4161-1d58-44f1-a2ec-c9aa45c60ce4 {{(pid=86856) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2a1a9eae-9403-4b4e-99a4-a887a514e9aa tempest-GroupSnapshotsTest-1647710575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2a1a9eae-9403-4b4e-99a4-a887a514e9aa tempest-GroupSnapshotsTest-1647710575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-2a1a9eae-9403-4b4e-99a4-a887a514e9aa tempest-GroupSnapshotsTest-1647710575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-2a1a9eae-9403-4b4e-99a4-a887a514e9aa tempest-GroupSnapshotsTest-1647710575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2a1a9eae-9403-4b4e-99a4-a887a514e9aa tempest-GroupSnapshotsTest-1647710575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-2a1a9eae-9403-4b4e-99a4-a887a514e9aa tempest-GroupSnapshotsTest-1647710575 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-2a1a9eae-9403-4b4e-99a4-a887a514e9aa tempest-GroupSnapshotsTest-1647710575 None] Acquiring lock "cinder-quobyte-80d0138c-3916-470a-bd04-01a8d225369f" by "_copy_volume_from_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:09:30 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-8bb41b44-0f02-4dc0-b2be-6eaef0306270 tempest-SnapshotsActionsTest-2144663578 None] Create snapshot completed successfully
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-2a1a9eae-9403-4b4e-99a4-a887a514e9aa tempest-GroupSnapshotsTest-1647710575 None] Lock "cinder-quobyte-80d0138c-3916-470a-bd04-01a8d225369f" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-2a1a9eae-9403-4b4e-99a4-a887a514e9aa tempest-GroupSnapshotsTest-1647710575 None] snapshot: ac5b4161-1d58-44f1-a2ec-c9aa45c60ce4, volume: 80d0138c-3916-470a-bd04-01a8d225369f,  {{(pid=86856) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2a1a9eae-9403-4b4e-99a4-a887a514e9aa tempest-GroupSnapshotsTest-1647710575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2a1a9eae-9403-4b4e-99a4-a887a514e9aa tempest-GroupSnapshotsTest-1647710575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-2a1a9eae-9403-4b4e-99a4-a887a514e9aa tempest-GroupSnapshotsTest-1647710575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-2a1a9eae-9403-4b4e-99a4-a887a514e9aa tempest-GroupSnapshotsTest-1647710575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2a1a9eae-9403-4b4e-99a4-a887a514e9aa tempest-GroupSnapshotsTest-1647710575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5eb1b2-50d7-4384-85b6-1ee5de206004]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2a1a9eae-9403-4b4e-99a4-a887a514e9aa tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996.ac5b4161-1d58-44f1-a2ec-c9aa45c60ce4 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:30 devstack sudo[94671]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8b58d9d5-1cdd-407b-b6bf-16ebcfd5706e tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553.301cdbf9-f3e6-4ce8-817a-09359250e8f5" returned: 0 in 0.438s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-8b58d9d5-1cdd-407b-b6bf-16ebcfd5706e tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[0274cd9a-5cb4-4450-9be8-07bdaf245a6f]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8b58d9d5-1cdd-407b-b6bf-16ebcfd5706e tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:30 devstack sudo[94676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996.ac5b4161-1d58-44f1-a2ec-c9aa45c60ce4
Nov 06 17:09:30 devstack sudo[94676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:30 devstack sudo[94679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553
Nov 06 17:09:30 devstack sudo[94679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a614ed95-7b85-4fea-ac3f-b1f57c4d5a2c tempest-SnapshotsActionsTest-1406578492 None] Acquiring lock "cinder-7275f1b5-7e00-47cb-ba5a-e631b4c8b5c6-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a614ed95-7b85-4fea-ac3f-b1f57c4d5a2c tempest-SnapshotsActionsTest-1406578492 None] Lock "cinder-7275f1b5-7e00-47cb-ba5a-e631b4c8b5c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a614ed95-7b85-4fea-ac3f-b1f57c4d5a2c tempest-SnapshotsActionsTest-1406578492 None] Acquiring lock "cinder-quobyte-731c0d83-cea5-4222-8b14-66e27e7b3b48" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:09:30 devstack sudo[94676]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2a1a9eae-9403-4b4e-99a4-a887a514e9aa tempest-GroupSnapshotsTest-1647710575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996.ac5b4161-1d58-44f1-a2ec-c9aa45c60ce4" returned: 0 in 0.519s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-2a1a9eae-9403-4b4e-99a4-a887a514e9aa tempest-GroupSnapshotsTest-1647710575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a614ed95-7b85-4fea-ac3f-b1f57c4d5a2c tempest-SnapshotsActionsTest-1406578492 None] Lock "cinder-quobyte-731c0d83-cea5-4222-8b14-66e27e7b3b48" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a614ed95-7b85-4fea-ac3f-b1f57c4d5a2c tempest-SnapshotsActionsTest-1406578492 None] Acquiring lock "cinder-quobyte-7275f1b5-7e00-47cb-ba5a-e631b4c8b5c6" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c07bacf-00b0-4519-916b-fa8a6d2e62d9]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2a1a9eae-9403-4b4e-99a4-a887a514e9aa tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a614ed95-7b85-4fea-ac3f-b1f57c4d5a2c tempest-SnapshotsActionsTest-1406578492 None] Lock "cinder-quobyte-7275f1b5-7e00-47cb-ba5a-e631b4c8b5c6" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-a614ed95-7b85-4fea-ac3f-b1f57c4d5a2c tempest-SnapshotsActionsTest-1406578492 None] Deleting offline snapshot 7275f1b5-7e00-47cb-ba5a-e631b4c8b5c6 of volume 731c0d83-cea5-4222-8b14-66e27e7b3b48 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-a614ed95-7b85-4fea-ac3f-b1f57c4d5a2c tempest-SnapshotsActionsTest-1406578492 None] snapshot_file for this snap is: volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7275f1b5-7e00-47cb-ba5a-e631b4c8b5c6 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:09:30 devstack sudo[94679]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8b58d9d5-1cdd-407b-b6bf-16ebcfd5706e tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553" returned: 0 in 0.500s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8b58d9d5-1cdd-407b-b6bf-16ebcfd5706e tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553.301cdbf9-f3e6-4ce8-817a-09359250e8f5 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[43705dc4-787c-4f4d-89d3-7da5fc8bf9f9]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:09:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a614ed95-7b85-4fea-ac3f-b1f57c4d5a2c tempest-SnapshotsActionsTest-1406578492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7275f1b5-7e00-47cb-ba5a-e631b4c8b5c6 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:30 devstack sudo[94689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553.301cdbf9-f3e6-4ce8-817a-09359250e8f5
Nov 06 17:09:30 devstack sudo[94688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996
Nov 06 17:09:30 devstack sudo[94689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:30 devstack sudo[94688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:30 devstack sudo[94690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7275f1b5-7e00-47cb-ba5a-e631b4c8b5c6
Nov 06 17:09:30 devstack sudo[94690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:31 devstack sudo[94688]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2a1a9eae-9403-4b4e-99a4-a887a514e9aa tempest-GroupSnapshotsTest-1647710575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996" returned: 0 in 0.430s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:31 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-2a1a9eae-9403-4b4e-99a4-a887a514e9aa tempest-GroupSnapshotsTest-1647710575 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996 {{(pid=86856) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 06 17:09:31 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-2a1a9eae-9403-4b4e-99a4-a887a514e9aa tempest-GroupSnapshotsTest-1647710575 None] Creating direct copy from snapshot {{(pid=86856) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 06 17:09:31 devstack cinder-volume[86856]: DEBUG cinder.utils [None req-2a1a9eae-9403-4b4e-99a4-a887a514e9aa tempest-GroupSnapshotsTest-1647710575 None] Path /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-80d0138c-3916-470a-bd04-01a8d225369f not found in is_blk_device check {{(pid=86856) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 06 17:09:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2a1a9eae-9403-4b4e-99a4-a887a514e9aa tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-80d0138c-3916-470a-bd04-01a8d225369f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:31 devstack sudo[94703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-80d0138c-3916-470a-bd04-01a8d225369f
Nov 06 17:09:31 devstack sudo[94703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:31 devstack sudo[94689]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8b58d9d5-1cdd-407b-b6bf-16ebcfd5706e tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553.301cdbf9-f3e6-4ce8-817a-09359250e8f5" returned: 0 in 0.408s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8b58d9d5-1cdd-407b-b6bf-16ebcfd5706e tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553.301cdbf9-f3e6-4ce8-817a-09359250e8f5 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:31 devstack sudo[94708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553.301cdbf9-f3e6-4ce8-817a-09359250e8f5
Nov 06 17:09:31 devstack sudo[94708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:31 devstack sudo[94690]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a614ed95-7b85-4fea-ac3f-b1f57c4d5a2c tempest-SnapshotsActionsTest-1406578492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7275f1b5-7e00-47cb-ba5a-e631b4c8b5c6" returned: 0 in 0.468s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:31 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-a614ed95-7b85-4fea-ac3f-b1f57c4d5a2c tempest-SnapshotsActionsTest-1406578492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-731c0d83-cea5-4222-8b14-66e27e7b3b48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:09:31 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5adef28-de19-4a37-bcc1-e212d8aa6c9a]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:09:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a614ed95-7b85-4fea-ac3f-b1f57c4d5a2c tempest-SnapshotsActionsTest-1406578492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:31 devstack sudo[94710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49
Nov 06 17:09:31 devstack sudo[94710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:31 devstack sudo[94708]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8b58d9d5-1cdd-407b-b6bf-16ebcfd5706e tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553.301cdbf9-f3e6-4ce8-817a-09359250e8f5" returned: 0 in 0.295s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:31 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-8b58d9d5-1cdd-407b-b6bf-16ebcfd5706e tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Lock "cinder-quobyte-301cdbf9-f3e6-4ce8-817a-09359250e8f5" released by "_delete_snapshot" :: held 1.777s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:09:31 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-8b58d9d5-1cdd-407b-b6bf-16ebcfd5706e tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Lock "cinder-quobyte-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553" released by "delete_snapshot" :: held 1.808s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:09:31 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-8b58d9d5-1cdd-407b-b6bf-16ebcfd5706e tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Created reservations ['c9a66667-87f5-432f-9cb4-4e573df503a5', '0b341166-a2e6-4239-9cdd-d1ad73cc8d83', '05b09e8a-6b61-4fc3-b15e-ebd5b1ec2a94', '9dfaa50d-7697-4fd6-9e08-7740f466fd97'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:09:31 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-8b58d9d5-1cdd-407b-b6bf-16ebcfd5706e tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Delete snapshot completed successfully.
Nov 06 17:09:31 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-8b58d9d5-1cdd-407b-b6bf-16ebcfd5706e tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Lock "cinder-301cdbf9-f3e6-4ce8-817a-09359250e8f5-delete_snapshot" released by "delete_snapshot" :: held 2.131s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:09:31 devstack sudo[94710]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a614ed95-7b85-4fea-ac3f-b1f57c4d5a2c tempest-SnapshotsActionsTest-1406578492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49" returned: 0 in 0.597s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:31 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-a614ed95-7b85-4fea-ac3f-b1f57c4d5a2c tempest-SnapshotsActionsTest-1406578492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-731c0d83-cea5-4222-8b14-66e27e7b3b48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:09:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a614ed95-7b85-4fea-ac3f-b1f57c4d5a2c tempest-SnapshotsActionsTest-1406578492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7275f1b5-7e00-47cb-ba5a-e631b4c8b5c6 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:32 devstack sudo[94723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7275f1b5-7e00-47cb-ba5a-e631b4c8b5c6
Nov 06 17:09:32 devstack sudo[94723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:32 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-8c1f8d27-08ff-47f3-8ee5-a77f077a5f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Acquiring lock "cinder-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:09:32 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-8c1f8d27-08ff-47f3-8ee5-a77f077a5f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Lock "cinder-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:09:32 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-8c1f8d27-08ff-47f3-8ee5-a77f077a5f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Acquiring lock "cinder-quobyte-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:09:32 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-8c1f8d27-08ff-47f3-8ee5-a77f077a5f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Lock "cinder-quobyte-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553" acquired by "delete_volume" :: waited 0.026s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:09:32 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71830d9-c552-45d3-bbdc-2d65121b3a94]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:09:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8c1f8d27-08ff-47f3-8ee5-a77f077a5f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:32 devstack sudo[94731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553
Nov 06 17:09:32 devstack sudo[94731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:32 devstack sudo[94723]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a614ed95-7b85-4fea-ac3f-b1f57c4d5a2c tempest-SnapshotsActionsTest-1406578492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7275f1b5-7e00-47cb-ba5a-e631b4c8b5c6" returned: 0 in 0.935s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a614ed95-7b85-4fea-ac3f-b1f57c4d5a2c tempest-SnapshotsActionsTest-1406578492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7275f1b5-7e00-47cb-ba5a-e631b4c8b5c6 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:32 devstack sudo[94733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7275f1b5-7e00-47cb-ba5a-e631b4c8b5c6
Nov 06 17:09:32 devstack sudo[94733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:33 devstack sudo[94731]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8c1f8d27-08ff-47f3-8ee5-a77f077a5f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553" returned: 0 in 1.079s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8c1f8d27-08ff-47f3-8ee5-a77f077a5f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:33 devstack sudo[94739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553
Nov 06 17:09:33 devstack sudo[94739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:33 devstack sudo[94733]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a614ed95-7b85-4fea-ac3f-b1f57c4d5a2c tempest-SnapshotsActionsTest-1406578492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.7275f1b5-7e00-47cb-ba5a-e631b4c8b5c6" returned: 0 in 0.883s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:33 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a614ed95-7b85-4fea-ac3f-b1f57c4d5a2c tempest-SnapshotsActionsTest-1406578492 None] Lock "cinder-quobyte-7275f1b5-7e00-47cb-ba5a-e631b4c8b5c6" released by "_delete_snapshot" :: held 3.091s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:09:33 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a614ed95-7b85-4fea-ac3f-b1f57c4d5a2c tempest-SnapshotsActionsTest-1406578492 None] Lock "cinder-quobyte-731c0d83-cea5-4222-8b14-66e27e7b3b48" released by "delete_snapshot" :: held 3.163s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:09:34 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-a614ed95-7b85-4fea-ac3f-b1f57c4d5a2c tempest-SnapshotsActionsTest-1406578492 None] Created reservations ['ecfdfa0d-541e-4f5b-af84-5ee23f24f120', '7bea91d2-9009-489f-9eb0-c0b48050e461', 'd642dcbe-bcd0-4722-8e78-97f8b3a4922a', 'b42d75b3-5f46-4da2-97cc-85b4e5bab7b2'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:09:34 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-a614ed95-7b85-4fea-ac3f-b1f57c4d5a2c tempest-SnapshotsActionsTest-1406578492 None] Delete snapshot completed successfully.
Nov 06 17:09:34 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a614ed95-7b85-4fea-ac3f-b1f57c4d5a2c tempest-SnapshotsActionsTest-1406578492 None] Lock "cinder-7275f1b5-7e00-47cb-ba5a-e631b4c8b5c6-delete_snapshot" released by "delete_snapshot" :: held 3.452s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:09:34 devstack sudo[94739]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8c1f8d27-08ff-47f3-8ee5-a77f077a5f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553" returned: 0 in 0.591s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:34 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-8c1f8d27-08ff-47f3-8ee5-a77f077a5f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Lock "cinder-quobyte-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553" released by "delete_volume" :: held 1.860s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:09:34 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-8c1f8d27-08ff-47f3-8ee5-a77f077a5f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Created reservations ['f88339fc-898a-4628-8ce4-ee9b1d3f9a82', '95c377af-9bcf-414c-bf08-d54ec795e641', '8c8ad930-b1b8-43ab-a5d2-42f76877166b', '93b9b937-85ba-4029-baa6-281399bde747'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:09:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-8c1f8d27-08ff-47f3-8ee5-a77f077a5f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:09:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-8c1f8d27-08ff-47f3-8ee5-a77f077a5f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:09:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-8c1f8d27-08ff-47f3-8ee5-a77f077a5f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:09:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-8c1f8d27-08ff-47f3-8ee5-a77f077a5f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:09:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-8c1f8d27-08ff-47f3-8ee5-a77f077a5f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:09:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8c1f8d27-08ff-47f3-8ee5-a77f077a5f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:34 devstack sudo[94742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:09:34 devstack sudo[94742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:34 devstack sudo[94742]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8c1f8d27-08ff-47f3-8ee5-a77f077a5f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.470s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:35 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-8c1f8d27-08ff-47f3-8ee5-a77f077a5f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:09:35 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-8c1f8d27-08ff-47f3-8ee5-a77f077a5f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Deleted volume successfully.
Nov 06 17:09:35 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-8c1f8d27-08ff-47f3-8ee5-a77f077a5f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-2019247451 None] Lock "cinder-cb2cd71a-28a4-44b2-9e1f-8db24f5b1553-delete_volume" released by "delete_volume" :: held 2.773s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:09:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-79e7e79c-d78b-4be3-a53e-5e28d0bb424d tempest-SnapshotsActionsTest-2144663578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:09:40 devstack sudo[94703]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2a1a9eae-9403-4b4e-99a4-a887a514e9aa tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-80d0138c-3916-470a-bd04-01a8d225369f" returned: 0 in 8.828s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:40 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-2a1a9eae-9403-4b4e-99a4-a887a514e9aa tempest-GroupSnapshotsTest-1647710575 None] Image conversion details: src /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996, size 1024.00 MB, duration 8.83 sec, destination /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-80d0138c-3916-470a-bd04-01a8d225369f {{(pid=86856) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 17:09:40 devstack cinder-volume[86856]: INFO cinder.image.image_utils [None req-2a1a9eae-9403-4b4e-99a4-a887a514e9aa tempest-GroupSnapshotsTest-1647710575 None] Converted 1024.00 MB image at 115.97 MB/s
Nov 06 17:09:40 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-2a1a9eae-9403-4b4e-99a4-a887a514e9aa tempest-GroupSnapshotsTest-1647710575 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-80d0138c-3916-470a-bd04-01a8d225369f is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 17:09:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2a1a9eae-9403-4b4e-99a4-a887a514e9aa tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-80d0138c-3916-470a-bd04-01a8d225369f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:40 devstack sudo[94748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-80d0138c-3916-470a-bd04-01a8d225369f
Nov 06 17:09:40 devstack sudo[94748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:40 devstack sudo[94748]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2a1a9eae-9403-4b4e-99a4-a887a514e9aa tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-80d0138c-3916-470a-bd04-01a8d225369f" returned: 0 in 0.298s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:40 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-2a1a9eae-9403-4b4e-99a4-a887a514e9aa tempest-GroupSnapshotsTest-1647710575 None] Lock "cinder-quobyte-80d0138c-3916-470a-bd04-01a8d225369f" released by "_copy_volume_from_snapshot" :: held 10.197s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:09:40 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=149,cinder:UPDATE=165,cinder:INSERT=35,cinder:DELETE=14 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:09:40 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=142,cinder:UPDATE=162,cinder:INSERT=40,cinder:DELETE=10 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:09:40 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-2a1a9eae-9403-4b4e-99a4-a887a514e9aa tempest-GroupSnapshotsTest-1647710575 None] Lock "cinder-quobyte-ac5b4161-1d58-44f1-a2ec-c9aa45c60ce4-80d0138c-3916-470a-bd04-01a8d225369f" released by "_create_volume_from_snapshot" :: held 10.298s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:09:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2a1a9eae-9403-4b4e-99a4-a887a514e9aa tempest-GroupSnapshotsTest-1647710575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.326s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:09:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-79e7e79c-d78b-4be3-a53e-5e28d0bb424d tempest-SnapshotsActionsTest-2144663578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.628s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:09:40 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-79e7e79c-d78b-4be3-a53e-5e28d0bb424d tempest-SnapshotsActionsTest-2144663578 None] Creating offline snapshot 3f19e4bd-3114-4936-a4a0-64013fc7d106 of volume 731c0d83-cea5-4222-8b14-66e27e7b3b48 {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:09:40 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5b25fa-d7f3-45e8-80d0-26b2d6c51880]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:09:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-79e7e79c-d78b-4be3-a53e-5e28d0bb424d tempest-SnapshotsActionsTest-2144663578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:40 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-2a1a9eae-9403-4b4e-99a4-a887a514e9aa tempest-GroupSnapshotsTest-1647710575 None] Create group from source-snapshot-69bd32a5-161f-4ec1-b413-e52429350430 completed successfully.
Nov 06 17:09:40 devstack sudo[94785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49
Nov 06 17:09:40 devstack sudo[94785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:41 devstack sudo[94785]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-79e7e79c-d78b-4be3-a53e-5e28d0bb424d tempest-SnapshotsActionsTest-2144663578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49" returned: 0 in 0.533s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:41 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-79e7e79c-d78b-4be3-a53e-5e28d0bb424d tempest-SnapshotsActionsTest-2144663578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-731c0d83-cea5-4222-8b14-66e27e7b3b48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:09:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-79e7e79c-d78b-4be3-a53e-5e28d0bb424d tempest-SnapshotsActionsTest-2144663578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.3f19e4bd-3114-4936-a4a0-64013fc7d106 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:41 devstack sudo[94793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.3f19e4bd-3114-4936-a4a0-64013fc7d106 1G
Nov 06 17:09:41 devstack sudo[94793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:41 devstack sudo[94793]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-79e7e79c-d78b-4be3-a53e-5e28d0bb424d tempest-SnapshotsActionsTest-2144663578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.3f19e4bd-3114-4936-a4a0-64013fc7d106 1G" returned: 0 in 0.583s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-79e7e79c-d78b-4be3-a53e-5e28d0bb424d tempest-SnapshotsActionsTest-2144663578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.3f19e4bd-3114-4936-a4a0-64013fc7d106 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:41 devstack sudo[94799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.3f19e4bd-3114-4936-a4a0-64013fc7d106
Nov 06 17:09:41 devstack sudo[94799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:41 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-47234f2c-4551-4693-9625-f8729985e180 tempest-GroupSnapshotsTest-1647710575 None] Acquiring lock "cinder-quobyte-80d0138c-3916-470a-bd04-01a8d225369f" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:09:41 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-47234f2c-4551-4693-9625-f8729985e180 tempest-GroupSnapshotsTest-1647710575 None] Lock "cinder-quobyte-80d0138c-3916-470a-bd04-01a8d225369f" acquired by "delete_volume" :: waited 0.021s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:09:41 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7e69f8-6723-45f1-95a0-769aeb9357a7]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:09:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-47234f2c-4551-4693-9625-f8729985e180 tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-80d0138c-3916-470a-bd04-01a8d225369f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:42 devstack sudo[94799]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-79e7e79c-d78b-4be3-a53e-5e28d0bb424d tempest-SnapshotsActionsTest-2144663578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.3f19e4bd-3114-4936-a4a0-64013fc7d106" returned: 0 in 0.374s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:42 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-79e7e79c-d78b-4be3-a53e-5e28d0bb424d tempest-SnapshotsActionsTest-2144663578 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.3f19e4bd-3114-4936-a4a0-64013fc7d106 is being set with open permissions: ugo+rw
Nov 06 17:09:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-79e7e79c-d78b-4be3-a53e-5e28d0bb424d tempest-SnapshotsActionsTest-2144663578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.3f19e4bd-3114-4936-a4a0-64013fc7d106 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:42 devstack sudo[94801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-80d0138c-3916-470a-bd04-01a8d225369f
Nov 06 17:09:42 devstack sudo[94801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:42 devstack sudo[94807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.3f19e4bd-3114-4936-a4a0-64013fc7d106
Nov 06 17:09:42 devstack sudo[94807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:42 devstack sudo[94807]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-79e7e79c-d78b-4be3-a53e-5e28d0bb424d tempest-SnapshotsActionsTest-2144663578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.3f19e4bd-3114-4936-a4a0-64013fc7d106" returned: 0 in 0.305s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:42 devstack sudo[94801]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-47234f2c-4551-4693-9625-f8729985e180 tempest-GroupSnapshotsTest-1647710575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-80d0138c-3916-470a-bd04-01a8d225369f" returned: 0 in 0.469s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-47234f2c-4551-4693-9625-f8729985e180 tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-80d0138c-3916-470a-bd04-01a8d225369f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:42 devstack sudo[94815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-80d0138c-3916-470a-bd04-01a8d225369f
Nov 06 17:09:42 devstack sudo[94815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-79e7e79c-d78b-4be3-a53e-5e28d0bb424d tempest-SnapshotsActionsTest-2144663578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.021s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:09:42 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-79e7e79c-d78b-4be3-a53e-5e28d0bb424d tempest-SnapshotsActionsTest-2144663578 None] Create snapshot completed successfully
Nov 06 17:09:42 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager._thread_info {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:09:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread count: 28 {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 17:09:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread info: [<_MainThread(MainThread, started 125183137599616)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125183027608256)>, <Thread(Thread-3 (stat_writer), started daemon 125183025243776)>, <Thread(Rabbit-heartbeat, started daemon 125183023512896)>, <Thread(Thread-5 (_runner), started daemon 125183023357120)>, <Thread(Thread-7 (_runner), started daemon 125183021306496)>, <Thread(fd_logger, started daemon 125183018711616)>, <Thread(privsep_reader, started daemon 125183017484224)>, <Thread(tpool_thread_0, started daemon 125183013742272)>, <Thread(tpool_thread_1, started daemon 125183005349568)>, <Thread(tpool_thread_2, started daemon 125182996956864)>, <Thread(tpool_thread_3, started daemon 125182988564160)>, <Thread(tpool_thread_4, started daemon 125182980171456)>, <Thread(tpool_thread_5, started daemon 125182971778752)>, <Thread(tpool_thread_6, started daemon 125182963386048)>, <Thread(tpool_thread_7, started daemon 125182954993344)>, <Thread(tpool_thread_8, started daemon 125182946600640)>, <Thread(tpool_thread_9, started daemon 125182938207936)>, <Thread(tpool_thread_10, started daemon 125182929815232)>, <Thread(tpool_thread_11, started daemon 125182921422528)>, <Thread(tpool_thread_12, started daemon 125182913013440)>, <Thread(tpool_thread_13, started daemon 125182904604352)>, <Thread(tpool_thread_14, started daemon 125182896195264)>, <Thread(tpool_thread_15, started daemon 125182887786176)>, <Thread(tpool_thread_16, started daemon 125182879377088)>, <Thread(tpool_thread_17, started daemon 125182870968000)>, <Thread(tpool_thread_18, started daemon 125182862558912)>, <Thread(tpool_thread_19, started daemon 125182854149824)>] {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 17:09:42 devstack sudo[94815]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-47234f2c-4551-4693-9625-f8729985e180 tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-80d0138c-3916-470a-bd04-01a8d225369f" returned: 0 in 0.266s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:42 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-47234f2c-4551-4693-9625-f8729985e180 tempest-GroupSnapshotsTest-1647710575 None] Lock "cinder-quobyte-80d0138c-3916-470a-bd04-01a8d225369f" released by "delete_volume" :: held 0.795s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:09:42 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-47234f2c-4551-4693-9625-f8729985e180 tempest-GroupSnapshotsTest-1647710575 None] Created reservations ['0a78b15c-a4e9-46ee-aa73-62d86cc5ed32'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:09:42 devstack cinder-volume[86856]: WARNING cinder.quota [None req-47234f2c-4551-4693-9625-f8729985e180 tempest-GroupSnapshotsTest-1647710575 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1751226402 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1751226402, it is now deprecated. Please use the default quota class for default quota.
Nov 06 17:09:42 devstack cinder-volume[86856]: WARNING cinder.quota [None req-47234f2c-4551-4693-9625-f8729985e180 tempest-GroupSnapshotsTest-1647710575 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1751226402 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1751226402, it is now deprecated. Please use the default quota class for default quota.
Nov 06 17:09:42 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-47234f2c-4551-4693-9625-f8729985e180 tempest-GroupSnapshotsTest-1647710575 None] Created reservations ['1b252bd0-086b-453f-8fe6-2515534a6c9d', '760db1d7-2293-456e-9ba1-adceeef72bc0', '95e37e24-d6f2-4bd8-9308-3bcb7a0d867e', '822f9c06-34c6-46ab-a27a-88106f968669'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:09:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-47234f2c-4551-4693-9625-f8729985e180 tempest-GroupSnapshotsTest-1647710575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:09:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-47234f2c-4551-4693-9625-f8729985e180 tempest-GroupSnapshotsTest-1647710575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:09:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-47234f2c-4551-4693-9625-f8729985e180 tempest-GroupSnapshotsTest-1647710575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:09:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-47234f2c-4551-4693-9625-f8729985e180 tempest-GroupSnapshotsTest-1647710575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:09:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-47234f2c-4551-4693-9625-f8729985e180 tempest-GroupSnapshotsTest-1647710575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:09:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-47234f2c-4551-4693-9625-f8729985e180 tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:42 devstack sudo[94818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:09:42 devstack sudo[94818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:43 devstack sudo[94818]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-47234f2c-4551-4693-9625-f8729985e180 tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.348s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:43 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-47234f2c-4551-4693-9625-f8729985e180 tempest-GroupSnapshotsTest-1647710575 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:09:43 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-47234f2c-4551-4693-9625-f8729985e180 tempest-GroupSnapshotsTest-1647710575 None] Delete group completed successfully.
Nov 06 17:09:43 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-c6400c04-9197-49ad-b7df-f382d7d135e6 tempest-GroupSnapshotsTest-1647710575 None] group_snapshot 69bd32a5-161f-4ec1-b413-e52429350430: deleting
Nov 06 17:09:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c6400c04-9197-49ad-b7df-f382d7d135e6 tempest-GroupSnapshotsTest-1647710575 None] group_snapshot 69bd32a5-161f-4ec1-b413-e52429350430: deleting {{(pid=86856) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 06 17:09:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ae4dd8ce-7768-410c-bcf4-77a8ccf0f23d tempest-SnapshotsActionsTest-1406578492 None] Acquiring lock "cinder-3f19e4bd-3114-4936-a4a0-64013fc7d106-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:09:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c6400c04-9197-49ad-b7df-f382d7d135e6 tempest-GroupSnapshotsTest-1647710575 None] Acquiring lock "cinder-quobyte-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:09:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ae4dd8ce-7768-410c-bcf4-77a8ccf0f23d tempest-SnapshotsActionsTest-1406578492 None] Lock "cinder-3f19e4bd-3114-4936-a4a0-64013fc7d106-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:09:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ae4dd8ce-7768-410c-bcf4-77a8ccf0f23d tempest-SnapshotsActionsTest-1406578492 None] Acquiring lock "cinder-quobyte-731c0d83-cea5-4222-8b14-66e27e7b3b48" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:09:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c6400c04-9197-49ad-b7df-f382d7d135e6 tempest-GroupSnapshotsTest-1647710575 None] Lock "cinder-quobyte-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:09:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c6400c04-9197-49ad-b7df-f382d7d135e6 tempest-GroupSnapshotsTest-1647710575 None] Acquiring lock "cinder-quobyte-ac5b4161-1d58-44f1-a2ec-c9aa45c60ce4" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:09:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ae4dd8ce-7768-410c-bcf4-77a8ccf0f23d tempest-SnapshotsActionsTest-1406578492 None] Lock "cinder-quobyte-731c0d83-cea5-4222-8b14-66e27e7b3b48" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:09:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ae4dd8ce-7768-410c-bcf4-77a8ccf0f23d tempest-SnapshotsActionsTest-1406578492 None] Acquiring lock "cinder-quobyte-3f19e4bd-3114-4936-a4a0-64013fc7d106" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:09:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c6400c04-9197-49ad-b7df-f382d7d135e6 tempest-GroupSnapshotsTest-1647710575 None] Lock "cinder-quobyte-ac5b4161-1d58-44f1-a2ec-c9aa45c60ce4" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:09:43 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-c6400c04-9197-49ad-b7df-f382d7d135e6 tempest-GroupSnapshotsTest-1647710575 None] Deleting offline snapshot ac5b4161-1d58-44f1-a2ec-c9aa45c60ce4 of volume 6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:09:43 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-c6400c04-9197-49ad-b7df-f382d7d135e6 tempest-GroupSnapshotsTest-1647710575 None] snapshot_file for this snap is: volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996.ac5b4161-1d58-44f1-a2ec-c9aa45c60ce4 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:09:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ae4dd8ce-7768-410c-bcf4-77a8ccf0f23d tempest-SnapshotsActionsTest-1406578492 None] Lock "cinder-quobyte-3f19e4bd-3114-4936-a4a0-64013fc7d106" acquired by "_delete_snapshot" :: waited 0.059s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:09:43 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-ae4dd8ce-7768-410c-bcf4-77a8ccf0f23d tempest-SnapshotsActionsTest-1406578492 None] Deleting offline snapshot 3f19e4bd-3114-4936-a4a0-64013fc7d106 of volume 731c0d83-cea5-4222-8b14-66e27e7b3b48 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:09:43 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-ae4dd8ce-7768-410c-bcf4-77a8ccf0f23d tempest-SnapshotsActionsTest-1406578492 None] snapshot_file for this snap is: volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.3f19e4bd-3114-4936-a4a0-64013fc7d106 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:09:43 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9e5840-bacc-4780-96fa-68ae8018ab25]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:09:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c6400c04-9197-49ad-b7df-f382d7d135e6 tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996.ac5b4161-1d58-44f1-a2ec-c9aa45c60ce4 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:43 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bff9f52-fb97-4cf0-b821-3df35f623fc0]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:09:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ae4dd8ce-7768-410c-bcf4-77a8ccf0f23d tempest-SnapshotsActionsTest-1406578492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.3f19e4bd-3114-4936-a4a0-64013fc7d106 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:43 devstack sudo[94821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996.ac5b4161-1d58-44f1-a2ec-c9aa45c60ce4
Nov 06 17:09:43 devstack sudo[94821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:43 devstack sudo[94822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.3f19e4bd-3114-4936-a4a0-64013fc7d106
Nov 06 17:09:43 devstack sudo[94822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:44 devstack sudo[94821]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c6400c04-9197-49ad-b7df-f382d7d135e6 tempest-GroupSnapshotsTest-1647710575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996.ac5b4161-1d58-44f1-a2ec-c9aa45c60ce4" returned: 0 in 0.480s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:44 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-c6400c04-9197-49ad-b7df-f382d7d135e6 tempest-GroupSnapshotsTest-1647710575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:09:44 devstack sudo[94822]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:44 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bcbbf9-4934-4529-bab8-4499eb2935c4]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:09:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c6400c04-9197-49ad-b7df-f382d7d135e6 tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ae4dd8ce-7768-410c-bcf4-77a8ccf0f23d tempest-SnapshotsActionsTest-1406578492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.3f19e4bd-3114-4936-a4a0-64013fc7d106" returned: 0 in 0.507s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:44 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-ae4dd8ce-7768-410c-bcf4-77a8ccf0f23d tempest-SnapshotsActionsTest-1406578492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-731c0d83-cea5-4222-8b14-66e27e7b3b48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:09:44 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[26717835-f8a9-4acf-a1f4-9e53bd775d0c]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:09:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ae4dd8ce-7768-410c-bcf4-77a8ccf0f23d tempest-SnapshotsActionsTest-1406578492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:44 devstack sudo[94833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996
Nov 06 17:09:44 devstack sudo[94833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:44 devstack sudo[94834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49
Nov 06 17:09:44 devstack sudo[94834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:44 devstack sudo[94833]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:44 devstack sudo[94834]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c6400c04-9197-49ad-b7df-f382d7d135e6 tempest-GroupSnapshotsTest-1647710575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996" returned: 0 in 0.673s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ae4dd8ce-7768-410c-bcf4-77a8ccf0f23d tempest-SnapshotsActionsTest-1406578492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49" returned: 0 in 0.613s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c6400c04-9197-49ad-b7df-f382d7d135e6 tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996.ac5b4161-1d58-44f1-a2ec-c9aa45c60ce4 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:44 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-ae4dd8ce-7768-410c-bcf4-77a8ccf0f23d tempest-SnapshotsActionsTest-1406578492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-731c0d83-cea5-4222-8b14-66e27e7b3b48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:09:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ae4dd8ce-7768-410c-bcf4-77a8ccf0f23d tempest-SnapshotsActionsTest-1406578492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.3f19e4bd-3114-4936-a4a0-64013fc7d106 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:44 devstack sudo[94849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996.ac5b4161-1d58-44f1-a2ec-c9aa45c60ce4
Nov 06 17:09:44 devstack sudo[94849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:44 devstack sudo[94850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.3f19e4bd-3114-4936-a4a0-64013fc7d106
Nov 06 17:09:44 devstack sudo[94850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:45 devstack sudo[94849]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c6400c04-9197-49ad-b7df-f382d7d135e6 tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996.ac5b4161-1d58-44f1-a2ec-c9aa45c60ce4" returned: 0 in 0.429s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c6400c04-9197-49ad-b7df-f382d7d135e6 tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996.ac5b4161-1d58-44f1-a2ec-c9aa45c60ce4 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:45 devstack sudo[94850]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ae4dd8ce-7768-410c-bcf4-77a8ccf0f23d tempest-SnapshotsActionsTest-1406578492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.3f19e4bd-3114-4936-a4a0-64013fc7d106" returned: 0 in 0.442s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ae4dd8ce-7768-410c-bcf4-77a8ccf0f23d tempest-SnapshotsActionsTest-1406578492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.3f19e4bd-3114-4936-a4a0-64013fc7d106 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:45 devstack sudo[94862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996.ac5b4161-1d58-44f1-a2ec-c9aa45c60ce4
Nov 06 17:09:45 devstack sudo[94862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:45 devstack sudo[94863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.3f19e4bd-3114-4936-a4a0-64013fc7d106
Nov 06 17:09:45 devstack sudo[94863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:45 devstack sudo[94863]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:45 devstack sudo[94862]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c6400c04-9197-49ad-b7df-f382d7d135e6 tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996.ac5b4161-1d58-44f1-a2ec-c9aa45c60ce4" returned: 0 in 0.314s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ae4dd8ce-7768-410c-bcf4-77a8ccf0f23d tempest-SnapshotsActionsTest-1406578492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.3f19e4bd-3114-4936-a4a0-64013fc7d106" returned: 0 in 0.291s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:45 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ae4dd8ce-7768-410c-bcf4-77a8ccf0f23d tempest-SnapshotsActionsTest-1406578492 None] Lock "cinder-quobyte-3f19e4bd-3114-4936-a4a0-64013fc7d106" released by "_delete_snapshot" :: held 2.044s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:09:45 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c6400c04-9197-49ad-b7df-f382d7d135e6 tempest-GroupSnapshotsTest-1647710575 None] Lock "cinder-quobyte-ac5b4161-1d58-44f1-a2ec-c9aa45c60ce4" released by "_delete_snapshot" :: held 2.093s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:09:45 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c6400c04-9197-49ad-b7df-f382d7d135e6 tempest-GroupSnapshotsTest-1647710575 None] Lock "cinder-quobyte-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996" released by "delete_snapshot" :: held 2.140s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:09:45 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ae4dd8ce-7768-410c-bcf4-77a8ccf0f23d tempest-SnapshotsActionsTest-1406578492 None] Lock "cinder-quobyte-731c0d83-cea5-4222-8b14-66e27e7b3b48" released by "delete_snapshot" :: held 2.124s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:09:45 devstack cinder-volume[86856]: WARNING cinder.quota [None req-c6400c04-9197-49ad-b7df-f382d7d135e6 tempest-GroupSnapshotsTest-1647710575 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1751226402 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1751226402, it is now deprecated. Please use the default quota class for default quota.
Nov 06 17:09:45 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-c6400c04-9197-49ad-b7df-f382d7d135e6 tempest-GroupSnapshotsTest-1647710575 None] Created reservations ['cad9d718-b4e3-4228-8aeb-57a23b33009b', 'a6f89149-02dd-4e36-8f5d-2a73ceb18d83', '5013fce5-1fb6-45c1-9909-bcb6c5367bd6', '4de3fb47-f1ca-4a26-945b-3de6e21326c5'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:09:45 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-ae4dd8ce-7768-410c-bcf4-77a8ccf0f23d tempest-SnapshotsActionsTest-1406578492 None] Created reservations ['7be0fedf-9f67-4ec4-aae3-bd3b5808ddd2', 'bd316c38-581a-4b57-8f1d-ea77235c5f3a', 'f7fbdc8d-e7ea-4906-b2e4-6581a3f018e9', '7243eeed-38b3-4c20-8b5a-98af51cd9026'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:09:45 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-c6400c04-9197-49ad-b7df-f382d7d135e6 tempest-GroupSnapshotsTest-1647710575 None] group_snapshot 69bd32a5-161f-4ec1-b413-e52429350430: deleted successfully
Nov 06 17:09:45 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-ae4dd8ce-7768-410c-bcf4-77a8ccf0f23d tempest-SnapshotsActionsTest-1406578492 None] Delete snapshot completed successfully.
Nov 06 17:09:45 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ae4dd8ce-7768-410c-bcf4-77a8ccf0f23d tempest-SnapshotsActionsTest-1406578492 None] Lock "cinder-3f19e4bd-3114-4936-a4a0-64013fc7d106-delete_snapshot" released by "delete_snapshot" :: held 2.414s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:09:47 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1fafdbc9-2f4c-48d5-9127-d4533c96c627 tempest-GroupSnapshotsTest-1647710575 None] Acquiring lock "cinder-quobyte-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:09:47 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1fafdbc9-2f4c-48d5-9127-d4533c96c627 tempest-GroupSnapshotsTest-1647710575 None] Lock "cinder-quobyte-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996" acquired by "delete_volume" :: waited 0.029s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:09:47 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[85021ae9-8f9d-467a-8cb4-ebdf05074ad0]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:09:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1fafdbc9-2f4c-48d5-9127-d4533c96c627 tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:47 devstack sudo[94868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996
Nov 06 17:09:47 devstack sudo[94868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:47 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-283f6cb4-bde1-4d91-aafe-6ccba2c4b19a tempest-SnapshotsActionsTest-2144663578 None] Acquiring lock "cinder-bcf51a63-4349-4985-af62-e27a079ccf49-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:09:47 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-283f6cb4-bde1-4d91-aafe-6ccba2c4b19a tempest-SnapshotsActionsTest-2144663578 None] Lock "cinder-bcf51a63-4349-4985-af62-e27a079ccf49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:09:47 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-283f6cb4-bde1-4d91-aafe-6ccba2c4b19a tempest-SnapshotsActionsTest-2144663578 None] Acquiring lock "cinder-quobyte-731c0d83-cea5-4222-8b14-66e27e7b3b48" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:09:47 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-283f6cb4-bde1-4d91-aafe-6ccba2c4b19a tempest-SnapshotsActionsTest-2144663578 None] Lock "cinder-quobyte-731c0d83-cea5-4222-8b14-66e27e7b3b48" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:09:47 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-283f6cb4-bde1-4d91-aafe-6ccba2c4b19a tempest-SnapshotsActionsTest-2144663578 None] Acquiring lock "cinder-quobyte-bcf51a63-4349-4985-af62-e27a079ccf49" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:09:47 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-283f6cb4-bde1-4d91-aafe-6ccba2c4b19a tempest-SnapshotsActionsTest-2144663578 None] Lock "cinder-quobyte-bcf51a63-4349-4985-af62-e27a079ccf49" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:09:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-283f6cb4-bde1-4d91-aafe-6ccba2c4b19a tempest-SnapshotsActionsTest-2144663578 None] Deleting offline snapshot bcf51a63-4349-4985-af62-e27a079ccf49 of volume 731c0d83-cea5-4222-8b14-66e27e7b3b48 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:09:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-283f6cb4-bde1-4d91-aafe-6ccba2c4b19a tempest-SnapshotsActionsTest-2144663578 None] snapshot_file for this snap is: volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:09:47 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[8000fe13-a9e5-4dfd-9852-2b77707a81d4]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:09:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-283f6cb4-bde1-4d91-aafe-6ccba2c4b19a tempest-SnapshotsActionsTest-2144663578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:47 devstack sudo[94870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49
Nov 06 17:09:47 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:47 devstack sudo[94868]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1fafdbc9-2f4c-48d5-9127-d4533c96c627 tempest-GroupSnapshotsTest-1647710575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996" returned: 0 in 0.554s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1fafdbc9-2f4c-48d5-9127-d4533c96c627 tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:47 devstack sudo[94876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996
Nov 06 17:09:47 devstack sudo[94876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:48 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-283f6cb4-bde1-4d91-aafe-6ccba2c4b19a tempest-SnapshotsActionsTest-2144663578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49" returned: 0 in 0.453s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:48 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-283f6cb4-bde1-4d91-aafe-6ccba2c4b19a tempest-SnapshotsActionsTest-2144663578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-731c0d83-cea5-4222-8b14-66e27e7b3b48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:09:48 devstack sudo[94876]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1fafdbc9-2f4c-48d5-9127-d4533c96c627 tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996" returned: 0 in 0.272s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:48 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2b047a-f50c-4fd3-8ea0-9339df394095]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:09:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-283f6cb4-bde1-4d91-aafe-6ccba2c4b19a tempest-SnapshotsActionsTest-2144663578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:48 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1fafdbc9-2f4c-48d5-9127-d4533c96c627 tempest-GroupSnapshotsTest-1647710575 None] Lock "cinder-quobyte-6cecaaf9-57bb-4aaf-b9c2-d4136ebe7996" released by "delete_volume" :: held 0.953s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:09:48 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-1fafdbc9-2f4c-48d5-9127-d4533c96c627 tempest-GroupSnapshotsTest-1647710575 None] Created reservations ['77d96b8f-5ccf-4f05-aa71-3bf8dd9c89f5'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:09:48 devstack sudo[94883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48
Nov 06 17:09:48 devstack sudo[94883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:48 devstack cinder-volume[86856]: WARNING cinder.db.api [None req-1fafdbc9-2f4c-48d5-9127-d4533c96c627 tempest-GroupSnapshotsTest-1647710575 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1751226402']
Nov 06 17:09:48 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-1fafdbc9-2f4c-48d5-9127-d4533c96c627 tempest-GroupSnapshotsTest-1647710575 None] Created reservations ['9210fc56-93b8-4fa1-a113-d93e63644b77', 'c7accff9-ba3e-41e9-8394-bf159da2383e', 'ecfd1ed1-0f2d-4273-a181-623598ebfc09', 'c13c63f6-19ea-4b53-b024-c24d6d9cc342'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:09:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1fafdbc9-2f4c-48d5-9127-d4533c96c627 tempest-GroupSnapshotsTest-1647710575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:09:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1fafdbc9-2f4c-48d5-9127-d4533c96c627 tempest-GroupSnapshotsTest-1647710575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:09:48 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1fafdbc9-2f4c-48d5-9127-d4533c96c627 tempest-GroupSnapshotsTest-1647710575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:09:48 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1fafdbc9-2f4c-48d5-9127-d4533c96c627 tempest-GroupSnapshotsTest-1647710575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:09:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1fafdbc9-2f4c-48d5-9127-d4533c96c627 tempest-GroupSnapshotsTest-1647710575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:09:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1fafdbc9-2f4c-48d5-9127-d4533c96c627 tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:48 devstack sudo[94885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:09:48 devstack sudo[94885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:48 devstack sudo[94883]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-283f6cb4-bde1-4d91-aafe-6ccba2c4b19a tempest-SnapshotsActionsTest-2144663578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48" returned: 0 in 0.493s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-283f6cb4-bde1-4d91-aafe-6ccba2c4b19a tempest-SnapshotsActionsTest-2144663578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:48 devstack sudo[94890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49
Nov 06 17:09:48 devstack sudo[94890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:48 devstack sudo[94885]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1fafdbc9-2f4c-48d5-9127-d4533c96c627 tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.359s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:48 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-1fafdbc9-2f4c-48d5-9127-d4533c96c627 tempest-GroupSnapshotsTest-1647710575 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:09:48 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-1fafdbc9-2f4c-48d5-9127-d4533c96c627 tempest-GroupSnapshotsTest-1647710575 None] Delete group completed successfully.
Nov 06 17:09:49 devstack sudo[94890]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-283f6cb4-bde1-4d91-aafe-6ccba2c4b19a tempest-SnapshotsActionsTest-2144663578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49" returned: 0 in 0.558s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-283f6cb4-bde1-4d91-aafe-6ccba2c4b19a tempest-SnapshotsActionsTest-2144663578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:49 devstack sudo[94897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49
Nov 06 17:09:49 devstack sudo[94897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:49 devstack sudo[94897]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-283f6cb4-bde1-4d91-aafe-6ccba2c4b19a tempest-SnapshotsActionsTest-2144663578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48.bcf51a63-4349-4985-af62-e27a079ccf49" returned: 0 in 0.278s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:49 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-283f6cb4-bde1-4d91-aafe-6ccba2c4b19a tempest-SnapshotsActionsTest-2144663578 None] Lock "cinder-quobyte-bcf51a63-4349-4985-af62-e27a079ccf49" released by "_delete_snapshot" :: held 1.983s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:09:49 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-283f6cb4-bde1-4d91-aafe-6ccba2c4b19a tempest-SnapshotsActionsTest-2144663578 None] Lock "cinder-quobyte-731c0d83-cea5-4222-8b14-66e27e7b3b48" released by "delete_snapshot" :: held 2.022s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:09:49 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-283f6cb4-bde1-4d91-aafe-6ccba2c4b19a tempest-SnapshotsActionsTest-2144663578 None] Created reservations ['a4c55fad-af9e-400c-880d-2e798fef2f80', 'a2dab31d-2c60-4c3b-bc1f-75db5a6752c6', 'b854be76-6c26-4d40-9678-8ca2aa08da38', 'e0a8fb54-bc75-45ec-8727-94a97dfcc175'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:09:49 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-283f6cb4-bde1-4d91-aafe-6ccba2c4b19a tempest-SnapshotsActionsTest-2144663578 None] Delete snapshot completed successfully.
Nov 06 17:09:49 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-283f6cb4-bde1-4d91-aafe-6ccba2c4b19a tempest-SnapshotsActionsTest-2144663578 None] Lock "cinder-bcf51a63-4349-4985-af62-e27a079ccf49-delete_snapshot" released by "delete_snapshot" :: held 2.367s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:09:50 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-c18ea726-7996-41b3-898d-967a60a4ebc9 tempest-GroupSnapshotsTest-1647710575 None] Group tempest-GroupSnapshotsTest-Group-594668538: creating
Nov 06 17:09:50 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-c18ea726-7996-41b3-898d-967a60a4ebc9 tempest-GroupSnapshotsTest-1647710575 None] Group tempest-GroupSnapshotsTest-Group-594668538: created successfully
Nov 06 17:09:50 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-c18ea726-7996-41b3-898d-967a60a4ebc9 tempest-GroupSnapshotsTest-1647710575 None] Create group completed successfully.
Nov 06 17:09:50 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5544e097-8509-469b-9091-fa354b5fcac6 tempest-SnapshotsActionsTest-2144663578 None] Acquiring lock "cinder-731c0d83-cea5-4222-8b14-66e27e7b3b48-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:09:50 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5544e097-8509-469b-9091-fa354b5fcac6 tempest-SnapshotsActionsTest-2144663578 None] Lock "cinder-731c0d83-cea5-4222-8b14-66e27e7b3b48-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:09:50 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5544e097-8509-469b-9091-fa354b5fcac6 tempest-SnapshotsActionsTest-2144663578 None] Acquiring lock "cinder-quobyte-731c0d83-cea5-4222-8b14-66e27e7b3b48" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:09:50 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5544e097-8509-469b-9091-fa354b5fcac6 tempest-SnapshotsActionsTest-2144663578 None] Lock "cinder-quobyte-731c0d83-cea5-4222-8b14-66e27e7b3b48" acquired by "delete_volume" :: waited 0.023s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:09:51 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[713f4bf2-2ff3-48f2-8f40-29e8b7445cbe]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:09:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5544e097-8509-469b-9091-fa354b5fcac6 tempest-SnapshotsActionsTest-2144663578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:51 devstack sudo[94901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48
Nov 06 17:09:51 devstack sudo[94901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:51 devstack sudo[94901]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5544e097-8509-469b-9091-fa354b5fcac6 tempest-SnapshotsActionsTest-2144663578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48" returned: 0 in 0.521s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5544e097-8509-469b-9091-fa354b5fcac6 tempest-SnapshotsActionsTest-2144663578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:51 devstack sudo[94906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48
Nov 06 17:09:51 devstack sudo[94906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:51 devstack sudo[94906]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5544e097-8509-469b-9091-fa354b5fcac6 tempest-SnapshotsActionsTest-2144663578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-731c0d83-cea5-4222-8b14-66e27e7b3b48" returned: 0 in 0.348s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:51 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5544e097-8509-469b-9091-fa354b5fcac6 tempest-SnapshotsActionsTest-2144663578 None] Lock "cinder-quobyte-731c0d83-cea5-4222-8b14-66e27e7b3b48" released by "delete_volume" :: held 0.963s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-5544e097-8509-469b-9091-fa354b5fcac6 tempest-SnapshotsActionsTest-2144663578 None] Created reservations ['d759ace7-15ac-4270-80be-4ae2b588a98c', 'd8a22457-39ad-4a12-bcee-4d51736e038d', '272167cf-3261-4c44-bfd2-8b2b2c14cee6', 'cdfdabae-1498-4f95-a043-215462a3e07c'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5544e097-8509-469b-9091-fa354b5fcac6 tempest-SnapshotsActionsTest-2144663578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5544e097-8509-469b-9091-fa354b5fcac6 tempest-SnapshotsActionsTest-2144663578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5544e097-8509-469b-9091-fa354b5fcac6 tempest-SnapshotsActionsTest-2144663578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5544e097-8509-469b-9091-fa354b5fcac6 tempest-SnapshotsActionsTest-2144663578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5544e097-8509-469b-9091-fa354b5fcac6 tempest-SnapshotsActionsTest-2144663578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5544e097-8509-469b-9091-fa354b5fcac6 tempest-SnapshotsActionsTest-2144663578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:52 devstack sudo[94909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:09:52 devstack sudo[94909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b45eb48-685c-4afb-9315-50a3ae0fc2e6 tempest-GroupSnapshotsTest-1647710575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7b45eb48-685c-4afb-9315-50a3ae0fc2e6 tempest-GroupSnapshotsTest-1647710575 None] Flow 'volume_create_manager' (64fc4b51-51ad-49c4-a06e-30a3ceca6e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7b45eb48-685c-4afb-9315-50a3ae0fc2e6 tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7460f47d-65ef-4108-be1f-12eeb4c0ec72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7b45eb48-685c-4afb-9315-50a3ae0fc2e6 tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7460f47d-65ef-4108-be1f-12eeb4c0ec72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1930398289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=34b94421-8ecb-4964-ba2a-372082cf1f27,host='devstack@QuobyteHD#QuobyteHD',id=891e44c8-54e3-4feb-bfef-090b2b1ffab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dd9c18dca9a4bb599b8d91b0f3816e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:09:52Z,use_quota=True,user_id='9a4d2f51c3094da4a21a4d29425ef175',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b04f57d-3bf6-4ee9-aee6-dc1fdb2552dd),volume_type_id=4b04f57d-3bf6-4ee9-aee6-dc1fdb2552dd)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7b45eb48-685c-4afb-9315-50a3ae0fc2e6 tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (848ce678-10e0-436c-a454-a2375fd5ba75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7b45eb48-685c-4afb-9315-50a3ae0fc2e6 tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (848ce678-10e0-436c-a454-a2375fd5ba75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7b45eb48-685c-4afb-9315-50a3ae0fc2e6 tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d5144c9-0133-4316-8516-22ea1c46c12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7b45eb48-685c-4afb-9315-50a3ae0fc2e6 tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d5144c9-0133-4316-8516-22ea1c46c12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '891e44c8-54e3-4feb-bfef-090b2b1ffab5', 'volume_name': 'volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7b45eb48-685c-4afb-9315-50a3ae0fc2e6 tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5833252e-8337-4c60-b47f-cdd9523d9915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7b45eb48-685c-4afb-9315-50a3ae0fc2e6 tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5833252e-8337-4c60-b47f-cdd9523d9915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7b45eb48-685c-4afb-9315-50a3ae0fc2e6 tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d4cf0ac-4c3a-4c3b-9cc9-ef27fa7e59b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:52 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-7b45eb48-685c-4afb-9315-50a3ae0fc2e6 tempest-GroupSnapshotsTest-1647710575 None] Volume 891e44c8-54e3-4feb-bfef-090b2b1ffab5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5', 'volume_size': 1}
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7b45eb48-685c-4afb-9315-50a3ae0fc2e6 tempest-GroupSnapshotsTest-1647710575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7b45eb48-685c-4afb-9315-50a3ae0fc2e6 tempest-GroupSnapshotsTest-1647710575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7b45eb48-685c-4afb-9315-50a3ae0fc2e6 tempest-GroupSnapshotsTest-1647710575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=34b94421-8ecb-4964-ba2a-372082cf1f27,created_at=2026-11-06T16:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1930398289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=34b94421-8ecb-4964-ba2a-372082cf1f27,host='devstack@QuobyteHD#QuobyteHD',id=891e44c8-54e3-4feb-bfef-090b2b1ffab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dd9c18dca9a4bb599b8d91b0f3816e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:09:52Z,use_quota=True,user_id='9a4d2f51c3094da4a21a4d29425ef175',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b04f57d-3bf6-4ee9-aee6-dc1fdb2552dd),volume_type_id=4b04f57d-3bf6-4ee9-aee6-dc1fdb2552dd)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-7b45eb48-685c-4afb-9315-50a3ae0fc2e6 tempest-GroupSnapshotsTest-1647710575 None] Creating volume 891e44c8-54e3-4feb-bfef-090b2b1ffab5 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7b45eb48-685c-4afb-9315-50a3ae0fc2e6 tempest-GroupSnapshotsTest-1647710575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7b45eb48-685c-4afb-9315-50a3ae0fc2e6 tempest-GroupSnapshotsTest-1647710575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7b45eb48-685c-4afb-9315-50a3ae0fc2e6 tempest-GroupSnapshotsTest-1647710575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7b45eb48-685c-4afb-9315-50a3ae0fc2e6 tempest-GroupSnapshotsTest-1647710575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7b45eb48-685c-4afb-9315-50a3ae0fc2e6 tempest-GroupSnapshotsTest-1647710575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7b45eb48-685c-4afb-9315-50a3ae0fc2e6 tempest-GroupSnapshotsTest-1647710575 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:09:52 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-7b45eb48-685c-4afb-9315-50a3ae0fc2e6 tempest-GroupSnapshotsTest-1647710575 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7b45eb48-685c-4afb-9315-50a3ae0fc2e6 tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:52 devstack sudo[94912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5 1073741824
Nov 06 17:09:52 devstack sudo[94912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:52 devstack sudo[94909]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5544e097-8509-469b-9091-fa354b5fcac6 tempest-SnapshotsActionsTest-2144663578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.485s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-5544e097-8509-469b-9091-fa354b5fcac6 tempest-SnapshotsActionsTest-2144663578 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:09:52 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-5544e097-8509-469b-9091-fa354b5fcac6 tempest-SnapshotsActionsTest-2144663578 None] Deleted volume successfully.
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Flow 'volume_create_manager' (a23dce74-cb3a-4ffe-ae82-73248d422d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a049117c-f97b-4ed8-ab29-ab1e6322efa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a049117c-f97b-4ed8-ab29-ab1e6322efa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-860812996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=336f2799-2368-4a6a-957c-874568fbb2b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8d87582aba4a13ba0a5a9bbe66bcaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:09:53Z,use_quota=True,user_id='ffab8d0e1f5349db8061d1b146356ffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f183de84-c562-4fcb-a6fa-8709f4e2bde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f183de84-c562-4fcb-a6fa-8709f4e2bde6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49e9a098-c1d5-442b-b74d-e548d0464667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG cinder.image.glance [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Creating Keystone auth plugin from conf {{(pid=86856) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 06 17:09:52 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5544e097-8509-469b-9091-fa354b5fcac6 tempest-SnapshotsActionsTest-2144663578 None] Lock "cinder-731c0d83-cea5-4222-8b14-66e27e7b3b48-delete_volume" released by "delete_volume" :: held 1.906s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:09:53 devstack sudo[94912]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7b45eb48-685c-4afb-9315-50a3ae0fc2e6 tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5 1073741824" returned: 0 in 0.738s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7b45eb48-685c-4afb-9315-50a3ae0fc2e6 tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:53 devstack sudo[94919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5
Nov 06 17:09:53 devstack sudo[94919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:53 devstack sudo[94919]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7b45eb48-685c-4afb-9315-50a3ae0fc2e6 tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5" returned: 0 in 0.293s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:53 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7b45eb48-685c-4afb-9315-50a3ae0fc2e6 tempest-GroupSnapshotsTest-1647710575 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:09:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7b45eb48-685c-4afb-9315-50a3ae0fc2e6 tempest-GroupSnapshotsTest-1647710575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:09:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7b45eb48-685c-4afb-9315-50a3ae0fc2e6 tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d4cf0ac-4c3a-4c3b-9cc9-ef27fa7e59b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7b45eb48-685c-4afb-9315-50a3ae0fc2e6 tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d28c087-d709-4c6b-8159-b9303897edbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:53 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-7b45eb48-685c-4afb-9315-50a3ae0fc2e6 tempest-GroupSnapshotsTest-1647710575 None] Volume volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5 (891e44c8-54e3-4feb-bfef-090b2b1ffab5): created successfully
Nov 06 17:09:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7b45eb48-685c-4afb-9315-50a3ae0fc2e6 tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d28c087-d709-4c6b-8159-b9303897edbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7b45eb48-685c-4afb-9315-50a3ae0fc2e6 tempest-GroupSnapshotsTest-1647710575 None] Flow 'volume_create_manager' (64fc4b51-51ad-49c4-a06e-30a3ceca6e33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:09:53 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-7b45eb48-685c-4afb-9315-50a3ae0fc2e6 tempest-GroupSnapshotsTest-1647710575 None] Created volume successfully.
Nov 06 17:09:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49e9a098-c1d5-442b-b74d-e548d0464667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '336f2799-2368-4a6a-957c-874568fbb2b5', 'volume_name': 'volume-336f2799-2368-4a6a-957c-874568fbb2b5', 'volume_size': 1, 'image_id': '420ae2ee-253a-40a6-ad62-b130f2314d4a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/420ae2ee-253a-40a6-ad62-b130f2314d4a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '805e2cf12fa14002ae5dfa994733f868', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '420ae2ee-253a-40a6-ad62-b130f2314d4a', 'created_at': datetime.datetime(2026, 11, 6, 15, 57, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 15, 57, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/420ae2ee-253a-40a6-ad62-b130f2314d4a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x71da71274590>}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dd40602-b343-4aeb-a788-2e47d6600486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dd40602-b343-4aeb-a788-2e47d6600486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4185f151-8145-4868-b83c-cdaaee48c3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:54 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Volume 336f2799-2368-4a6a-957c-874568fbb2b5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-336f2799-2368-4a6a-957c-874568fbb2b5', 'volume_size': 1, 'image_id': '420ae2ee-253a-40a6-ad62-b130f2314d4a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/420ae2ee-253a-40a6-ad62-b130f2314d4a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '805e2cf12fa14002ae5dfa994733f868', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '420ae2ee-253a-40a6-ad62-b130f2314d4a', 'created_at': datetime.datetime(2026, 11, 6, 15, 57, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 15, 57, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/420ae2ee-253a-40a6-ad62-b130f2314d4a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x71da71274590>}
Nov 06 17:09:54 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Trying to clone 336f2799-2368-4a6a-957c-874568fbb2b5 from image 420ae2ee-253a-40a6-ad62-b130f2314d4a at location (None, [{'url': 'file:///opt/stack/data/glance/images/420ae2ee-253a-40a6-ad62-b130f2314d4a', 'metadata': {}}]). {{(pid=86856) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 06 17:09:54 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_bchna984devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86856) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 06 17:09:54 devstack cinder-volume[86856]: INFO cinder.image.image_utils [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Image download 20.69 MB at 20.69 MB/s
Nov 06 17:09:54 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4a4b83-22d4-4e8a-a311-9c24df600746]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:09:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_bchna984devstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:54 devstack sudo[94923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_bchna984devstack@QuobyteHD
Nov 06 17:09:54 devstack sudo[94923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:54 devstack sudo[94923]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_bchna984devstack@QuobyteHD" returned: 0 in 0.394s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:54 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Temporary image 420ae2ee-253a-40a6-ad62-b130f2314d4a is fetched for user ffab8d0e1f5349db8061d1b146356ffc. {{(pid=86856) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 06 17:09:55 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e4a914-5fc2-4295-80cd-f8ca8a4c8bf3]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:09:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_bchna984devstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:55 devstack sudo[94928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_bchna984devstack@QuobyteHD
Nov 06 17:09:55 devstack sudo[94928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:55 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-bae833ee-f774-4a72-88e7-bacd1edfbbd9 tempest-GroupSnapshotsTest-1647710575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:09:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bae833ee-f774-4a72-88e7-bacd1edfbbd9 tempest-GroupSnapshotsTest-1647710575 None] Flow 'volume_create_manager' (54248f91-e2e7-4b98-818f-b2047d72a4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:09:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bae833ee-f774-4a72-88e7-bacd1edfbbd9 tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96852791-751b-4458-ba09-5c0b3492e79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bae833ee-f774-4a72-88e7-bacd1edfbbd9 tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96852791-751b-4458-ba09-5c0b3492e79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-905816042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=34b94421-8ecb-4964-ba2a-372082cf1f27,host='devstack@QuobyteHD#QuobyteHD',id=43ec1a53-22d8-4dc1-b4cc-78cb391d9856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dd9c18dca9a4bb599b8d91b0f3816e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:09:55Z,use_quota=True,user_id='9a4d2f51c3094da4a21a4d29425ef175',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b04f57d-3bf6-4ee9-aee6-dc1fdb2552dd),volume_type_id=4b04f57d-3bf6-4ee9-aee6-dc1fdb2552dd)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bae833ee-f774-4a72-88e7-bacd1edfbbd9 tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b2e5785-f77f-4658-b9a5-c45dced9a328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bae833ee-f774-4a72-88e7-bacd1edfbbd9 tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b2e5785-f77f-4658-b9a5-c45dced9a328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bae833ee-f774-4a72-88e7-bacd1edfbbd9 tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (771b361d-c127-4ac6-8be6-af221646f304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bae833ee-f774-4a72-88e7-bacd1edfbbd9 tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (771b361d-c127-4ac6-8be6-af221646f304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43ec1a53-22d8-4dc1-b4cc-78cb391d9856', 'volume_name': 'volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bae833ee-f774-4a72-88e7-bacd1edfbbd9 tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b2669ff-9848-4387-9e9a-d1c0f8177199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bae833ee-f774-4a72-88e7-bacd1edfbbd9 tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b2669ff-9848-4387-9e9a-d1c0f8177199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bae833ee-f774-4a72-88e7-bacd1edfbbd9 tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ade393-14e6-4ef7-b584-c580b54d963c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:55 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-bae833ee-f774-4a72-88e7-bacd1edfbbd9 tempest-GroupSnapshotsTest-1647710575 None] Volume 43ec1a53-22d8-4dc1-b4cc-78cb391d9856: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856', 'volume_size': 1}
Nov 06 17:09:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bae833ee-f774-4a72-88e7-bacd1edfbbd9 tempest-GroupSnapshotsTest-1647710575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:09:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bae833ee-f774-4a72-88e7-bacd1edfbbd9 tempest-GroupSnapshotsTest-1647710575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:09:55 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bae833ee-f774-4a72-88e7-bacd1edfbbd9 tempest-GroupSnapshotsTest-1647710575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=34b94421-8ecb-4964-ba2a-372082cf1f27,created_at=2026-11-06T16:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-905816042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=34b94421-8ecb-4964-ba2a-372082cf1f27,host='devstack@QuobyteHD#QuobyteHD',id=43ec1a53-22d8-4dc1-b4cc-78cb391d9856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dd9c18dca9a4bb599b8d91b0f3816e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:09:55Z,use_quota=True,user_id='9a4d2f51c3094da4a21a4d29425ef175',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b04f57d-3bf6-4ee9-aee6-dc1fdb2552dd),volume_type_id=4b04f57d-3bf6-4ee9-aee6-dc1fdb2552dd)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:09:55 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-bae833ee-f774-4a72-88e7-bacd1edfbbd9 tempest-GroupSnapshotsTest-1647710575 None] Creating volume 43ec1a53-22d8-4dc1-b4cc-78cb391d9856 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:09:55 devstack sudo[94928]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bae833ee-f774-4a72-88e7-bacd1edfbbd9 tempest-GroupSnapshotsTest-1647710575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:09:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bae833ee-f774-4a72-88e7-bacd1edfbbd9 tempest-GroupSnapshotsTest-1647710575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:09:55 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bae833ee-f774-4a72-88e7-bacd1edfbbd9 tempest-GroupSnapshotsTest-1647710575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:09:55 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bae833ee-f774-4a72-88e7-bacd1edfbbd9 tempest-GroupSnapshotsTest-1647710575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:09:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bae833ee-f774-4a72-88e7-bacd1edfbbd9 tempest-GroupSnapshotsTest-1647710575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:09:55 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bae833ee-f774-4a72-88e7-bacd1edfbbd9 tempest-GroupSnapshotsTest-1647710575 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:09:55 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-bae833ee-f774-4a72-88e7-bacd1edfbbd9 tempest-GroupSnapshotsTest-1647710575 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:09:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bae833ee-f774-4a72-88e7-bacd1edfbbd9 tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_bchna984devstack@QuobyteHD" returned: 0 in 0.529s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:09:55 devstack sudo[94933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856 1073741824
Nov 06 17:09:55 devstack sudo[94933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:56 devstack sudo[94933]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bae833ee-f774-4a72-88e7-bacd1edfbbd9 tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856 1073741824" returned: 0 in 0.544s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bae833ee-f774-4a72-88e7-bacd1edfbbd9 tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:56 devstack sudo[94940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856
Nov 06 17:09:56 devstack sudo[94940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:56 devstack sudo[94940]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bae833ee-f774-4a72-88e7-bacd1edfbbd9 tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856" returned: 0 in 0.266s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:56 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bae833ee-f774-4a72-88e7-bacd1edfbbd9 tempest-GroupSnapshotsTest-1647710575 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:09:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bae833ee-f774-4a72-88e7-bacd1edfbbd9 tempest-GroupSnapshotsTest-1647710575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:09:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.846s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:09:56 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-860812996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=336f2799-2368-4a6a-957c-874568fbb2b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8d87582aba4a13ba0a5a9bbe66bcaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:09:53Z,use_quota=True,user_id='ffab8d0e1f5349db8061d1b146356ffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:09:56 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Creating volume 336f2799-2368-4a6a-957c-874568fbb2b5 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:09:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:09:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:09:56 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:09:56 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:09:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:09:56 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:09:56 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:09:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-336f2799-2368-4a6a-957c-874568fbb2b5 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:56 devstack sudo[94943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-336f2799-2368-4a6a-957c-874568fbb2b5 1073741824
Nov 06 17:09:56 devstack sudo[94943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:56 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bae833ee-f774-4a72-88e7-bacd1edfbbd9 tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ade393-14e6-4ef7-b584-c580b54d963c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:56 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bae833ee-f774-4a72-88e7-bacd1edfbbd9 tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f115cc00-96c1-4b1a-bad8-f5085903f065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:09:56 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-bae833ee-f774-4a72-88e7-bacd1edfbbd9 tempest-GroupSnapshotsTest-1647710575 None] Volume volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856 (43ec1a53-22d8-4dc1-b4cc-78cb391d9856): created successfully
Nov 06 17:09:56 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bae833ee-f774-4a72-88e7-bacd1edfbbd9 tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f115cc00-96c1-4b1a-bad8-f5085903f065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:09:56 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bae833ee-f774-4a72-88e7-bacd1edfbbd9 tempest-GroupSnapshotsTest-1647710575 None] Flow 'volume_create_manager' (54248f91-e2e7-4b98-818f-b2047d72a4f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:09:56 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-bae833ee-f774-4a72-88e7-bacd1edfbbd9 tempest-GroupSnapshotsTest-1647710575 None] Created volume successfully.
Nov 06 17:09:57 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-8b0d56bc-c333-4396-a6a8-9e3813810aad tempest-GroupSnapshotsTest-1647710575 None] Update group completed successfully.
Nov 06 17:09:57 devstack sudo[94943]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-336f2799-2368-4a6a-957c-874568fbb2b5 1073741824" returned: 0 in 0.603s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-336f2799-2368-4a6a-957c-874568fbb2b5 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:57 devstack sudo[94949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-336f2799-2368-4a6a-957c-874568fbb2b5
Nov 06 17:09:57 devstack sudo[94949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:57 devstack sudo[94949]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-336f2799-2368-4a6a-957c-874568fbb2b5" returned: 0 in 0.260s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:57 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:09:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:09:57 devstack cinder-volume[86856]: DEBUG cinder.volume.volume_utils [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Attempting download of 420ae2ee-253a-40a6-ad62-b130f2314d4a ((None, [{'url': 'file:///opt/stack/data/glance/images/420ae2ee-253a-40a6-ad62-b130f2314d4a', 'metadata': {}}])) to volume 336f2799-2368-4a6a-957c-874568fbb2b5. {{(pid=86856) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 06 17:09:57 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bdb466-56d1-4786-85cf-fc916a3f47ca]: (4, 'raw') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:09:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_420ae2ee-253a-40a6-ad62-b130f2314d4a_bt90bstt {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:57 devstack sudo[94952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_420ae2ee-253a-40a6-ad62-b130f2314d4a_bt90bstt
Nov 06 17:09:57 devstack sudo[94952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:57 devstack sudo[94952]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_420ae2ee-253a-40a6-ad62-b130f2314d4a_bt90bstt" returned: 0 in 0.378s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_420ae2ee-253a-40a6-ad62-b130f2314d4a_bt90bstt {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:58 devstack sudo[94956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_420ae2ee-253a-40a6-ad62-b130f2314d4a_bt90bstt
Nov 06 17:09:58 devstack sudo[94956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:58 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-352f0de9-2c90-4480-8a90-c1c70534f7c7 tempest-GroupSnapshotsTest-1647710575 None] Update group completed successfully.
Nov 06 17:09:58 devstack sudo[94956]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_420ae2ee-253a-40a6-ad62-b130f2314d4a_bt90bstt" returned: 1 in 0.447s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_420ae2ee-253a-40a6-ad62-b130f2314d4a_bt90bstt' failed. Not Retrying. {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 17:09:58 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e213c5b-86d3-490a-890a-04a2374f6b5c]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:09:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_bchna984devstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:58 devstack sudo[94960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_bchna984devstack@QuobyteHD
Nov 06 17:09:58 devstack sudo[94960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:58 devstack sudo[94960]: pam_unix(sudo:session): session closed for user root
Nov 06 17:09:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_bchna984devstack@QuobyteHD" returned: 0 in 0.344s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:09:58 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] 420ae2ee-253a-40a6-ad62-b130f2314d4a was qcow2, converting to qcow2 {{(pid=86856) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 06 17:09:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_bchna984devstack@QuobyteHD /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-336f2799-2368-4a6a-957c-874568fbb2b5 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:09:58 devstack sudo[94965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_bchna984devstack@QuobyteHD /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-336f2799-2368-4a6a-957c-874568fbb2b5
Nov 06 17:09:58 devstack sudo[94965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:09:59 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-3cff94b1-c806-43bc-993f-cfdc718d3ea4 tempest-GroupSnapshotsTest-1647710575 None] Update group completed successfully.
Nov 06 17:10:00 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-3abf6819-2da6-4af7-8637-b7068765d227 tempest-GroupSnapshotsTest-1647710575 None] Update group completed successfully.
Nov 06 17:10:01 devstack sudo[94965]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_bchna984devstack@QuobyteHD /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-336f2799-2368-4a6a-957c-874568fbb2b5" returned: 0 in 2.516s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:01 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_bchna984devstack@QuobyteHD, size 112.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-336f2799-2368-4a6a-957c-874568fbb2b5 {{(pid=86856) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 17:10:01 devstack cinder-volume[86856]: INFO cinder.image.image_utils [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Converted 112.00 MB image at 44.51 MB/s
Nov 06 17:10:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-336f2799-2368-4a6a-957c-874568fbb2b5 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:01 devstack sudo[94974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-336f2799-2368-4a6a-957c-874568fbb2b5 1G
Nov 06 17:10:01 devstack sudo[94974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:01 devstack sudo[94974]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-336f2799-2368-4a6a-957c-874568fbb2b5 1G" returned: 0 in 0.476s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:01 devstack cinder-volume[86856]: DEBUG cinder.volume.volume_utils [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Downloaded image 420ae2ee-253a-40a6-ad62-b130f2314d4a ((None, [{'url': 'file:///opt/stack/data/glance/images/420ae2ee-253a-40a6-ad62-b130f2314d4a', 'metadata': {}}])) to volume 336f2799-2368-4a6a-957c-874568fbb2b5 successfully. {{(pid=86856) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 06 17:10:01 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Temporary image 420ae2ee-253a-40a6-ad62-b130f2314d4a for user ffab8d0e1f5349db8061d1b146356ffc is deleted. {{(pid=86856) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 06 17:10:01 devstack cinder-volume[86856]: DEBUG cinder.volume.volume_utils [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Marking volume 336f2799-2368-4a6a-957c-874568fbb2b5 as bootable. {{(pid=86856) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 06 17:10:01 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Copying metadata from image 420ae2ee-253a-40a6-ad62-b130f2314d4a to 336f2799-2368-4a6a-957c-874568fbb2b5. {{(pid=86856) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 06 17:10:01 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Creating volume glance metadata for volume 336f2799-2368-4a6a-957c-874568fbb2b5 backed by image 420ae2ee-253a-40a6-ad62-b130f2314d4a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '420ae2ee-253a-40a6-ad62-b130f2314d4a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86856) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 06 17:10:01 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4185f151-8145-4868-b83c-cdaaee48c3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-336f2799-2368-4a6a-957c-874568fbb2b5', 'volume_size': 1, 'image_id': '420ae2ee-253a-40a6-ad62-b130f2314d4a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/420ae2ee-253a-40a6-ad62-b130f2314d4a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '805e2cf12fa14002ae5dfa994733f868', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '420ae2ee-253a-40a6-ad62-b130f2314d4a', 'created_at': datetime.datetime(2026, 11, 6, 15, 57, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 15, 57, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/420ae2ee-253a-40a6-ad62-b130f2314d4a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x71da71274590>}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:01 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5194619f-24e6-456f-888d-583bbaf4eaf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:01 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Volume volume-336f2799-2368-4a6a-957c-874568fbb2b5 (336f2799-2368-4a6a-957c-874568fbb2b5): created successfully
Nov 06 17:10:01 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5194619f-24e6-456f-888d-583bbaf4eaf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:01 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Flow 'volume_create_manager' (a23dce74-cb3a-4ffe-ae82-73248d422d27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:10:01 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-d31ce8af-2b0c-4645-b902-cf2d993046f7 tempest-VolumesImageMetadata-1659684344 None] Created volume successfully.
Nov 06 17:10:02 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-45f8fa93-7ccd-4f34-90af-ca776d10b997 tempest-VolumeQuotasAdminTestJSON-1874337193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:10:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-45f8fa93-7ccd-4f34-90af-ca776d10b997 tempest-VolumeQuotasAdminTestJSON-1874337193 None] Flow 'volume_create_manager' (a9e5e927-f5e4-4147-b679-cc035519e3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:10:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-45f8fa93-7ccd-4f34-90af-ca776d10b997 tempest-VolumeQuotasAdminTestJSON-1874337193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66258cd9-a573-4c2a-bf0e-0892f35dd7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-45f8fa93-7ccd-4f34-90af-ca776d10b997 tempest-VolumeQuotasAdminTestJSON-1874337193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66258cd9-a573-4c2a-bf0e-0892f35dd7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:10:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1251000717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d1a6ea-8c47-4d6d-9134-f22d68e2b804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99f1f080ef654951b2bae0a04c6406a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:10:02Z,use_quota=True,user_id='586cce9f3bc54e2ba1da6a66b0ffa9a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-45f8fa93-7ccd-4f34-90af-ca776d10b997 tempest-VolumeQuotasAdminTestJSON-1874337193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be2c314-fe74-4eba-9bd1-1489e5e1d076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-45f8fa93-7ccd-4f34-90af-ca776d10b997 tempest-VolumeQuotasAdminTestJSON-1874337193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be2c314-fe74-4eba-9bd1-1489e5e1d076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-45f8fa93-7ccd-4f34-90af-ca776d10b997 tempest-VolumeQuotasAdminTestJSON-1874337193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21e4325c-72cc-47f2-8f69-09f4d753e1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-45f8fa93-7ccd-4f34-90af-ca776d10b997 tempest-VolumeQuotasAdminTestJSON-1874337193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21e4325c-72cc-47f2-8f69-09f4d753e1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42d1a6ea-8c47-4d6d-9134-f22d68e2b804', 'volume_name': 'volume-42d1a6ea-8c47-4d6d-9134-f22d68e2b804', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-45f8fa93-7ccd-4f34-90af-ca776d10b997 tempest-VolumeQuotasAdminTestJSON-1874337193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a68b557-2756-428a-8c2b-ac2dd2990e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-45f8fa93-7ccd-4f34-90af-ca776d10b997 tempest-VolumeQuotasAdminTestJSON-1874337193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a68b557-2756-428a-8c2b-ac2dd2990e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-45f8fa93-7ccd-4f34-90af-ca776d10b997 tempest-VolumeQuotasAdminTestJSON-1874337193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00ac8e80-3af8-4c2b-9ada-94b06abc7742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:02 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-45f8fa93-7ccd-4f34-90af-ca776d10b997 tempest-VolumeQuotasAdminTestJSON-1874337193 None] Volume 42d1a6ea-8c47-4d6d-9134-f22d68e2b804: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42d1a6ea-8c47-4d6d-9134-f22d68e2b804', 'volume_size': 1}
Nov 06 17:10:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-45f8fa93-7ccd-4f34-90af-ca776d10b997 tempest-VolumeQuotasAdminTestJSON-1874337193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-45f8fa93-7ccd-4f34-90af-ca776d10b997 tempest-VolumeQuotasAdminTestJSON-1874337193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:02 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-45f8fa93-7ccd-4f34-90af-ca776d10b997 tempest-VolumeQuotasAdminTestJSON-1874337193 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:10:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1251000717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d1a6ea-8c47-4d6d-9134-f22d68e2b804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99f1f080ef654951b2bae0a04c6406a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:10:02Z,use_quota=True,user_id='586cce9f3bc54e2ba1da6a66b0ffa9a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:10:02 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-45f8fa93-7ccd-4f34-90af-ca776d10b997 tempest-VolumeQuotasAdminTestJSON-1874337193 None] Creating volume 42d1a6ea-8c47-4d6d-9134-f22d68e2b804 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:10:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-45f8fa93-7ccd-4f34-90af-ca776d10b997 tempest-VolumeQuotasAdminTestJSON-1874337193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-45f8fa93-7ccd-4f34-90af-ca776d10b997 tempest-VolumeQuotasAdminTestJSON-1874337193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:02 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-45f8fa93-7ccd-4f34-90af-ca776d10b997 tempest-VolumeQuotasAdminTestJSON-1874337193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:10:02 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-45f8fa93-7ccd-4f34-90af-ca776d10b997 tempest-VolumeQuotasAdminTestJSON-1874337193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:10:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-45f8fa93-7ccd-4f34-90af-ca776d10b997 tempest-VolumeQuotasAdminTestJSON-1874337193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:02 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-45f8fa93-7ccd-4f34-90af-ca776d10b997 tempest-VolumeQuotasAdminTestJSON-1874337193 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:10:02 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-45f8fa93-7ccd-4f34-90af-ca776d10b997 tempest-VolumeQuotasAdminTestJSON-1874337193 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:10:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-45f8fa93-7ccd-4f34-90af-ca776d10b997 tempest-VolumeQuotasAdminTestJSON-1874337193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-42d1a6ea-8c47-4d6d-9134-f22d68e2b804 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:02 devstack sudo[94980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-42d1a6ea-8c47-4d6d-9134-f22d68e2b804 1073741824
Nov 06 17:10:02 devstack sudo[94980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:02 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-9e1f693a-ab3f-433a-a9d1-c8878dcb47da tempest-GroupSnapshotsTest-1647710575 None] GroupSnapshot a68db64d-2918-4894-8037-36160240aeba: creating.
Nov 06 17:10:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9e1f693a-ab3f-433a-a9d1-c8878dcb47da tempest-GroupSnapshotsTest-1647710575 None] Group snapshot a68db64d-2918-4894-8037-36160240aeba: creating. {{(pid=86856) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 06 17:10:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9e1f693a-ab3f-433a-a9d1-c8878dcb47da tempest-GroupSnapshotsTest-1647710575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:02 devstack sudo[94980]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-45f8fa93-7ccd-4f34-90af-ca776d10b997 tempest-VolumeQuotasAdminTestJSON-1874337193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-42d1a6ea-8c47-4d6d-9134-f22d68e2b804 1073741824" returned: 0 in 0.766s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-45f8fa93-7ccd-4f34-90af-ca776d10b997 tempest-VolumeQuotasAdminTestJSON-1874337193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-42d1a6ea-8c47-4d6d-9134-f22d68e2b804 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:02 devstack sudo[94986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-42d1a6ea-8c47-4d6d-9134-f22d68e2b804
Nov 06 17:10:02 devstack sudo[94986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:03 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-3b7e14fd-e92d-4a83-b33a-dc7558ecd112 tempest-VolumesImageMetadata-1659684344 None] Acquiring lock "cinder-336f2799-2368-4a6a-957c-874568fbb2b5-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:03 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-3b7e14fd-e92d-4a83-b33a-dc7558ecd112 tempest-VolumesImageMetadata-1659684344 None] Lock "cinder-336f2799-2368-4a6a-957c-874568fbb2b5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:03 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-3b7e14fd-e92d-4a83-b33a-dc7558ecd112 tempest-VolumesImageMetadata-1659684344 None] Acquiring lock "cinder-quobyte-336f2799-2368-4a6a-957c-874568fbb2b5" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:03 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-3b7e14fd-e92d-4a83-b33a-dc7558ecd112 tempest-VolumesImageMetadata-1659684344 None] Lock "cinder-quobyte-336f2799-2368-4a6a-957c-874568fbb2b5" acquired by "delete_volume" :: waited 0.025s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:03 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[4453e489-53fa-4254-ba36-22fa89a257b1]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:10:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3b7e14fd-e92d-4a83-b33a-dc7558ecd112 tempest-VolumesImageMetadata-1659684344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-336f2799-2368-4a6a-957c-874568fbb2b5 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:03 devstack sudo[94986]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-45f8fa93-7ccd-4f34-90af-ca776d10b997 tempest-VolumeQuotasAdminTestJSON-1874337193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-42d1a6ea-8c47-4d6d-9134-f22d68e2b804" returned: 0 in 0.336s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:03 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-45f8fa93-7ccd-4f34-90af-ca776d10b997 tempest-VolumeQuotasAdminTestJSON-1874337193 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:10:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-45f8fa93-7ccd-4f34-90af-ca776d10b997 tempest-VolumeQuotasAdminTestJSON-1874337193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9e1f693a-ab3f-433a-a9d1-c8878dcb47da tempest-GroupSnapshotsTest-1647710575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.715s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-45f8fa93-7ccd-4f34-90af-ca776d10b997 tempest-VolumeQuotasAdminTestJSON-1874337193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00ac8e80-3af8-4c2b-9ada-94b06abc7742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42d1a6ea-8c47-4d6d-9134-f22d68e2b804', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-45f8fa93-7ccd-4f34-90af-ca776d10b997 tempest-VolumeQuotasAdminTestJSON-1874337193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f05894f-4fe7-49e4-8f40-6df422f01249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:03 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-9e1f693a-ab3f-433a-a9d1-c8878dcb47da tempest-GroupSnapshotsTest-1647710575 None] Creating offline snapshot 20b84733-0755-4a1e-b77a-bf38ef23755a of volume 43ec1a53-22d8-4dc1-b4cc-78cb391d9856 {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:10:03 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-45f8fa93-7ccd-4f34-90af-ca776d10b997 tempest-VolumeQuotasAdminTestJSON-1874337193 None] Volume volume-42d1a6ea-8c47-4d6d-9134-f22d68e2b804 (42d1a6ea-8c47-4d6d-9134-f22d68e2b804): created successfully
Nov 06 17:10:03 devstack sudo[94988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-336f2799-2368-4a6a-957c-874568fbb2b5
Nov 06 17:10:03 devstack sudo[94988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-45f8fa93-7ccd-4f34-90af-ca776d10b997 tempest-VolumeQuotasAdminTestJSON-1874337193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f05894f-4fe7-49e4-8f40-6df422f01249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-45f8fa93-7ccd-4f34-90af-ca776d10b997 tempest-VolumeQuotasAdminTestJSON-1874337193 None] Flow 'volume_create_manager' (a9e5e927-f5e4-4147-b679-cc035519e3a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:10:03 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33ca3f4-9570-46b0-8eed-c140cc4c5f32]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:10:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9e1f693a-ab3f-433a-a9d1-c8878dcb47da tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:03 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-45f8fa93-7ccd-4f34-90af-ca776d10b997 tempest-VolumeQuotasAdminTestJSON-1874337193 None] Created volume successfully.
Nov 06 17:10:03 devstack sudo[94991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856
Nov 06 17:10:03 devstack sudo[94991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:03 devstack sudo[94988]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3b7e14fd-e92d-4a83-b33a-dc7558ecd112 tempest-VolumesImageMetadata-1659684344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-336f2799-2368-4a6a-957c-874568fbb2b5" returned: 0 in 0.452s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3b7e14fd-e92d-4a83-b33a-dc7558ecd112 tempest-VolumesImageMetadata-1659684344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-336f2799-2368-4a6a-957c-874568fbb2b5 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:03 devstack sudo[94996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-336f2799-2368-4a6a-957c-874568fbb2b5
Nov 06 17:10:03 devstack sudo[94996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:03 devstack sudo[94991]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9e1f693a-ab3f-433a-a9d1-c8878dcb47da tempest-GroupSnapshotsTest-1647710575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856" returned: 0 in 0.473s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9e1f693a-ab3f-433a-a9d1-c8878dcb47da tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856.20b84733-0755-4a1e-b77a-bf38ef23755a 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:03 devstack sudo[95001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856.20b84733-0755-4a1e-b77a-bf38ef23755a 1G
Nov 06 17:10:03 devstack sudo[95001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:04 devstack sudo[94996]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3b7e14fd-e92d-4a83-b33a-dc7558ecd112 tempest-VolumesImageMetadata-1659684344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-336f2799-2368-4a6a-957c-874568fbb2b5" returned: 0 in 0.350s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:04 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-3b7e14fd-e92d-4a83-b33a-dc7558ecd112 tempest-VolumesImageMetadata-1659684344 None] Lock "cinder-quobyte-336f2799-2368-4a6a-957c-874568fbb2b5" released by "delete_volume" :: held 0.880s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:04 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-3b7e14fd-e92d-4a83-b33a-dc7558ecd112 tempest-VolumesImageMetadata-1659684344 None] Created reservations ['0bf1cf44-25cd-4616-8a9c-5668cb28fbf6', '425e1257-96d3-40bd-bff3-e815f403210b', '7017a9b7-36ef-4cb8-9694-81408a766879', 'e4f5d0bd-bcc3-42c5-96d0-81e622864cac'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:10:04 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1d8c094c-d0b9-4755-9644-02655c5dfc0f tempest-VolumeQuotasAdminTestJSON-1874337193 None] Acquiring lock "cinder-42d1a6ea-8c47-4d6d-9134-f22d68e2b804-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:04 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1d8c094c-d0b9-4755-9644-02655c5dfc0f tempest-VolumeQuotasAdminTestJSON-1874337193 None] Lock "cinder-42d1a6ea-8c47-4d6d-9134-f22d68e2b804-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:04 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1d8c094c-d0b9-4755-9644-02655c5dfc0f tempest-VolumeQuotasAdminTestJSON-1874337193 None] Acquiring lock "cinder-quobyte-42d1a6ea-8c47-4d6d-9134-f22d68e2b804" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3b7e14fd-e92d-4a83-b33a-dc7558ecd112 tempest-VolumesImageMetadata-1659684344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3b7e14fd-e92d-4a83-b33a-dc7558ecd112 tempest-VolumesImageMetadata-1659684344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:04 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3b7e14fd-e92d-4a83-b33a-dc7558ecd112 tempest-VolumesImageMetadata-1659684344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:10:04 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3b7e14fd-e92d-4a83-b33a-dc7558ecd112 tempest-VolumesImageMetadata-1659684344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:10:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3b7e14fd-e92d-4a83-b33a-dc7558ecd112 tempest-VolumesImageMetadata-1659684344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3b7e14fd-e92d-4a83-b33a-dc7558ecd112 tempest-VolumesImageMetadata-1659684344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:04 devstack sudo[95007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:10:04 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1d8c094c-d0b9-4755-9644-02655c5dfc0f tempest-VolumeQuotasAdminTestJSON-1874337193 None] Lock "cinder-quobyte-42d1a6ea-8c47-4d6d-9134-f22d68e2b804" acquired by "delete_volume" :: waited 0.042s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:04 devstack sudo[95007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:04 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cc78ab-10bb-4777-af3b-cffc25d48818]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:10:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1d8c094c-d0b9-4755-9644-02655c5dfc0f tempest-VolumeQuotasAdminTestJSON-1874337193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-42d1a6ea-8c47-4d6d-9134-f22d68e2b804 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:04 devstack sudo[95001]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9e1f693a-ab3f-433a-a9d1-c8878dcb47da tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856.20b84733-0755-4a1e-b77a-bf38ef23755a 1G" returned: 0 in 0.603s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9e1f693a-ab3f-433a-a9d1-c8878dcb47da tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856.20b84733-0755-4a1e-b77a-bf38ef23755a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:04 devstack sudo[95011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856.20b84733-0755-4a1e-b77a-bf38ef23755a
Nov 06 17:10:04 devstack sudo[95011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:04 devstack sudo[95010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-42d1a6ea-8c47-4d6d-9134-f22d68e2b804
Nov 06 17:10:04 devstack sudo[95010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:04 devstack sudo[95007]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3b7e14fd-e92d-4a83-b33a-dc7558ecd112 tempest-VolumesImageMetadata-1659684344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.298s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:04 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-3b7e14fd-e92d-4a83-b33a-dc7558ecd112 tempest-VolumesImageMetadata-1659684344 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:10:04 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-3b7e14fd-e92d-4a83-b33a-dc7558ecd112 tempest-VolumesImageMetadata-1659684344 None] Deleted volume successfully.
Nov 06 17:10:04 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-3b7e14fd-e92d-4a83-b33a-dc7558ecd112 tempest-VolumesImageMetadata-1659684344 None] Lock "cinder-336f2799-2368-4a6a-957c-874568fbb2b5-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:04 devstack sudo[95011]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9e1f693a-ab3f-433a-a9d1-c8878dcb47da tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856.20b84733-0755-4a1e-b77a-bf38ef23755a" returned: 0 in 0.390s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:04 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-9e1f693a-ab3f-433a-a9d1-c8878dcb47da tempest-GroupSnapshotsTest-1647710575 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856.20b84733-0755-4a1e-b77a-bf38ef23755a is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 17:10:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9e1f693a-ab3f-433a-a9d1-c8878dcb47da tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856.20b84733-0755-4a1e-b77a-bf38ef23755a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:04 devstack sudo[95021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856.20b84733-0755-4a1e-b77a-bf38ef23755a
Nov 06 17:10:04 devstack sudo[95021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:04 devstack sudo[95010]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1d8c094c-d0b9-4755-9644-02655c5dfc0f tempest-VolumeQuotasAdminTestJSON-1874337193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-42d1a6ea-8c47-4d6d-9134-f22d68e2b804" returned: 0 in 0.578s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1d8c094c-d0b9-4755-9644-02655c5dfc0f tempest-VolumeQuotasAdminTestJSON-1874337193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-42d1a6ea-8c47-4d6d-9134-f22d68e2b804 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:04 devstack sudo[95024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-42d1a6ea-8c47-4d6d-9134-f22d68e2b804
Nov 06 17:10:04 devstack sudo[95024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:05 devstack sudo[95021]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9e1f693a-ab3f-433a-a9d1-c8878dcb47da tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856.20b84733-0755-4a1e-b77a-bf38ef23755a" returned: 0 in 0.266s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9e1f693a-ab3f-433a-a9d1-c8878dcb47da tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:05 devstack sudo[95028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856.info
Nov 06 17:10:05 devstack sudo[95028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:05 devstack sudo[95024]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1d8c094c-d0b9-4755-9644-02655c5dfc0f tempest-VolumeQuotasAdminTestJSON-1874337193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-42d1a6ea-8c47-4d6d-9134-f22d68e2b804" returned: 0 in 0.268s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:05 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1d8c094c-d0b9-4755-9644-02655c5dfc0f tempest-VolumeQuotasAdminTestJSON-1874337193 None] Lock "cinder-quobyte-42d1a6ea-8c47-4d6d-9134-f22d68e2b804" released by "delete_volume" :: held 0.906s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:05 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-1d8c094c-d0b9-4755-9644-02655c5dfc0f tempest-VolumeQuotasAdminTestJSON-1874337193 None] Created reservations ['508b570b-358a-4908-a4f1-e8406e600a28', '61d75120-826c-4c20-8cfc-680473990dcb', '9ea96762-f58e-4c30-af17-200da5438d2e', 'dc774827-6680-4433-a9ea-a237ec33cb63'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:10:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1d8c094c-d0b9-4755-9644-02655c5dfc0f tempest-VolumeQuotasAdminTestJSON-1874337193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1d8c094c-d0b9-4755-9644-02655c5dfc0f tempest-VolumeQuotasAdminTestJSON-1874337193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:05 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1d8c094c-d0b9-4755-9644-02655c5dfc0f tempest-VolumeQuotasAdminTestJSON-1874337193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:10:05 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1d8c094c-d0b9-4755-9644-02655c5dfc0f tempest-VolumeQuotasAdminTestJSON-1874337193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:10:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1d8c094c-d0b9-4755-9644-02655c5dfc0f tempest-VolumeQuotasAdminTestJSON-1874337193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1d8c094c-d0b9-4755-9644-02655c5dfc0f tempest-VolumeQuotasAdminTestJSON-1874337193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:05 devstack sudo[95030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:10:05 devstack sudo[95030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:05 devstack sudo[95028]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9e1f693a-ab3f-433a-a9d1-c8878dcb47da tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856.info" returned: 0 in 0.415s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:05 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-9e1f693a-ab3f-433a-a9d1-c8878dcb47da tempest-GroupSnapshotsTest-1647710575 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 17:10:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9e1f693a-ab3f-433a-a9d1-c8878dcb47da tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:05 devstack sudo[95033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856.info
Nov 06 17:10:05 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:05 devstack sudo[95030]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1d8c094c-d0b9-4755-9644-02655c5dfc0f tempest-VolumeQuotasAdminTestJSON-1874337193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.490s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:05 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-1d8c094c-d0b9-4755-9644-02655c5dfc0f tempest-VolumeQuotasAdminTestJSON-1874337193 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:10:05 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-1d8c094c-d0b9-4755-9644-02655c5dfc0f tempest-VolumeQuotasAdminTestJSON-1874337193 None] Deleted volume successfully.
Nov 06 17:10:05 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1d8c094c-d0b9-4755-9644-02655c5dfc0f tempest-VolumeQuotasAdminTestJSON-1874337193 None] Lock "cinder-42d1a6ea-8c47-4d6d-9134-f22d68e2b804-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:05 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9e1f693a-ab3f-433a-a9d1-c8878dcb47da tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856.info" returned: 0 in 0.399s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9e1f693a-ab3f-433a-a9d1-c8878dcb47da tempest-GroupSnapshotsTest-1647710575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.697s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9e1f693a-ab3f-433a-a9d1-c8878dcb47da tempest-GroupSnapshotsTest-1647710575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9e1f693a-ab3f-433a-a9d1-c8878dcb47da tempest-GroupSnapshotsTest-1647710575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:06 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-9e1f693a-ab3f-433a-a9d1-c8878dcb47da tempest-GroupSnapshotsTest-1647710575 None] Creating offline snapshot 4129b67d-3bf1-4065-ba56-8b97a5b3dc87 of volume 891e44c8-54e3-4feb-bfef-090b2b1ffab5 {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:10:06 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9cea82-a36a-4150-a6a8-e544a387fe90]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:10:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9e1f693a-ab3f-433a-a9d1-c8878dcb47da tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:06 devstack sudo[95040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5
Nov 06 17:10:06 devstack sudo[95040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:06 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-05475f0f-db86-4e92-9863-a4b0bfecb94c tempest-VolumeQuotasAdminTestJSON-1874337193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:10:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-05475f0f-db86-4e92-9863-a4b0bfecb94c tempest-VolumeQuotasAdminTestJSON-1874337193 None] Flow 'volume_create_manager' (089b55d5-df4a-45a0-9c71-f4d68d8d5b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:10:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-05475f0f-db86-4e92-9863-a4b0bfecb94c tempest-VolumeQuotasAdminTestJSON-1874337193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f438cd10-4ac7-49d3-b699-91e3675c3167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-05475f0f-db86-4e92-9863-a4b0bfecb94c tempest-VolumeQuotasAdminTestJSON-1874337193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f438cd10-4ac7-49d3-b699-91e3675c3167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1081479215',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b92b3a11-f601-4dec-a0cc-64bb1f729a49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99f1f080ef654951b2bae0a04c6406a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:10:06Z,use_quota=True,user_id='586cce9f3bc54e2ba1da6a66b0ffa9a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-05475f0f-db86-4e92-9863-a4b0bfecb94c tempest-VolumeQuotasAdminTestJSON-1874337193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d39d313-3229-4f20-9dcd-6f7451e30275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-05475f0f-db86-4e92-9863-a4b0bfecb94c tempest-VolumeQuotasAdminTestJSON-1874337193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d39d313-3229-4f20-9dcd-6f7451e30275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-05475f0f-db86-4e92-9863-a4b0bfecb94c tempest-VolumeQuotasAdminTestJSON-1874337193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e35723f-93f0-4c9c-a4a2-537a5b143ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-05475f0f-db86-4e92-9863-a4b0bfecb94c tempest-VolumeQuotasAdminTestJSON-1874337193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e35723f-93f0-4c9c-a4a2-537a5b143ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b92b3a11-f601-4dec-a0cc-64bb1f729a49', 'volume_name': 'volume-b92b3a11-f601-4dec-a0cc-64bb1f729a49', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-05475f0f-db86-4e92-9863-a4b0bfecb94c tempest-VolumeQuotasAdminTestJSON-1874337193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b4db171-6c40-4a3a-ade1-823dfb0176b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-05475f0f-db86-4e92-9863-a4b0bfecb94c tempest-VolumeQuotasAdminTestJSON-1874337193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b4db171-6c40-4a3a-ade1-823dfb0176b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-05475f0f-db86-4e92-9863-a4b0bfecb94c tempest-VolumeQuotasAdminTestJSON-1874337193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5493f633-72f1-4274-ba88-23ecbdc55b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:06 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-05475f0f-db86-4e92-9863-a4b0bfecb94c tempest-VolumeQuotasAdminTestJSON-1874337193 None] Volume b92b3a11-f601-4dec-a0cc-64bb1f729a49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b92b3a11-f601-4dec-a0cc-64bb1f729a49', 'volume_size': 1}
Nov 06 17:10:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-05475f0f-db86-4e92-9863-a4b0bfecb94c tempest-VolumeQuotasAdminTestJSON-1874337193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:06 devstack sudo[95040]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9e1f693a-ab3f-433a-a9d1-c8878dcb47da tempest-GroupSnapshotsTest-1647710575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5" returned: 0 in 0.450s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9e1f693a-ab3f-433a-a9d1-c8878dcb47da tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5.4129b67d-3bf1-4065-ba56-8b97a5b3dc87 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:06 devstack sudo[95046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5.4129b67d-3bf1-4065-ba56-8b97a5b3dc87 1G
Nov 06 17:10:06 devstack sudo[95046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:07 devstack sudo[95046]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9e1f693a-ab3f-433a-a9d1-c8878dcb47da tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5.4129b67d-3bf1-4065-ba56-8b97a5b3dc87 1G" returned: 0 in 0.510s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9e1f693a-ab3f-433a-a9d1-c8878dcb47da tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5.4129b67d-3bf1-4065-ba56-8b97a5b3dc87 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:07 devstack sudo[95052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5.4129b67d-3bf1-4065-ba56-8b97a5b3dc87
Nov 06 17:10:07 devstack sudo[95052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:07 devstack sudo[95052]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9e1f693a-ab3f-433a-a9d1-c8878dcb47da tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5.4129b67d-3bf1-4065-ba56-8b97a5b3dc87" returned: 0 in 0.347s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:07 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-9e1f693a-ab3f-433a-a9d1-c8878dcb47da tempest-GroupSnapshotsTest-1647710575 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5.4129b67d-3bf1-4065-ba56-8b97a5b3dc87 is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 17:10:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9e1f693a-ab3f-433a-a9d1-c8878dcb47da tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5.4129b67d-3bf1-4065-ba56-8b97a5b3dc87 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:07 devstack sudo[95057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5.4129b67d-3bf1-4065-ba56-8b97a5b3dc87
Nov 06 17:10:07 devstack sudo[95057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:07 devstack sudo[95057]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9e1f693a-ab3f-433a-a9d1-c8878dcb47da tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5.4129b67d-3bf1-4065-ba56-8b97a5b3dc87" returned: 0 in 0.258s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9e1f693a-ab3f-433a-a9d1-c8878dcb47da tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:07 devstack sudo[95060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5.info
Nov 06 17:10:07 devstack sudo[95060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:07 devstack sudo[95060]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9e1f693a-ab3f-433a-a9d1-c8878dcb47da tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5.info" returned: 0 in 0.298s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:07 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-9e1f693a-ab3f-433a-a9d1-c8878dcb47da tempest-GroupSnapshotsTest-1647710575 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 17:10:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9e1f693a-ab3f-433a-a9d1-c8878dcb47da tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:08 devstack sudo[95063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5.info
Nov 06 17:10:08 devstack sudo[95063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:08 devstack sudo[95063]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9e1f693a-ab3f-433a-a9d1-c8878dcb47da tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5.info" returned: 0 in 0.301s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9e1f693a-ab3f-433a-a9d1-c8878dcb47da tempest-GroupSnapshotsTest-1647710575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.318s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-05475f0f-db86-4e92-9863-a4b0bfecb94c tempest-VolumeQuotasAdminTestJSON-1874337193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.987s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:08 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-05475f0f-db86-4e92-9863-a4b0bfecb94c tempest-VolumeQuotasAdminTestJSON-1874337193 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1081479215',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b92b3a11-f601-4dec-a0cc-64bb1f729a49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99f1f080ef654951b2bae0a04c6406a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:10:06Z,use_quota=True,user_id='586cce9f3bc54e2ba1da6a66b0ffa9a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:10:08 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-05475f0f-db86-4e92-9863-a4b0bfecb94c tempest-VolumeQuotasAdminTestJSON-1874337193 None] Creating volume b92b3a11-f601-4dec-a0cc-64bb1f729a49 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:10:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-05475f0f-db86-4e92-9863-a4b0bfecb94c tempest-VolumeQuotasAdminTestJSON-1874337193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-05475f0f-db86-4e92-9863-a4b0bfecb94c tempest-VolumeQuotasAdminTestJSON-1874337193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:08 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-05475f0f-db86-4e92-9863-a4b0bfecb94c tempest-VolumeQuotasAdminTestJSON-1874337193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:10:08 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-05475f0f-db86-4e92-9863-a4b0bfecb94c tempest-VolumeQuotasAdminTestJSON-1874337193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:10:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-05475f0f-db86-4e92-9863-a4b0bfecb94c tempest-VolumeQuotasAdminTestJSON-1874337193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:08 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-05475f0f-db86-4e92-9863-a4b0bfecb94c tempest-VolumeQuotasAdminTestJSON-1874337193 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:10:08 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-05475f0f-db86-4e92-9863-a4b0bfecb94c tempest-VolumeQuotasAdminTestJSON-1874337193 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:10:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-05475f0f-db86-4e92-9863-a4b0bfecb94c tempest-VolumeQuotasAdminTestJSON-1874337193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b92b3a11-f601-4dec-a0cc-64bb1f729a49 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:08 devstack sudo[95069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b92b3a11-f601-4dec-a0cc-64bb1f729a49 1073741824
Nov 06 17:10:08 devstack sudo[95069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:08 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-9e1f693a-ab3f-433a-a9d1-c8878dcb47da tempest-GroupSnapshotsTest-1647710575 None] group_snapshot a68db64d-2918-4894-8037-36160240aeba: created successfully
Nov 06 17:10:08 devstack sudo[95069]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-05475f0f-db86-4e92-9863-a4b0bfecb94c tempest-VolumeQuotasAdminTestJSON-1874337193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b92b3a11-f601-4dec-a0cc-64bb1f729a49 1073741824" returned: 0 in 0.566s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-05475f0f-db86-4e92-9863-a4b0bfecb94c tempest-VolumeQuotasAdminTestJSON-1874337193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b92b3a11-f601-4dec-a0cc-64bb1f729a49 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:08 devstack sudo[95075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b92b3a11-f601-4dec-a0cc-64bb1f729a49
Nov 06 17:10:08 devstack sudo[95075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:09 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] group_snapshot a68db64d-2918-4894-8037-36160240aeba: deleting
Nov 06 17:10:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] group_snapshot a68db64d-2918-4894-8037-36160240aeba: deleting {{(pid=86856) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 06 17:10:09 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] Acquiring lock "cinder-quobyte-43ec1a53-22d8-4dc1-b4cc-78cb391d9856" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:09 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] Lock "cinder-quobyte-43ec1a53-22d8-4dc1-b4cc-78cb391d9856" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:09 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] Acquiring lock "cinder-quobyte-20b84733-0755-4a1e-b77a-bf38ef23755a" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:09 devstack sudo[95075]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-05475f0f-db86-4e92-9863-a4b0bfecb94c tempest-VolumeQuotasAdminTestJSON-1874337193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b92b3a11-f601-4dec-a0cc-64bb1f729a49" returned: 0 in 0.403s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:09 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-05475f0f-db86-4e92-9863-a4b0bfecb94c tempest-VolumeQuotasAdminTestJSON-1874337193 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:10:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-05475f0f-db86-4e92-9863-a4b0bfecb94c tempest-VolumeQuotasAdminTestJSON-1874337193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:09 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] Lock "cinder-quobyte-20b84733-0755-4a1e-b77a-bf38ef23755a" acquired by "_delete_snapshot" :: waited 0.063s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:09 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] Deleting offline snapshot 20b84733-0755-4a1e-b77a-bf38ef23755a of volume 43ec1a53-22d8-4dc1-b4cc-78cb391d9856 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:10:09 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] snapshot_file for this snap is: volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856.20b84733-0755-4a1e-b77a-bf38ef23755a {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:10:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-05475f0f-db86-4e92-9863-a4b0bfecb94c tempest-VolumeQuotasAdminTestJSON-1874337193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5493f633-72f1-4274-ba88-23ecbdc55b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b92b3a11-f601-4dec-a0cc-64bb1f729a49', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-05475f0f-db86-4e92-9863-a4b0bfecb94c tempest-VolumeQuotasAdminTestJSON-1874337193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09f2d783-bb4f-42eb-be2a-08c8ba5ba965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:09 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc3ef78-bdbb-41bc-9194-86ac72d4dbe3]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:10:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856.20b84733-0755-4a1e-b77a-bf38ef23755a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:09 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-05475f0f-db86-4e92-9863-a4b0bfecb94c tempest-VolumeQuotasAdminTestJSON-1874337193 None] Volume volume-b92b3a11-f601-4dec-a0cc-64bb1f729a49 (b92b3a11-f601-4dec-a0cc-64bb1f729a49): created successfully
Nov 06 17:10:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-05475f0f-db86-4e92-9863-a4b0bfecb94c tempest-VolumeQuotasAdminTestJSON-1874337193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09f2d783-bb4f-42eb-be2a-08c8ba5ba965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-05475f0f-db86-4e92-9863-a4b0bfecb94c tempest-VolumeQuotasAdminTestJSON-1874337193 None] Flow 'volume_create_manager' (089b55d5-df4a-45a0-9c71-f4d68d8d5b4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:10:09 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-05475f0f-db86-4e92-9863-a4b0bfecb94c tempest-VolumeQuotasAdminTestJSON-1874337193 None] Created volume successfully.
Nov 06 17:10:09 devstack sudo[95078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856.20b84733-0755-4a1e-b77a-bf38ef23755a
Nov 06 17:10:09 devstack sudo[95078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:09 devstack sudo[95078]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856.20b84733-0755-4a1e-b77a-bf38ef23755a" returned: 0 in 0.489s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:09 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:10:09 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1106f6-9763-4588-8615-c7f50caa2bed]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:10:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:10 devstack sudo[95087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856
Nov 06 17:10:10 devstack sudo[95087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:10 devstack sudo[95087]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856" returned: 0 in 0.545s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856.20b84733-0755-4a1e-b77a-bf38ef23755a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:10 devstack sudo[95102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856.20b84733-0755-4a1e-b77a-bf38ef23755a
Nov 06 17:10:10 devstack sudo[95102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:10 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6231d46-145d-4be3-a86b-dc270f06f0c1 tempest-VolumesDeleteCascade-2117513304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:10:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f6231d46-145d-4be3-a86b-dc270f06f0c1 tempest-VolumesDeleteCascade-2117513304 None] Flow 'volume_create_manager' (807785d1-62a0-4b51-a4e8-e93be66d8d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:10:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f6231d46-145d-4be3-a86b-dc270f06f0c1 tempest-VolumesDeleteCascade-2117513304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3d0ddaf-7840-435c-af7d-e0cc470fffe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f6231d46-145d-4be3-a86b-dc270f06f0c1 tempest-VolumesDeleteCascade-2117513304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3d0ddaf-7840-435c-af7d-e0cc470fffe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1745472088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f98db9a4-4fd2-427e-b2bc-316fc898ac5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8761530ba84deea7471d5abd6f96eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:10:11Z,use_quota=True,user_id='adc2b85166044b0c9b17b7ab4475beda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f6231d46-145d-4be3-a86b-dc270f06f0c1 tempest-VolumesDeleteCascade-2117513304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d34e867-41ae-4dd9-9df6-f0ae1e42fff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f6231d46-145d-4be3-a86b-dc270f06f0c1 tempest-VolumesDeleteCascade-2117513304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d34e867-41ae-4dd9-9df6-f0ae1e42fff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f6231d46-145d-4be3-a86b-dc270f06f0c1 tempest-VolumesDeleteCascade-2117513304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0222b9d-db11-452f-8ad9-97226dfaf30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f6231d46-145d-4be3-a86b-dc270f06f0c1 tempest-VolumesDeleteCascade-2117513304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0222b9d-db11-452f-8ad9-97226dfaf30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f98db9a4-4fd2-427e-b2bc-316fc898ac5d', 'volume_name': 'volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f6231d46-145d-4be3-a86b-dc270f06f0c1 tempest-VolumesDeleteCascade-2117513304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b543431-b9c8-46e0-9d2e-33a4bc235e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f6231d46-145d-4be3-a86b-dc270f06f0c1 tempest-VolumesDeleteCascade-2117513304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b543431-b9c8-46e0-9d2e-33a4bc235e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f6231d46-145d-4be3-a86b-dc270f06f0c1 tempest-VolumesDeleteCascade-2117513304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c402210-8545-441d-8f75-9588ad981e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:10 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-f6231d46-145d-4be3-a86b-dc270f06f0c1 tempest-VolumesDeleteCascade-2117513304 None] Volume f98db9a4-4fd2-427e-b2bc-316fc898ac5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d', 'volume_size': 1}
Nov 06 17:10:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f6231d46-145d-4be3-a86b-dc270f06f0c1 tempest-VolumesDeleteCascade-2117513304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f6231d46-145d-4be3-a86b-dc270f06f0c1 tempest-VolumesDeleteCascade-2117513304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:10 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-f6231d46-145d-4be3-a86b-dc270f06f0c1 tempest-VolumesDeleteCascade-2117513304 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1745472088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f98db9a4-4fd2-427e-b2bc-316fc898ac5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8761530ba84deea7471d5abd6f96eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:10:11Z,use_quota=True,user_id='adc2b85166044b0c9b17b7ab4475beda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:10:10 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-f6231d46-145d-4be3-a86b-dc270f06f0c1 tempest-VolumesDeleteCascade-2117513304 None] Creating volume f98db9a4-4fd2-427e-b2bc-316fc898ac5d {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:10:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f6231d46-145d-4be3-a86b-dc270f06f0c1 tempest-VolumesDeleteCascade-2117513304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f6231d46-145d-4be3-a86b-dc270f06f0c1 tempest-VolumesDeleteCascade-2117513304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:10 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-f6231d46-145d-4be3-a86b-dc270f06f0c1 tempest-VolumesDeleteCascade-2117513304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:10:10 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-f6231d46-145d-4be3-a86b-dc270f06f0c1 tempest-VolumesDeleteCascade-2117513304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:10:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f6231d46-145d-4be3-a86b-dc270f06f0c1 tempest-VolumesDeleteCascade-2117513304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:10 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-f6231d46-145d-4be3-a86b-dc270f06f0c1 tempest-VolumesDeleteCascade-2117513304 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:10:10 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-f6231d46-145d-4be3-a86b-dc270f06f0c1 tempest-VolumesDeleteCascade-2117513304 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:10:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f6231d46-145d-4be3-a86b-dc270f06f0c1 tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:10 devstack sudo[95107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d 1073741824
Nov 06 17:10:10 devstack sudo[95107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:11 devstack sudo[95102]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856.20b84733-0755-4a1e-b77a-bf38ef23755a" returned: 0 in 0.517s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856.20b84733-0755-4a1e-b77a-bf38ef23755a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:11 devstack sudo[95116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856.20b84733-0755-4a1e-b77a-bf38ef23755a
Nov 06 17:10:11 devstack sudo[95116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:11 devstack sudo[95107]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:11 devstack sudo[95116]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f6231d46-145d-4be3-a86b-dc270f06f0c1 tempest-VolumesDeleteCascade-2117513304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d 1073741824" returned: 0 in 0.591s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856.20b84733-0755-4a1e-b77a-bf38ef23755a" returned: 0 in 0.304s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] Lock "cinder-quobyte-20b84733-0755-4a1e-b77a-bf38ef23755a" released by "_delete_snapshot" :: held 2.036s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] Lock "cinder-quobyte-43ec1a53-22d8-4dc1-b4cc-78cb391d9856" released by "delete_snapshot" :: held 2.110s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f6231d46-145d-4be3-a86b-dc270f06f0c1 tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] Acquiring lock "cinder-quobyte-891e44c8-54e3-4feb-bfef-090b2b1ffab5" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:11 devstack sudo[95120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d
Nov 06 17:10:11 devstack sudo[95120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:11 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-d0a3c6d3-03e6-4280-9e5b-4d47ffb9bcab tempest-VolumeQuotasAdminTestJSON-727634808 None] Transfer volume completed successfully.
Nov 06 17:10:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] Lock "cinder-quobyte-891e44c8-54e3-4feb-bfef-090b2b1ffab5" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] Acquiring lock "cinder-quobyte-4129b67d-3bf1-4065-ba56-8b97a5b3dc87" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] Lock "cinder-quobyte-4129b67d-3bf1-4065-ba56-8b97a5b3dc87" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:11 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] Deleting offline snapshot 4129b67d-3bf1-4065-ba56-8b97a5b3dc87 of volume 891e44c8-54e3-4feb-bfef-090b2b1ffab5 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:10:11 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] snapshot_file for this snap is: volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5.4129b67d-3bf1-4065-ba56-8b97a5b3dc87 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:10:11 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54153ce-b560-44fa-bf33-8eb6c80d7a96]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:10:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5.4129b67d-3bf1-4065-ba56-8b97a5b3dc87 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:11 devstack sudo[95122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5.4129b67d-3bf1-4065-ba56-8b97a5b3dc87
Nov 06 17:10:11 devstack sudo[95122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:11 devstack sudo[95120]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f6231d46-145d-4be3-a86b-dc270f06f0c1 tempest-VolumesDeleteCascade-2117513304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d" returned: 0 in 0.364s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:11 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-f6231d46-145d-4be3-a86b-dc270f06f0c1 tempest-VolumesDeleteCascade-2117513304 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:10:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f6231d46-145d-4be3-a86b-dc270f06f0c1 tempest-VolumesDeleteCascade-2117513304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:11 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f6231d46-145d-4be3-a86b-dc270f06f0c1 tempest-VolumesDeleteCascade-2117513304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c402210-8545-441d-8f75-9588ad981e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:11 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f6231d46-145d-4be3-a86b-dc270f06f0c1 tempest-VolumesDeleteCascade-2117513304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83458097-e8e3-4b8b-ba4a-e69c1dfc0b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:11 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-f6231d46-145d-4be3-a86b-dc270f06f0c1 tempest-VolumesDeleteCascade-2117513304 None] Volume volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d (f98db9a4-4fd2-427e-b2bc-316fc898ac5d): created successfully
Nov 06 17:10:11 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f6231d46-145d-4be3-a86b-dc270f06f0c1 tempest-VolumesDeleteCascade-2117513304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83458097-e8e3-4b8b-ba4a-e69c1dfc0b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:11 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f6231d46-145d-4be3-a86b-dc270f06f0c1 tempest-VolumesDeleteCascade-2117513304 None] Flow 'volume_create_manager' (807785d1-62a0-4b51-a4e8-e93be66d8d76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:10:11 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-f6231d46-145d-4be3-a86b-dc270f06f0c1 tempest-VolumesDeleteCascade-2117513304 None] Created volume successfully.
Nov 06 17:10:12 devstack sudo[95122]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:12 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c9875a4f-ab8b-4046-9d50-c6290ba77166 tempest-VolumeQuotasAdminTestJSON-442546234 None] Acquiring lock "cinder-b92b3a11-f601-4dec-a0cc-64bb1f729a49-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5.4129b67d-3bf1-4065-ba56-8b97a5b3dc87" returned: 0 in 0.591s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:12 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:10:12 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bfcc54-d437-46eb-abfb-859dc5384e9e]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:10:12 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c9875a4f-ab8b-4046-9d50-c6290ba77166 tempest-VolumeQuotasAdminTestJSON-442546234 None] Lock "cinder-b92b3a11-f601-4dec-a0cc-64bb1f729a49-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:12 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c9875a4f-ab8b-4046-9d50-c6290ba77166 tempest-VolumeQuotasAdminTestJSON-442546234 None] Acquiring lock "cinder-quobyte-b92b3a11-f601-4dec-a0cc-64bb1f729a49" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:12 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c9875a4f-ab8b-4046-9d50-c6290ba77166 tempest-VolumeQuotasAdminTestJSON-442546234 None] Lock "cinder-quobyte-b92b3a11-f601-4dec-a0cc-64bb1f729a49" acquired by "delete_volume" :: waited 0.015s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:12 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e428a0-40bf-41f0-9fc6-cf5c4d0c312c]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:10:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c9875a4f-ab8b-4046-9d50-c6290ba77166 tempest-VolumeQuotasAdminTestJSON-442546234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b92b3a11-f601-4dec-a0cc-64bb1f729a49 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:12 devstack sudo[95130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5
Nov 06 17:10:12 devstack sudo[95130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:12 devstack sudo[95131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b92b3a11-f601-4dec-a0cc-64bb1f729a49
Nov 06 17:10:12 devstack sudo[95131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:12 devstack sudo[95130]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5" returned: 0 in 0.613s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5.4129b67d-3bf1-4065-ba56-8b97a5b3dc87 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:12 devstack sudo[95152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5.4129b67d-3bf1-4065-ba56-8b97a5b3dc87
Nov 06 17:10:12 devstack sudo[95152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:13 devstack sudo[95131]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c9875a4f-ab8b-4046-9d50-c6290ba77166 tempest-VolumeQuotasAdminTestJSON-442546234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b92b3a11-f601-4dec-a0cc-64bb1f729a49" returned: 0 in 0.837s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c9875a4f-ab8b-4046-9d50-c6290ba77166 tempest-VolumeQuotasAdminTestJSON-442546234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b92b3a11-f601-4dec-a0cc-64bb1f729a49 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:13 devstack sudo[95187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b92b3a11-f601-4dec-a0cc-64bb1f729a49
Nov 06 17:10:13 devstack sudo[95187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6d68177e-f905-462e-ad39-a6ebe49a633a tempest-VolumesDeleteCascade-2117513304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6d68177e-f905-462e-ad39-a6ebe49a633a tempest-VolumesDeleteCascade-2117513304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:13 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-6d68177e-f905-462e-ad39-a6ebe49a633a tempest-VolumesDeleteCascade-2117513304 None] Creating offline snapshot 52e54b72-b5fb-45e1-b9f8-054cb62dc586 of volume f98db9a4-4fd2-427e-b2bc-316fc898ac5d {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:10:13 devstack sudo[95187]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c9875a4f-ab8b-4046-9d50-c6290ba77166 tempest-VolumeQuotasAdminTestJSON-442546234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b92b3a11-f601-4dec-a0cc-64bb1f729a49" returned: 0 in 0.422s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:13 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aed64f8-ff33-4b54-92ed-7384986c4065]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:10:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6d68177e-f905-462e-ad39-a6ebe49a633a tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:13 devstack sudo[95152]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5.4129b67d-3bf1-4065-ba56-8b97a5b3dc87" returned: 0 in 0.794s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5.4129b67d-3bf1-4065-ba56-8b97a5b3dc87 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:13 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c9875a4f-ab8b-4046-9d50-c6290ba77166 tempest-VolumeQuotasAdminTestJSON-442546234 None] Lock "cinder-quobyte-b92b3a11-f601-4dec-a0cc-64bb1f729a49" released by "delete_volume" :: held 1.372s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:13 devstack sudo[95207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5.4129b67d-3bf1-4065-ba56-8b97a5b3dc87
Nov 06 17:10:13 devstack sudo[95207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:13 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-c9875a4f-ab8b-4046-9d50-c6290ba77166 tempest-VolumeQuotasAdminTestJSON-442546234 None] Created reservations ['99aca0e2-8fac-4640-b575-e45e3271104a', '6df99e4e-63e2-424d-ab29-8df5e7267bf0', 'c37c487e-96d7-416a-9ad1-5f112b7927dd', '298b0a85-270c-4c5a-a53e-6657972f193c'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:10:13 devstack sudo[95206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d
Nov 06 17:10:13 devstack sudo[95206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c9875a4f-ab8b-4046-9d50-c6290ba77166 tempest-VolumeQuotasAdminTestJSON-442546234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c9875a4f-ab8b-4046-9d50-c6290ba77166 tempest-VolumeQuotasAdminTestJSON-442546234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:13 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c9875a4f-ab8b-4046-9d50-c6290ba77166 tempest-VolumeQuotasAdminTestJSON-442546234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:10:14 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c9875a4f-ab8b-4046-9d50-c6290ba77166 tempest-VolumeQuotasAdminTestJSON-442546234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:10:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c9875a4f-ab8b-4046-9d50-c6290ba77166 tempest-VolumeQuotasAdminTestJSON-442546234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.079s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c9875a4f-ab8b-4046-9d50-c6290ba77166 tempest-VolumeQuotasAdminTestJSON-442546234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:14 devstack sudo[95215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:10:14 devstack sudo[95215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:14 devstack sudo[95206]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6d68177e-f905-462e-ad39-a6ebe49a633a tempest-VolumesDeleteCascade-2117513304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d" returned: 0 in 0.652s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6d68177e-f905-462e-ad39-a6ebe49a633a tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.52e54b72-b5fb-45e1-b9f8-054cb62dc586 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:14 devstack sudo[95207]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5.4129b67d-3bf1-4065-ba56-8b97a5b3dc87" returned: 0 in 0.666s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:14 devstack sudo[95224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.52e54b72-b5fb-45e1-b9f8-054cb62dc586 1G
Nov 06 17:10:14 devstack sudo[95224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:14 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] Lock "cinder-quobyte-4129b67d-3bf1-4065-ba56-8b97a5b3dc87" released by "_delete_snapshot" :: held 2.825s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:14 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] Lock "cinder-quobyte-891e44c8-54e3-4feb-bfef-090b2b1ffab5" released by "delete_snapshot" :: held 2.855s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:14 devstack sudo[95215]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c9875a4f-ab8b-4046-9d50-c6290ba77166 tempest-VolumeQuotasAdminTestJSON-442546234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.382s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:14 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-c9875a4f-ab8b-4046-9d50-c6290ba77166 tempest-VolumeQuotasAdminTestJSON-442546234 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:10:14 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-c9875a4f-ab8b-4046-9d50-c6290ba77166 tempest-VolumeQuotasAdminTestJSON-442546234 None] Deleted volume successfully.
Nov 06 17:10:14 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c9875a4f-ab8b-4046-9d50-c6290ba77166 tempest-VolumeQuotasAdminTestJSON-442546234 None] Lock "cinder-b92b3a11-f601-4dec-a0cc-64bb1f729a49-delete_volume" released by "delete_volume" :: held 2.235s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:14 devstack cinder-volume[86856]: WARNING cinder.quota [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-363734846 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-363734846, it is now deprecated. Please use the default quota class for default quota.
Nov 06 17:10:14 devstack cinder-volume[86856]: WARNING cinder.quota [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-363734846 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-363734846, it is now deprecated. Please use the default quota class for default quota.
Nov 06 17:10:14 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] Created reservations ['8d2f59f1-d671-4549-acf2-e6e4f13644d3', '358df5b7-445d-4c3e-9f61-925a014d1076', 'f0134ed7-8898-458e-a0d7-61f33aa9a027', '042e5799-492c-4a12-8e6d-986eb39db033'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:10:14 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] Created reservations ['b14beedd-c8fb-40c3-9f74-47f6dafeec0f', '4e0827ad-c02b-41e5-9a73-0e86da355edd', '2a6a76e3-841e-4d45-a729-8e36b97e2a0f', '483d07ec-fff1-49cd-a2e5-794be8a46300'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:10:14 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-fd63de14-0adb-4f47-b61d-74f13ad7fc95 tempest-GroupSnapshotsTest-1647710575 None] group_snapshot a68db64d-2918-4894-8037-36160240aeba: deleted successfully
Nov 06 17:10:15 devstack sudo[95224]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6d68177e-f905-462e-ad39-a6ebe49a633a tempest-VolumesDeleteCascade-2117513304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.52e54b72-b5fb-45e1-b9f8-054cb62dc586 1G" returned: 0 in 0.824s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6d68177e-f905-462e-ad39-a6ebe49a633a tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.52e54b72-b5fb-45e1-b9f8-054cb62dc586 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:15 devstack sudo[95234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.52e54b72-b5fb-45e1-b9f8-054cb62dc586
Nov 06 17:10:15 devstack sudo[95234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:15 devstack sudo[95234]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6d68177e-f905-462e-ad39-a6ebe49a633a tempest-VolumesDeleteCascade-2117513304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.52e54b72-b5fb-45e1-b9f8-054cb62dc586" returned: 0 in 0.509s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:15 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-6d68177e-f905-462e-ad39-a6ebe49a633a tempest-VolumesDeleteCascade-2117513304 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.52e54b72-b5fb-45e1-b9f8-054cb62dc586 is being set with open permissions: ugo+rw
Nov 06 17:10:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6d68177e-f905-462e-ad39-a6ebe49a633a tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.52e54b72-b5fb-45e1-b9f8-054cb62dc586 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:15 devstack sudo[95240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.52e54b72-b5fb-45e1-b9f8-054cb62dc586
Nov 06 17:10:15 devstack sudo[95240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:15 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f5e52743-d59e-4578-a43a-55b1cd2febcc tempest-GroupSnapshotsTest-1647710575 None] Acquiring lock "cinder-quobyte-43ec1a53-22d8-4dc1-b4cc-78cb391d9856" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:15 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f5e52743-d59e-4578-a43a-55b1cd2febcc tempest-GroupSnapshotsTest-1647710575 None] Lock "cinder-quobyte-43ec1a53-22d8-4dc1-b4cc-78cb391d9856" acquired by "delete_volume" :: waited 0.041s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:15 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5a4b40-b7d4-4485-b466-14439b8fd421]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:10:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f5e52743-d59e-4578-a43a-55b1cd2febcc tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:15 devstack sudo[95242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856
Nov 06 17:10:15 devstack sudo[95242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:15 devstack sudo[95240]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6d68177e-f905-462e-ad39-a6ebe49a633a tempest-VolumesDeleteCascade-2117513304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.52e54b72-b5fb-45e1-b9f8-054cb62dc586" returned: 0 in 0.376s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6d68177e-f905-462e-ad39-a6ebe49a633a tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:16 devstack sudo[95245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.info
Nov 06 17:10:16 devstack sudo[95245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:16 devstack sudo[95242]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f5e52743-d59e-4578-a43a-55b1cd2febcc tempest-GroupSnapshotsTest-1647710575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856" returned: 0 in 0.521s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f5e52743-d59e-4578-a43a-55b1cd2febcc tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:16 devstack sudo[95250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856
Nov 06 17:10:16 devstack sudo[95250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:16 devstack sudo[95245]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6d68177e-f905-462e-ad39-a6ebe49a633a tempest-VolumesDeleteCascade-2117513304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.info" returned: 0 in 0.404s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:16 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-6d68177e-f905-462e-ad39-a6ebe49a633a tempest-VolumesDeleteCascade-2117513304 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.info is being set with open permissions: ugo+rw
Nov 06 17:10:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6d68177e-f905-462e-ad39-a6ebe49a633a tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:16 devstack sudo[95253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.info
Nov 06 17:10:16 devstack sudo[95253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:16 devstack sudo[95250]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f5e52743-d59e-4578-a43a-55b1cd2febcc tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-43ec1a53-22d8-4dc1-b4cc-78cb391d9856" returned: 0 in 0.416s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:16 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f5e52743-d59e-4578-a43a-55b1cd2febcc tempest-GroupSnapshotsTest-1647710575 None] Lock "cinder-quobyte-43ec1a53-22d8-4dc1-b4cc-78cb391d9856" released by "delete_volume" :: held 1.084s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:16 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f5e52743-d59e-4578-a43a-55b1cd2febcc tempest-GroupSnapshotsTest-1647710575 None] Acquiring lock "cinder-quobyte-891e44c8-54e3-4feb-bfef-090b2b1ffab5" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:16 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f5e52743-d59e-4578-a43a-55b1cd2febcc tempest-GroupSnapshotsTest-1647710575 None] Lock "cinder-quobyte-891e44c8-54e3-4feb-bfef-090b2b1ffab5" acquired by "delete_volume" :: waited 0.026s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:16 devstack sudo[95253]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6d68177e-f905-462e-ad39-a6ebe49a633a tempest-VolumesDeleteCascade-2117513304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.info" returned: 0 in 0.448s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6d68177e-f905-462e-ad39-a6ebe49a633a tempest-VolumesDeleteCascade-2117513304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.389s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:16 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fbbb8e-7d54-4b5a-b6c6-dfccde146379]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:10:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f5e52743-d59e-4578-a43a-55b1cd2febcc tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:17 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-6d68177e-f905-462e-ad39-a6ebe49a633a tempest-VolumesDeleteCascade-2117513304 None] Create snapshot completed successfully
Nov 06 17:10:17 devstack sudo[95257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5
Nov 06 17:10:17 devstack sudo[95257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:17 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-cffa7644-b8fa-43d1-90e2-acac88916e6b tempest-VolumesActionsTest-619378497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:10:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cffa7644-b8fa-43d1-90e2-acac88916e6b tempest-VolumesActionsTest-619378497 None] Flow 'volume_create_manager' (a3d6eca6-8a58-4e02-9f62-f9f15d55fc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:10:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cffa7644-b8fa-43d1-90e2-acac88916e6b tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26160f72-abc0-4156-abf1-6d0a1e4e8450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cffa7644-b8fa-43d1-90e2-acac88916e6b tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26160f72-abc0-4156-abf1-6d0a1e4e8450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-549777439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08ccaa7a-11d6-42a8-90c0-c1d87a5d6b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db018548e4294a7d90917ec2cd21b08f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:10:17Z,use_quota=True,user_id='3c3572b432f640ab90152886669b3fc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cffa7644-b8fa-43d1-90e2-acac88916e6b tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f8dd6e4-d33c-4b4b-aec7-ea8eea879787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cffa7644-b8fa-43d1-90e2-acac88916e6b tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f8dd6e4-d33c-4b4b-aec7-ea8eea879787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cffa7644-b8fa-43d1-90e2-acac88916e6b tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6669a2e-36b7-4874-82cd-136eee46beee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:17 devstack sudo[95257]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cffa7644-b8fa-43d1-90e2-acac88916e6b tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6669a2e-36b7-4874-82cd-136eee46beee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08ccaa7a-11d6-42a8-90c0-c1d87a5d6b0c', 'volume_name': 'volume-08ccaa7a-11d6-42a8-90c0-c1d87a5d6b0c', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cffa7644-b8fa-43d1-90e2-acac88916e6b tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c884f9d-8c59-4a21-9223-1cee169bc710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cffa7644-b8fa-43d1-90e2-acac88916e6b tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c884f9d-8c59-4a21-9223-1cee169bc710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cffa7644-b8fa-43d1-90e2-acac88916e6b tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (930e2a54-c364-4295-8b31-ffcdd94a4af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:17 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-cffa7644-b8fa-43d1-90e2-acac88916e6b tempest-VolumesActionsTest-619378497 None] Volume 08ccaa7a-11d6-42a8-90c0-c1d87a5d6b0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08ccaa7a-11d6-42a8-90c0-c1d87a5d6b0c', 'volume_size': 1}
Nov 06 17:10:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-cffa7644-b8fa-43d1-90e2-acac88916e6b tempest-VolumesActionsTest-619378497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-cffa7644-b8fa-43d1-90e2-acac88916e6b tempest-VolumesActionsTest-619378497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:17 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-cffa7644-b8fa-43d1-90e2-acac88916e6b tempest-VolumesActionsTest-619378497 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-549777439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08ccaa7a-11d6-42a8-90c0-c1d87a5d6b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db018548e4294a7d90917ec2cd21b08f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:10:17Z,use_quota=True,user_id='3c3572b432f640ab90152886669b3fc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:10:17 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-cffa7644-b8fa-43d1-90e2-acac88916e6b tempest-VolumesActionsTest-619378497 None] Creating volume 08ccaa7a-11d6-42a8-90c0-c1d87a5d6b0c {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:10:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-cffa7644-b8fa-43d1-90e2-acac88916e6b tempest-VolumesActionsTest-619378497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-cffa7644-b8fa-43d1-90e2-acac88916e6b tempest-VolumesActionsTest-619378497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:17 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-cffa7644-b8fa-43d1-90e2-acac88916e6b tempest-VolumesActionsTest-619378497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:10:17 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-cffa7644-b8fa-43d1-90e2-acac88916e6b tempest-VolumesActionsTest-619378497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:10:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-cffa7644-b8fa-43d1-90e2-acac88916e6b tempest-VolumesActionsTest-619378497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:17 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-cffa7644-b8fa-43d1-90e2-acac88916e6b tempest-VolumesActionsTest-619378497 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:10:17 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-cffa7644-b8fa-43d1-90e2-acac88916e6b tempest-VolumesActionsTest-619378497 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:10:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cffa7644-b8fa-43d1-90e2-acac88916e6b tempest-VolumesActionsTest-619378497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-08ccaa7a-11d6-42a8-90c0-c1d87a5d6b0c 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f5e52743-d59e-4578-a43a-55b1cd2febcc tempest-GroupSnapshotsTest-1647710575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5" returned: 0 in 0.783s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f5e52743-d59e-4578-a43a-55b1cd2febcc tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:17 devstack sudo[95263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5
Nov 06 17:10:17 devstack sudo[95263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:17 devstack sudo[95262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-08ccaa7a-11d6-42a8-90c0-c1d87a5d6b0c 1073741824
Nov 06 17:10:17 devstack sudo[95262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:18 devstack sudo[95263]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f5e52743-d59e-4578-a43a-55b1cd2febcc tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-891e44c8-54e3-4feb-bfef-090b2b1ffab5" returned: 0 in 0.392s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:18 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f5e52743-d59e-4578-a43a-55b1cd2febcc tempest-GroupSnapshotsTest-1647710575 None] Lock "cinder-quobyte-891e44c8-54e3-4feb-bfef-090b2b1ffab5" released by "delete_volume" :: held 1.345s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b65142e6-7692-4e2f-b10e-3b7345de5623 tempest-VolumesDeleteCascade-2117513304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:18 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-f5e52743-d59e-4578-a43a-55b1cd2febcc tempest-GroupSnapshotsTest-1647710575 None] Created reservations ['be5a6c51-9b28-4c4e-8393-c1eb8bbefee8'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:10:18 devstack cinder-volume[86856]: WARNING cinder.quota [None req-f5e52743-d59e-4578-a43a-55b1cd2febcc tempest-GroupSnapshotsTest-1647710575 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-363734846 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-363734846, it is now deprecated. Please use the default quota class for default quota.
Nov 06 17:10:18 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-f5e52743-d59e-4578-a43a-55b1cd2febcc tempest-GroupSnapshotsTest-1647710575 None] Created reservations ['192e4c15-ff2e-4338-b9a0-2552853f897c', '69782402-af7d-4730-b0d5-af9f5472cf38', 'b7e58086-7659-4a25-aa14-dd7e29fa0134', 'ad9bb27b-871d-4ba9-8b0f-f39a12b283ca'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:10:18 devstack sudo[95262]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cffa7644-b8fa-43d1-90e2-acac88916e6b tempest-VolumesActionsTest-619378497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-08ccaa7a-11d6-42a8-90c0-c1d87a5d6b0c 1073741824" returned: 0 in 0.874s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:18 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-f5e52743-d59e-4578-a43a-55b1cd2febcc tempest-GroupSnapshotsTest-1647710575 None] Created reservations ['f0f2cbc3-81c7-4f73-a386-374b94cc35df', 'c748d4f1-98ae-4472-8fe9-89f85169de16', 'e8d18aa7-c676-420f-a8dd-1f07ecbfa700', 'cfff5115-4f19-4270-8330-48fd2bb25b5e'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:10:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cffa7644-b8fa-43d1-90e2-acac88916e6b tempest-VolumesActionsTest-619378497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-08ccaa7a-11d6-42a8-90c0-c1d87a5d6b0c {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:18 devstack sudo[95272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-08ccaa7a-11d6-42a8-90c0-c1d87a5d6b0c
Nov 06 17:10:18 devstack sudo[95272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f5e52743-d59e-4578-a43a-55b1cd2febcc tempest-GroupSnapshotsTest-1647710575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f5e52743-d59e-4578-a43a-55b1cd2febcc tempest-GroupSnapshotsTest-1647710575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:18 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-f5e52743-d59e-4578-a43a-55b1cd2febcc tempest-GroupSnapshotsTest-1647710575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:10:18 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-f5e52743-d59e-4578-a43a-55b1cd2febcc tempest-GroupSnapshotsTest-1647710575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:10:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f5e52743-d59e-4578-a43a-55b1cd2febcc tempest-GroupSnapshotsTest-1647710575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f5e52743-d59e-4578-a43a-55b1cd2febcc tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:18 devstack sudo[95274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:10:18 devstack sudo[95274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:18 devstack sudo[95272]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cffa7644-b8fa-43d1-90e2-acac88916e6b tempest-VolumesActionsTest-619378497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-08ccaa7a-11d6-42a8-90c0-c1d87a5d6b0c" returned: 0 in 0.298s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:18 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-cffa7644-b8fa-43d1-90e2-acac88916e6b tempest-VolumesActionsTest-619378497 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:10:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-cffa7644-b8fa-43d1-90e2-acac88916e6b tempest-VolumesActionsTest-619378497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b65142e6-7692-4e2f-b10e-3b7345de5623 tempest-VolumesDeleteCascade-2117513304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.759s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:18 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-b65142e6-7692-4e2f-b10e-3b7345de5623 tempest-VolumesDeleteCascade-2117513304 None] Creating offline snapshot 242a8720-0542-4e05-8f71-502481ee0a94 of volume f98db9a4-4fd2-427e-b2bc-316fc898ac5d {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:10:19 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cffa7644-b8fa-43d1-90e2-acac88916e6b tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (930e2a54-c364-4295-8b31-ffcdd94a4af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08ccaa7a-11d6-42a8-90c0-c1d87a5d6b0c', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:19 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cffa7644-b8fa-43d1-90e2-acac88916e6b tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6501ee3d-8178-4734-bda5-a5621344e1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:19 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[0699c53f-dbec-4fdf-a404-9a13b1af0ffa]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:10:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b65142e6-7692-4e2f-b10e-3b7345de5623 tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.52e54b72-b5fb-45e1-b9f8-054cb62dc586 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:19 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-cffa7644-b8fa-43d1-90e2-acac88916e6b tempest-VolumesActionsTest-619378497 None] Volume volume-08ccaa7a-11d6-42a8-90c0-c1d87a5d6b0c (08ccaa7a-11d6-42a8-90c0-c1d87a5d6b0c): created successfully
Nov 06 17:10:19 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cffa7644-b8fa-43d1-90e2-acac88916e6b tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6501ee3d-8178-4734-bda5-a5621344e1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:19 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cffa7644-b8fa-43d1-90e2-acac88916e6b tempest-VolumesActionsTest-619378497 None] Flow 'volume_create_manager' (a3d6eca6-8a58-4e02-9f62-f9f15d55fc18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:10:19 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-cffa7644-b8fa-43d1-90e2-acac88916e6b tempest-VolumesActionsTest-619378497 None] Created volume successfully.
Nov 06 17:10:19 devstack sudo[95274]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f5e52743-d59e-4578-a43a-55b1cd2febcc tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.401s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:19 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-f5e52743-d59e-4578-a43a-55b1cd2febcc tempest-GroupSnapshotsTest-1647710575 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:10:19 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-f5e52743-d59e-4578-a43a-55b1cd2febcc tempest-GroupSnapshotsTest-1647710575 None] Delete group completed successfully.
Nov 06 17:10:19 devstack sudo[95278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.52e54b72-b5fb-45e1-b9f8-054cb62dc586
Nov 06 17:10:19 devstack sudo[95278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:19 devstack sudo[95278]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b65142e6-7692-4e2f-b10e-3b7345de5623 tempest-VolumesDeleteCascade-2117513304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.52e54b72-b5fb-45e1-b9f8-054cb62dc586" returned: 0 in 0.455s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:19 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-b65142e6-7692-4e2f-b10e-3b7345de5623 tempest-VolumesDeleteCascade-2117513304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:10:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b65142e6-7692-4e2f-b10e-3b7345de5623 tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.52e54b72-b5fb-45e1-b9f8-054cb62dc586,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.242a8720-0542-4e05-8f71-502481ee0a94 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:19 devstack sudo[95283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.52e54b72-b5fb-45e1-b9f8-054cb62dc586,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.242a8720-0542-4e05-8f71-502481ee0a94 1G
Nov 06 17:10:19 devstack sudo[95283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:19 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7622d37c-068a-47d1-9442-a7ae73bee561 tempest-VolumesActionsTest-619378497 None] Acquiring lock "cinder-08ccaa7a-11d6-42a8-90c0-c1d87a5d6b0c" by "attach_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:19 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7622d37c-068a-47d1-9442-a7ae73bee561 tempest-VolumesActionsTest-619378497 None] Lock "cinder-08ccaa7a-11d6-42a8-90c0-c1d87a5d6b0c" acquired by "attach_volume" :: waited 0.052s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:19 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-7622d37c-068a-47d1-9442-a7ae73bee561 tempest-VolumesActionsTest-619378497 None] Attaching volume 08ccaa7a-11d6-42a8-90c0-c1d87a5d6b0c to instance 7fc3e6d8-f2e2-4887-bd92-86987156a781 at mountpoint /dev/vdb on host None.
Nov 06 17:10:19 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-7622d37c-068a-47d1-9442-a7ae73bee561 tempest-VolumesActionsTest-619378497 None] Attach volume completed successfully.
Nov 06 17:10:20 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7622d37c-068a-47d1-9442-a7ae73bee561 tempest-VolumesActionsTest-619378497 None] Lock "cinder-08ccaa7a-11d6-42a8-90c0-c1d87a5d6b0c" released by "attach_volume" :: held 0.201s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:20 devstack sudo[95283]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b65142e6-7692-4e2f-b10e-3b7345de5623 tempest-VolumesDeleteCascade-2117513304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.52e54b72-b5fb-45e1-b9f8-054cb62dc586,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.242a8720-0542-4e05-8f71-502481ee0a94 1G" returned: 0 in 0.869s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b65142e6-7692-4e2f-b10e-3b7345de5623 tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.52e54b72-b5fb-45e1-b9f8-054cb62dc586 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.242a8720-0542-4e05-8f71-502481ee0a94 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:20 devstack sudo[95288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.52e54b72-b5fb-45e1-b9f8-054cb62dc586 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.242a8720-0542-4e05-8f71-502481ee0a94
Nov 06 17:10:20 devstack sudo[95288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:20 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-71a2b707-a3a9-41b9-a40d-bacf2dc0ae0b tempest-GroupSnapshotsTest-1647710575 None] Group tempest-GroupSnapshotsTest-Group-866349728: creating
Nov 06 17:10:20 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-71a2b707-a3a9-41b9-a40d-bacf2dc0ae0b tempest-GroupSnapshotsTest-1647710575 None] Group tempest-GroupSnapshotsTest-Group-866349728: created successfully
Nov 06 17:10:20 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-71a2b707-a3a9-41b9-a40d-bacf2dc0ae0b tempest-GroupSnapshotsTest-1647710575 None] Create group completed successfully.
Nov 06 17:10:21 devstack sudo[95288]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b65142e6-7692-4e2f-b10e-3b7345de5623 tempest-VolumesDeleteCascade-2117513304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.52e54b72-b5fb-45e1-b9f8-054cb62dc586 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.242a8720-0542-4e05-8f71-502481ee0a94" returned: 0 in 0.592s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:21 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-b65142e6-7692-4e2f-b10e-3b7345de5623 tempest-VolumesDeleteCascade-2117513304 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.242a8720-0542-4e05-8f71-502481ee0a94 is being set with open permissions: ugo+rw
Nov 06 17:10:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b65142e6-7692-4e2f-b10e-3b7345de5623 tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.242a8720-0542-4e05-8f71-502481ee0a94 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:21 devstack sudo[95295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.242a8720-0542-4e05-8f71-502481ee0a94
Nov 06 17:10:21 devstack sudo[95295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:21 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-39709668-a250-417d-9a3c-21273321cca2 tempest-VolumesActionsTest-912802788 None] Terminate volume connection completed successfully.
Nov 06 17:10:21 devstack sudo[95295]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:21 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-39709668-a250-417d-9a3c-21273321cca2 tempest-VolumesActionsTest-912802788 None] Acquiring lock "cinder-08ccaa7a-11d6-42a8-90c0-c1d87a5d6b0c-detach_volume" by "detach_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b65142e6-7692-4e2f-b10e-3b7345de5623 tempest-VolumesDeleteCascade-2117513304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.242a8720-0542-4e05-8f71-502481ee0a94" returned: 0 in 0.364s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:21 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-39709668-a250-417d-9a3c-21273321cca2 tempest-VolumesActionsTest-912802788 None] Lock "cinder-08ccaa7a-11d6-42a8-90c0-c1d87a5d6b0c-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b65142e6-7692-4e2f-b10e-3b7345de5623 tempest-VolumesDeleteCascade-2117513304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.488s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:21 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-39709668-a250-417d-9a3c-21273321cca2 tempest-VolumesActionsTest-912802788 None] Detaching volume 08ccaa7a-11d6-42a8-90c0-c1d87a5d6b0c from instance 7fc3e6d8-f2e2-4887-bd92-86987156a781.
Nov 06 17:10:21 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-b65142e6-7692-4e2f-b10e-3b7345de5623 tempest-VolumesDeleteCascade-2117513304 None] Create snapshot completed successfully
Nov 06 17:10:21 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-39709668-a250-417d-9a3c-21273321cca2 tempest-VolumesActionsTest-912802788 None] Detach volume completed successfully.
Nov 06 17:10:21 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-39709668-a250-417d-9a3c-21273321cca2 tempest-VolumesActionsTest-912802788 None] Lock "cinder-08ccaa7a-11d6-42a8-90c0-c1d87a5d6b0c-detach_volume" released by "detach_volume" :: held 0.200s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:21 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-721899a0-c4d7-4263-b4fe-64c97cce8e5e tempest-VolumesActionsTest-619378497 None] Acquiring lock "cinder-08ccaa7a-11d6-42a8-90c0-c1d87a5d6b0c-detach_volume" by "detach_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:21 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-721899a0-c4d7-4263-b4fe-64c97cce8e5e tempest-VolumesActionsTest-619378497 None] Lock "cinder-08ccaa7a-11d6-42a8-90c0-c1d87a5d6b0c-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:21 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-721899a0-c4d7-4263-b4fe-64c97cce8e5e tempest-VolumesActionsTest-619378497 None] Volume detach called, but volume not attached.
Nov 06 17:10:22 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-721899a0-c4d7-4263-b4fe-64c97cce8e5e tempest-VolumesActionsTest-619378497 None] Lock "cinder-08ccaa7a-11d6-42a8-90c0-c1d87a5d6b0c-detach_volume" released by "detach_volume" :: held 0.032s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:22 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e90f09f9-ac77-41bf-b33d-81fec0dbb1ca tempest-VolumesActionsTest-619378497 None] Acquiring lock "cinder-08ccaa7a-11d6-42a8-90c0-c1d87a5d6b0c-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:22 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e90f09f9-ac77-41bf-b33d-81fec0dbb1ca tempest-VolumesActionsTest-619378497 None] Lock "cinder-08ccaa7a-11d6-42a8-90c0-c1d87a5d6b0c-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:22 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e90f09f9-ac77-41bf-b33d-81fec0dbb1ca tempest-VolumesActionsTest-619378497 None] Acquiring lock "cinder-quobyte-08ccaa7a-11d6-42a8-90c0-c1d87a5d6b0c" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:22 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e90f09f9-ac77-41bf-b33d-81fec0dbb1ca tempest-VolumesActionsTest-619378497 None] Lock "cinder-quobyte-08ccaa7a-11d6-42a8-90c0-c1d87a5d6b0c" acquired by "delete_volume" :: waited 0.029s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:22 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef7dfb6-71ec-4eda-8b29-d53ee274e31d]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:10:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e90f09f9-ac77-41bf-b33d-81fec0dbb1ca tempest-VolumesActionsTest-619378497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-08ccaa7a-11d6-42a8-90c0-c1d87a5d6b0c {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:22 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Acquiring lock "cinder-f98db9a4-4fd2-427e-b2bc-316fc898ac5d-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:22 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Lock "cinder-f98db9a4-4fd2-427e-b2bc-316fc898ac5d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:22 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-c37e1dde-9719-4c4b-9b3c-2bd936cd8fbf tempest-GroupSnapshotsTest-1647710575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:10:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c37e1dde-9719-4c4b-9b3c-2bd936cd8fbf tempest-GroupSnapshotsTest-1647710575 None] Flow 'volume_create_manager' (4fdbbd2c-9b48-4fd5-96ee-21247322b5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:10:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c37e1dde-9719-4c4b-9b3c-2bd936cd8fbf tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f12246-bf16-47b6-a9a9-3f3ef602bd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c37e1dde-9719-4c4b-9b3c-2bd936cd8fbf tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f12246-bf16-47b6-a9a9-3f3ef602bd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-433793274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=91bce0b2-c370-419c-966b-b138cb626380,host='devstack@QuobyteHD#QuobyteHD',id=d6a4fe04-3509-4295-bb95-3bf88a70ec92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dd9c18dca9a4bb599b8d91b0f3816e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:10:23Z,use_quota=True,user_id='9a4d2f51c3094da4a21a4d29425ef175',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ae66438-689a-4026-86c1-5ec460a53e6b),volume_type_id=0ae66438-689a-4026-86c1-5ec460a53e6b)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c37e1dde-9719-4c4b-9b3c-2bd936cd8fbf tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eb7a1f5-0f64-48c5-8a6d-9ea4734593bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:22 devstack sudo[95298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-08ccaa7a-11d6-42a8-90c0-c1d87a5d6b0c
Nov 06 17:10:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c37e1dde-9719-4c4b-9b3c-2bd936cd8fbf tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eb7a1f5-0f64-48c5-8a6d-9ea4734593bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:22 devstack sudo[95298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c37e1dde-9719-4c4b-9b3c-2bd936cd8fbf tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c9f88b-dbc4-4646-b37d-0415919a6d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c37e1dde-9719-4c4b-9b3c-2bd936cd8fbf tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c9f88b-dbc4-4646-b37d-0415919a6d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6a4fe04-3509-4295-bb95-3bf88a70ec92', 'volume_name': 'volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c37e1dde-9719-4c4b-9b3c-2bd936cd8fbf tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29bd0326-dd78-498f-92b8-ee48a78d3d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c37e1dde-9719-4c4b-9b3c-2bd936cd8fbf tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29bd0326-dd78-498f-92b8-ee48a78d3d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c37e1dde-9719-4c4b-9b3c-2bd936cd8fbf tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cfda012-09ff-4c6d-b92f-02851f51fe4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:22 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-c37e1dde-9719-4c4b-9b3c-2bd936cd8fbf tempest-GroupSnapshotsTest-1647710575 None] Volume d6a4fe04-3509-4295-bb95-3bf88a70ec92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92', 'volume_size': 1}
Nov 06 17:10:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c37e1dde-9719-4c4b-9b3c-2bd936cd8fbf tempest-GroupSnapshotsTest-1647710575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c37e1dde-9719-4c4b-9b3c-2bd936cd8fbf tempest-GroupSnapshotsTest-1647710575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:22 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c37e1dde-9719-4c4b-9b3c-2bd936cd8fbf tempest-GroupSnapshotsTest-1647710575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=91bce0b2-c370-419c-966b-b138cb626380,created_at=2026-11-06T16:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-433793274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=91bce0b2-c370-419c-966b-b138cb626380,host='devstack@QuobyteHD#QuobyteHD',id=d6a4fe04-3509-4295-bb95-3bf88a70ec92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dd9c18dca9a4bb599b8d91b0f3816e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:10:23Z,use_quota=True,user_id='9a4d2f51c3094da4a21a4d29425ef175',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ae66438-689a-4026-86c1-5ec460a53e6b),volume_type_id=0ae66438-689a-4026-86c1-5ec460a53e6b)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:10:22 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-c37e1dde-9719-4c4b-9b3c-2bd936cd8fbf tempest-GroupSnapshotsTest-1647710575 None] Creating volume d6a4fe04-3509-4295-bb95-3bf88a70ec92 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:10:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c37e1dde-9719-4c4b-9b3c-2bd936cd8fbf tempest-GroupSnapshotsTest-1647710575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c37e1dde-9719-4c4b-9b3c-2bd936cd8fbf tempest-GroupSnapshotsTest-1647710575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:22 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c37e1dde-9719-4c4b-9b3c-2bd936cd8fbf tempest-GroupSnapshotsTest-1647710575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:10:22 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c37e1dde-9719-4c4b-9b3c-2bd936cd8fbf tempest-GroupSnapshotsTest-1647710575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:10:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c37e1dde-9719-4c4b-9b3c-2bd936cd8fbf tempest-GroupSnapshotsTest-1647710575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:22 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c37e1dde-9719-4c4b-9b3c-2bd936cd8fbf tempest-GroupSnapshotsTest-1647710575 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:10:22 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-c37e1dde-9719-4c4b-9b3c-2bd936cd8fbf tempest-GroupSnapshotsTest-1647710575 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:10:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c37e1dde-9719-4c4b-9b3c-2bd936cd8fbf tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Performing cascade delete. {{(pid=86856) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 06 17:10:22 devstack sudo[95300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92 1073741824
Nov 06 17:10:22 devstack sudo[95300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:22 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Acquiring lock "cinder-242a8720-0542-4e05-8f71-502481ee0a94-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:23 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Lock "cinder-242a8720-0542-4e05-8f71-502481ee0a94-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:23 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Acquiring lock "cinder-quobyte-f98db9a4-4fd2-427e-b2bc-316fc898ac5d" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:23 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Lock "cinder-quobyte-f98db9a4-4fd2-427e-b2bc-316fc898ac5d" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:23 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Acquiring lock "cinder-quobyte-242a8720-0542-4e05-8f71-502481ee0a94" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:23 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Lock "cinder-quobyte-242a8720-0542-4e05-8f71-502481ee0a94" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:23 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Deleting offline snapshot 242a8720-0542-4e05-8f71-502481ee0a94 of volume f98db9a4-4fd2-427e-b2bc-316fc898ac5d {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:10:23 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] snapshot_file for this snap is: volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.242a8720-0542-4e05-8f71-502481ee0a94 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:10:23 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ad7871-992c-4649-8a36-903079435d02]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:10:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.242a8720-0542-4e05-8f71-502481ee0a94 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:23 devstack sudo[95298]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e90f09f9-ac77-41bf-b33d-81fec0dbb1ca tempest-VolumesActionsTest-619378497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-08ccaa7a-11d6-42a8-90c0-c1d87a5d6b0c" returned: 0 in 0.796s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e90f09f9-ac77-41bf-b33d-81fec0dbb1ca tempest-VolumesActionsTest-619378497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-08ccaa7a-11d6-42a8-90c0-c1d87a5d6b0c {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:23 devstack sudo[95309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-08ccaa7a-11d6-42a8-90c0-c1d87a5d6b0c
Nov 06 17:10:23 devstack sudo[95304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.242a8720-0542-4e05-8f71-502481ee0a94
Nov 06 17:10:23 devstack sudo[95304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:23 devstack sudo[95309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:23 devstack sudo[95300]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c37e1dde-9719-4c4b-9b3c-2bd936cd8fbf tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92 1073741824" returned: 0 in 0.666s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c37e1dde-9719-4c4b-9b3c-2bd936cd8fbf tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:23 devstack sudo[95316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92
Nov 06 17:10:23 devstack sudo[95316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:23 devstack sudo[95304]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.242a8720-0542-4e05-8f71-502481ee0a94" returned: 0 in 0.554s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:23 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:10:23 devstack sudo[95309]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e90f09f9-ac77-41bf-b33d-81fec0dbb1ca tempest-VolumesActionsTest-619378497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-08ccaa7a-11d6-42a8-90c0-c1d87a5d6b0c" returned: 0 in 0.435s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:23 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[91585772-8f03-4fab-8e48-2bed3fb4bf31]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:10:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.52e54b72-b5fb-45e1-b9f8-054cb62dc586 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:23 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e90f09f9-ac77-41bf-b33d-81fec0dbb1ca tempest-VolumesActionsTest-619378497 None] Lock "cinder-quobyte-08ccaa7a-11d6-42a8-90c0-c1d87a5d6b0c" released by "delete_volume" :: held 1.331s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:23 devstack sudo[95319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.52e54b72-b5fb-45e1-b9f8-054cb62dc586
Nov 06 17:10:23 devstack sudo[95319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:23 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-e90f09f9-ac77-41bf-b33d-81fec0dbb1ca tempest-VolumesActionsTest-619378497 None] Created reservations ['0770539e-2cdd-455b-9386-fc360c23bb3b', '78706ab3-eab2-412e-9144-ef98a7ebaea2', 'd4241922-d942-4d96-a2f0-d83529d63f60', 'a0041cde-2a15-41db-b398-d9c11c7ba504'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:10:24 devstack sudo[95316]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c37e1dde-9719-4c4b-9b3c-2bd936cd8fbf tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92" returned: 0 in 0.448s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:24 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c37e1dde-9719-4c4b-9b3c-2bd936cd8fbf tempest-GroupSnapshotsTest-1647710575 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:10:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c37e1dde-9719-4c4b-9b3c-2bd936cd8fbf tempest-GroupSnapshotsTest-1647710575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:24 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c37e1dde-9719-4c4b-9b3c-2bd936cd8fbf tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cfda012-09ff-4c6d-b92f-02851f51fe4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:24 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c37e1dde-9719-4c4b-9b3c-2bd936cd8fbf tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b56a51bd-1a7a-431b-8436-a6f93b9b9a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:24 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-c37e1dde-9719-4c4b-9b3c-2bd936cd8fbf tempest-GroupSnapshotsTest-1647710575 None] Volume volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92 (d6a4fe04-3509-4295-bb95-3bf88a70ec92): created successfully
Nov 06 17:10:24 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c37e1dde-9719-4c4b-9b3c-2bd936cd8fbf tempest-GroupSnapshotsTest-1647710575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b56a51bd-1a7a-431b-8436-a6f93b9b9a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:24 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c37e1dde-9719-4c4b-9b3c-2bd936cd8fbf tempest-GroupSnapshotsTest-1647710575 None] Flow 'volume_create_manager' (4fdbbd2c-9b48-4fd5-96ee-21247322b5fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:10:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e90f09f9-ac77-41bf-b33d-81fec0dbb1ca tempest-VolumesActionsTest-619378497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e90f09f9-ac77-41bf-b33d-81fec0dbb1ca tempest-VolumesActionsTest-619378497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:24 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e90f09f9-ac77-41bf-b33d-81fec0dbb1ca tempest-VolumesActionsTest-619378497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:10:24 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e90f09f9-ac77-41bf-b33d-81fec0dbb1ca tempest-VolumesActionsTest-619378497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:10:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e90f09f9-ac77-41bf-b33d-81fec0dbb1ca tempest-VolumesActionsTest-619378497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e90f09f9-ac77-41bf-b33d-81fec0dbb1ca tempest-VolumesActionsTest-619378497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:24 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-c37e1dde-9719-4c4b-9b3c-2bd936cd8fbf tempest-GroupSnapshotsTest-1647710575 None] Created volume successfully.
Nov 06 17:10:24 devstack sudo[95324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:10:24 devstack sudo[95324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:24 devstack sudo[95319]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.52e54b72-b5fb-45e1-b9f8-054cb62dc586" returned: 0 in 0.544s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:24 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:10:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.242a8720-0542-4e05-8f71-502481ee0a94 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:24 devstack sudo[95328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.242a8720-0542-4e05-8f71-502481ee0a94
Nov 06 17:10:24 devstack sudo[95328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:24 devstack sudo[95324]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e90f09f9-ac77-41bf-b33d-81fec0dbb1ca tempest-VolumesActionsTest-619378497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.311s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:24 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-e90f09f9-ac77-41bf-b33d-81fec0dbb1ca tempest-VolumesActionsTest-619378497 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:10:24 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-e90f09f9-ac77-41bf-b33d-81fec0dbb1ca tempest-VolumesActionsTest-619378497 None] Deleted volume successfully.
Nov 06 17:10:24 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e90f09f9-ac77-41bf-b33d-81fec0dbb1ca tempest-VolumesActionsTest-619378497 None] Lock "cinder-08ccaa7a-11d6-42a8-90c0-c1d87a5d6b0c-delete_volume" released by "delete_volume" :: held 2.194s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:24 devstack sudo[95328]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.242a8720-0542-4e05-8f71-502481ee0a94" returned: 0 in 0.476s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.242a8720-0542-4e05-8f71-502481ee0a94 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:24 devstack sudo[95335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.242a8720-0542-4e05-8f71-502481ee0a94
Nov 06 17:10:24 devstack sudo[95335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:25 devstack sudo[95335]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.242a8720-0542-4e05-8f71-502481ee0a94" returned: 0 in 0.373s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:25 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Lock "cinder-quobyte-242a8720-0542-4e05-8f71-502481ee0a94" released by "_delete_snapshot" :: held 2.127s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:25 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Lock "cinder-quobyte-f98db9a4-4fd2-427e-b2bc-316fc898ac5d" released by "delete_snapshot" :: held 2.176s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:25 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Created reservations ['6c19132f-02e5-4aaa-a291-e2180e7b5871', 'd099f0a4-78e7-4bdf-881f-a98834717bf6', 'ea3537dc-575b-4c1a-97a2-28c37de77fdf', 'c0742e80-b497-4a3c-8434-c925e1319fc4'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:10:25 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Delete snapshot completed successfully.
Nov 06 17:10:25 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Lock "cinder-242a8720-0542-4e05-8f71-502481ee0a94-delete_snapshot" released by "delete_snapshot" :: held 2.579s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:25 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Acquiring lock "cinder-52e54b72-b5fb-45e1-b9f8-054cb62dc586-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:25 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Lock "cinder-52e54b72-b5fb-45e1-b9f8-054cb62dc586-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:25 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Acquiring lock "cinder-quobyte-f98db9a4-4fd2-427e-b2bc-316fc898ac5d" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:25 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Lock "cinder-quobyte-f98db9a4-4fd2-427e-b2bc-316fc898ac5d" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:25 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Acquiring lock "cinder-quobyte-52e54b72-b5fb-45e1-b9f8-054cb62dc586" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:25 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Lock "cinder-quobyte-52e54b72-b5fb-45e1-b9f8-054cb62dc586" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:25 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Deleting offline snapshot 52e54b72-b5fb-45e1-b9f8-054cb62dc586 of volume f98db9a4-4fd2-427e-b2bc-316fc898ac5d {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:10:25 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] snapshot_file for this snap is: volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.52e54b72-b5fb-45e1-b9f8-054cb62dc586 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:10:25 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e4dbb0-6cc1-450b-9c20-c474ba33a6c6]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:10:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.52e54b72-b5fb-45e1-b9f8-054cb62dc586 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:25 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-0e05fd6c-08fd-48f7-a2a7-d6265b36ab4e tempest-GroupSnapshotsTest-1647710575 None] GroupSnapshot 26d29ae7-5f70-467a-b67d-87b78df1abf5: creating.
Nov 06 17:10:25 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0e05fd6c-08fd-48f7-a2a7-d6265b36ab4e tempest-GroupSnapshotsTest-1647710575 None] Group snapshot 26d29ae7-5f70-467a-b67d-87b78df1abf5: creating. {{(pid=86856) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 06 17:10:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0e05fd6c-08fd-48f7-a2a7-d6265b36ab4e tempest-GroupSnapshotsTest-1647710575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0e05fd6c-08fd-48f7-a2a7-d6265b36ab4e tempest-GroupSnapshotsTest-1647710575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:25 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-0e05fd6c-08fd-48f7-a2a7-d6265b36ab4e tempest-GroupSnapshotsTest-1647710575 None] Creating offline snapshot 7397a299-0b37-4b65-a80e-66c72a7fc8ba of volume d6a4fe04-3509-4295-bb95-3bf88a70ec92 {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:10:25 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad9337f-af06-49ed-9f33-5724aeb1462b]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:10:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0e05fd6c-08fd-48f7-a2a7-d6265b36ab4e tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:25 devstack sudo[95358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.52e54b72-b5fb-45e1-b9f8-054cb62dc586
Nov 06 17:10:25 devstack sudo[95358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:26 devstack sudo[95360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92
Nov 06 17:10:26 devstack sudo[95360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:26 devstack sudo[95358]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.52e54b72-b5fb-45e1-b9f8-054cb62dc586" returned: 0 in 0.502s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:26 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:10:26 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[004e0903-d656-44a3-9f67-2b5e22dc2dc2]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:10:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:26 devstack sudo[95366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d
Nov 06 17:10:26 devstack sudo[95366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:26 devstack sudo[95360]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0e05fd6c-08fd-48f7-a2a7-d6265b36ab4e tempest-GroupSnapshotsTest-1647710575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92" returned: 0 in 0.705s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0e05fd6c-08fd-48f7-a2a7-d6265b36ab4e tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92.7397a299-0b37-4b65-a80e-66c72a7fc8ba 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:26 devstack sudo[95374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92.7397a299-0b37-4b65-a80e-66c72a7fc8ba 1G
Nov 06 17:10:26 devstack sudo[95374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:26 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-4714bcd6-5f91-4ba1-b0e3-80b74ac74bb9 tempest-VolumesServicesTestJSON-903287624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:10:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4714bcd6-5f91-4ba1-b0e3-80b74ac74bb9 tempest-VolumesServicesTestJSON-903287624 None] Flow 'volume_create_manager' (0f7008e6-8b51-455a-979f-7a59843b3c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:10:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4714bcd6-5f91-4ba1-b0e3-80b74ac74bb9 tempest-VolumesServicesTestJSON-903287624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e04c6cb2-7b0b-42dd-b5ae-80f85b630e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4714bcd6-5f91-4ba1-b0e3-80b74ac74bb9 tempest-VolumesServicesTestJSON-903287624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e04c6cb2-7b0b-42dd-b5ae-80f85b630e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1320441928',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0723c8be-f5dd-498c-b0ea-9b24b8998001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c6034ffc12437cadac0ee2af66fbad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:10:27Z,use_quota=True,user_id='84d4abe66cea45db9e8bdd7e0a329a94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:27 devstack sudo[95366]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4714bcd6-5f91-4ba1-b0e3-80b74ac74bb9 tempest-VolumesServicesTestJSON-903287624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (403cc1ab-b1a5-410b-adcf-9efc200e94c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4714bcd6-5f91-4ba1-b0e3-80b74ac74bb9 tempest-VolumesServicesTestJSON-903287624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (403cc1ab-b1a5-410b-adcf-9efc200e94c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4714bcd6-5f91-4ba1-b0e3-80b74ac74bb9 tempest-VolumesServicesTestJSON-903287624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62c316fc-d7fc-414a-a258-16318fd19b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4714bcd6-5f91-4ba1-b0e3-80b74ac74bb9 tempest-VolumesServicesTestJSON-903287624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62c316fc-d7fc-414a-a258-16318fd19b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0723c8be-f5dd-498c-b0ea-9b24b8998001', 'volume_name': 'volume-0723c8be-f5dd-498c-b0ea-9b24b8998001', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4714bcd6-5f91-4ba1-b0e3-80b74ac74bb9 tempest-VolumesServicesTestJSON-903287624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f1cb917-dfb9-4f68-84ca-934a5a71d388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4714bcd6-5f91-4ba1-b0e3-80b74ac74bb9 tempest-VolumesServicesTestJSON-903287624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f1cb917-dfb9-4f68-84ca-934a5a71d388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4714bcd6-5f91-4ba1-b0e3-80b74ac74bb9 tempest-VolumesServicesTestJSON-903287624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dcdf7d6-2f47-44ae-929c-81e05b9723bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:27 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-4714bcd6-5f91-4ba1-b0e3-80b74ac74bb9 tempest-VolumesServicesTestJSON-903287624 None] Volume 0723c8be-f5dd-498c-b0ea-9b24b8998001: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0723c8be-f5dd-498c-b0ea-9b24b8998001', 'volume_size': 1}
Nov 06 17:10:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4714bcd6-5f91-4ba1-b0e3-80b74ac74bb9 tempest-VolumesServicesTestJSON-903287624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d" returned: 0 in 0.757s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.52e54b72-b5fb-45e1-b9f8-054cb62dc586 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:27 devstack sudo[95385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.52e54b72-b5fb-45e1-b9f8-054cb62dc586
Nov 06 17:10:27 devstack sudo[95385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:27 devstack sudo[95374]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0e05fd6c-08fd-48f7-a2a7-d6265b36ab4e tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92.7397a299-0b37-4b65-a80e-66c72a7fc8ba 1G" returned: 0 in 0.575s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0e05fd6c-08fd-48f7-a2a7-d6265b36ab4e tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92.7397a299-0b37-4b65-a80e-66c72a7fc8ba {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:27 devstack sudo[95387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92.7397a299-0b37-4b65-a80e-66c72a7fc8ba
Nov 06 17:10:27 devstack sudo[95387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:27 devstack sudo[95385]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.52e54b72-b5fb-45e1-b9f8-054cb62dc586" returned: 0 in 0.386s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.52e54b72-b5fb-45e1-b9f8-054cb62dc586 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:27 devstack sudo[95387]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0e05fd6c-08fd-48f7-a2a7-d6265b36ab4e tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92.7397a299-0b37-4b65-a80e-66c72a7fc8ba" returned: 0 in 0.320s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:27 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-0e05fd6c-08fd-48f7-a2a7-d6265b36ab4e tempest-GroupSnapshotsTest-1647710575 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92.7397a299-0b37-4b65-a80e-66c72a7fc8ba is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 17:10:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0e05fd6c-08fd-48f7-a2a7-d6265b36ab4e tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92.7397a299-0b37-4b65-a80e-66c72a7fc8ba {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:27 devstack sudo[95395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.52e54b72-b5fb-45e1-b9f8-054cb62dc586
Nov 06 17:10:27 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:27 devstack sudo[95397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92.7397a299-0b37-4b65-a80e-66c72a7fc8ba
Nov 06 17:10:27 devstack sudo[95397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:27 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d.52e54b72-b5fb-45e1-b9f8-054cb62dc586" returned: 0 in 0.271s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:27 devstack sudo[95397]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0e05fd6c-08fd-48f7-a2a7-d6265b36ab4e tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92.7397a299-0b37-4b65-a80e-66c72a7fc8ba" returned: 0 in 0.279s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:27 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Lock "cinder-quobyte-52e54b72-b5fb-45e1-b9f8-054cb62dc586" released by "_delete_snapshot" :: held 2.093s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:27 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Lock "cinder-quobyte-f98db9a4-4fd2-427e-b2bc-316fc898ac5d" released by "delete_snapshot" :: held 2.147s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0e05fd6c-08fd-48f7-a2a7-d6265b36ab4e tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:27 devstack sudo[95401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92.info
Nov 06 17:10:27 devstack sudo[95401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:27 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Created reservations ['7e5233fc-371f-4278-8dbf-204443deb3e8', '20ce12f5-9c08-4352-9837-7661ec946e3c', '1998bbc3-c200-44ae-9503-469200badbc4', '19ca9ec3-ecea-46f8-9c91-67215c437637'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:10:27 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Delete snapshot completed successfully.
Nov 06 17:10:27 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Lock "cinder-52e54b72-b5fb-45e1-b9f8-054cb62dc586-delete_snapshot" released by "delete_snapshot" :: held 2.358s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Snapshots deleted, issuing volume delete {{(pid=86856) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 06 17:10:27 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Acquiring lock "cinder-quobyte-f98db9a4-4fd2-427e-b2bc-316fc898ac5d" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:27 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Lock "cinder-quobyte-f98db9a4-4fd2-427e-b2bc-316fc898ac5d" acquired by "delete_volume" :: waited 0.012s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f97e166-b5ee-4219-bf50-a106523fcfef]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:28 devstack sudo[95401]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0e05fd6c-08fd-48f7-a2a7-d6265b36ab4e tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92.info" returned: 0 in 0.326s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:28 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-0e05fd6c-08fd-48f7-a2a7-d6265b36ab4e tempest-GroupSnapshotsTest-1647710575 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0e05fd6c-08fd-48f7-a2a7-d6265b36ab4e tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:28 devstack sudo[95403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d
Nov 06 17:10:28 devstack sudo[95403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:28 devstack sudo[95405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92.info
Nov 06 17:10:28 devstack sudo[95405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a81e070-b501-4ce0-9ee7-cebe45af66e4 tempest-VolumesActionsTest-619378497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3a81e070-b501-4ce0-9ee7-cebe45af66e4 tempest-VolumesActionsTest-619378497 None] Flow 'volume_create_manager' (bd774278-3de0-4ca3-97fd-33889856f2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3a81e070-b501-4ce0-9ee7-cebe45af66e4 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f84473eb-2c31-4194-8939-f17bcc8b0a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3a81e070-b501-4ce0-9ee7-cebe45af66e4 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f84473eb-2c31-4194-8939-f17bcc8b0a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1999675925',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f9ccce9-8fdf-4ada-8edc-3e00fab4c590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db018548e4294a7d90917ec2cd21b08f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:10:28Z,use_quota=True,user_id='3c3572b432f640ab90152886669b3fc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3a81e070-b501-4ce0-9ee7-cebe45af66e4 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0ec708f-74c9-4546-81f6-131e25222cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3a81e070-b501-4ce0-9ee7-cebe45af66e4 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0ec708f-74c9-4546-81f6-131e25222cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3a81e070-b501-4ce0-9ee7-cebe45af66e4 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13fb2bc-30d5-4c9f-aba7-60d0cd67d1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3a81e070-b501-4ce0-9ee7-cebe45af66e4 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13fb2bc-30d5-4c9f-aba7-60d0cd67d1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f9ccce9-8fdf-4ada-8edc-3e00fab4c590', 'volume_name': 'volume-5f9ccce9-8fdf-4ada-8edc-3e00fab4c590', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3a81e070-b501-4ce0-9ee7-cebe45af66e4 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b488ec70-c76b-4897-b8f0-92990437cba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3a81e070-b501-4ce0-9ee7-cebe45af66e4 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b488ec70-c76b-4897-b8f0-92990437cba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3a81e070-b501-4ce0-9ee7-cebe45af66e4 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f688e160-6042-47ea-ab91-32bb68dcb5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:28 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-3a81e070-b501-4ce0-9ee7-cebe45af66e4 tempest-VolumesActionsTest-619378497 None] Volume 5f9ccce9-8fdf-4ada-8edc-3e00fab4c590: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f9ccce9-8fdf-4ada-8edc-3e00fab4c590', 'volume_size': 1}
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3a81e070-b501-4ce0-9ee7-cebe45af66e4 tempest-VolumesActionsTest-619378497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:28 devstack sudo[95403]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d" returned: 0 in 0.384s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:28 devstack sudo[95405]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0e05fd6c-08fd-48f7-a2a7-d6265b36ab4e tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92.info" returned: 0 in 0.299s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:28 devstack sudo[95412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d
Nov 06 17:10:28 devstack sudo[95412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0e05fd6c-08fd-48f7-a2a7-d6265b36ab4e tempest-GroupSnapshotsTest-1647710575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.637s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4714bcd6-5f91-4ba1-b0e3-80b74ac74bb9 tempest-VolumesServicesTestJSON-903287624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.408s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4714bcd6-5f91-4ba1-b0e3-80b74ac74bb9 tempest-VolumesServicesTestJSON-903287624 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1320441928',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0723c8be-f5dd-498c-b0ea-9b24b8998001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c6034ffc12437cadac0ee2af66fbad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:10:27Z,use_quota=True,user_id='84d4abe66cea45db9e8bdd7e0a329a94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-4714bcd6-5f91-4ba1-b0e3-80b74ac74bb9 tempest-VolumesServicesTestJSON-903287624 None] Creating volume 0723c8be-f5dd-498c-b0ea-9b24b8998001 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4714bcd6-5f91-4ba1-b0e3-80b74ac74bb9 tempest-VolumesServicesTestJSON-903287624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4714bcd6-5f91-4ba1-b0e3-80b74ac74bb9 tempest-VolumesServicesTestJSON-903287624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4714bcd6-5f91-4ba1-b0e3-80b74ac74bb9 tempest-VolumesServicesTestJSON-903287624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4714bcd6-5f91-4ba1-b0e3-80b74ac74bb9 tempest-VolumesServicesTestJSON-903287624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4714bcd6-5f91-4ba1-b0e3-80b74ac74bb9 tempest-VolumesServicesTestJSON-903287624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4714bcd6-5f91-4ba1-b0e3-80b74ac74bb9 tempest-VolumesServicesTestJSON-903287624 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:10:28 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-4714bcd6-5f91-4ba1-b0e3-80b74ac74bb9 tempest-VolumesServicesTestJSON-903287624 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4714bcd6-5f91-4ba1-b0e3-80b74ac74bb9 tempest-VolumesServicesTestJSON-903287624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0723c8be-f5dd-498c-b0ea-9b24b8998001 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:28 devstack sudo[95414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0723c8be-f5dd-498c-b0ea-9b24b8998001 1073741824
Nov 06 17:10:28 devstack sudo[95414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:28 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-0e05fd6c-08fd-48f7-a2a7-d6265b36ab4e tempest-GroupSnapshotsTest-1647710575 None] group_snapshot 26d29ae7-5f70-467a-b67d-87b78df1abf5: created successfully
Nov 06 17:10:28 devstack sudo[95412]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f98db9a4-4fd2-427e-b2bc-316fc898ac5d" returned: 0 in 0.264s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Lock "cinder-quobyte-f98db9a4-4fd2-427e-b2bc-316fc898ac5d" released by "delete_volume" :: held 0.749s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Created reservations ['0d55b442-56c9-4a5c-a4bc-0cdc19103553', 'b3a55f28-93b2-49c9-9c51-cfcfe89586b4', '7a591fa8-bb98-439b-86e5-9f6fed618235', 'b82246db-d616-4ff6-92a2-194547b15684'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:28 devstack sudo[95420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:10:28 devstack sudo[95420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:28 devstack sudo[95414]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4714bcd6-5f91-4ba1-b0e3-80b74ac74bb9 tempest-VolumesServicesTestJSON-903287624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0723c8be-f5dd-498c-b0ea-9b24b8998001 1073741824" returned: 0 in 0.472s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4714bcd6-5f91-4ba1-b0e3-80b74ac74bb9 tempest-VolumesServicesTestJSON-903287624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0723c8be-f5dd-498c-b0ea-9b24b8998001 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:29 devstack sudo[95423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0723c8be-f5dd-498c-b0ea-9b24b8998001
Nov 06 17:10:29 devstack sudo[95423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:29 devstack sudo[95420]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.270s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:29 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:10:29 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Deleted volume successfully.
Nov 06 17:10:29 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-de6c1d65-9a75-453e-ba43-616040ebb062 tempest-VolumesDeleteCascade-2117513304 None] Lock "cinder-f98db9a4-4fd2-427e-b2bc-316fc898ac5d-delete_volume" released by "delete_volume" :: held 6.421s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:29 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-f5bd2855-a4cd-484f-a262-847c80e0b7c6 tempest-GroupSnapshotsTest-1647710575 None] group_snapshot 26d29ae7-5f70-467a-b67d-87b78df1abf5: deleting
Nov 06 17:10:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f5bd2855-a4cd-484f-a262-847c80e0b7c6 tempest-GroupSnapshotsTest-1647710575 None] group_snapshot 26d29ae7-5f70-467a-b67d-87b78df1abf5: deleting {{(pid=86856) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 06 17:10:29 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f5bd2855-a4cd-484f-a262-847c80e0b7c6 tempest-GroupSnapshotsTest-1647710575 None] Acquiring lock "cinder-quobyte-d6a4fe04-3509-4295-bb95-3bf88a70ec92" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:29 devstack sudo[95423]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4714bcd6-5f91-4ba1-b0e3-80b74ac74bb9 tempest-VolumesServicesTestJSON-903287624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0723c8be-f5dd-498c-b0ea-9b24b8998001" returned: 0 in 0.274s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:29 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4714bcd6-5f91-4ba1-b0e3-80b74ac74bb9 tempest-VolumesServicesTestJSON-903287624 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:10:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4714bcd6-5f91-4ba1-b0e3-80b74ac74bb9 tempest-VolumesServicesTestJSON-903287624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3a81e070-b501-4ce0-9ee7-cebe45af66e4 tempest-VolumesActionsTest-619378497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.889s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:29 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3a81e070-b501-4ce0-9ee7-cebe45af66e4 tempest-VolumesActionsTest-619378497 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1999675925',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f9ccce9-8fdf-4ada-8edc-3e00fab4c590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db018548e4294a7d90917ec2cd21b08f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:10:28Z,use_quota=True,user_id='3c3572b432f640ab90152886669b3fc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:10:29 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-3a81e070-b501-4ce0-9ee7-cebe45af66e4 tempest-VolumesActionsTest-619378497 None] Creating volume 5f9ccce9-8fdf-4ada-8edc-3e00fab4c590 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:10:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3a81e070-b501-4ce0-9ee7-cebe45af66e4 tempest-VolumesActionsTest-619378497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3a81e070-b501-4ce0-9ee7-cebe45af66e4 tempest-VolumesActionsTest-619378497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:29 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3a81e070-b501-4ce0-9ee7-cebe45af66e4 tempest-VolumesActionsTest-619378497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:10:29 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3a81e070-b501-4ce0-9ee7-cebe45af66e4 tempest-VolumesActionsTest-619378497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:10:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3a81e070-b501-4ce0-9ee7-cebe45af66e4 tempest-VolumesActionsTest-619378497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:29 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3a81e070-b501-4ce0-9ee7-cebe45af66e4 tempest-VolumesActionsTest-619378497 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:10:29 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-3a81e070-b501-4ce0-9ee7-cebe45af66e4 tempest-VolumesActionsTest-619378497 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:10:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3a81e070-b501-4ce0-9ee7-cebe45af66e4 tempest-VolumesActionsTest-619378497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5f9ccce9-8fdf-4ada-8edc-3e00fab4c590 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4714bcd6-5f91-4ba1-b0e3-80b74ac74bb9 tempest-VolumesServicesTestJSON-903287624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dcdf7d6-2f47-44ae-929c-81e05b9723bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0723c8be-f5dd-498c-b0ea-9b24b8998001', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4714bcd6-5f91-4ba1-b0e3-80b74ac74bb9 tempest-VolumesServicesTestJSON-903287624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6133817d-c0dd-4169-821e-907a8a14ac48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:29 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f5bd2855-a4cd-484f-a262-847c80e0b7c6 tempest-GroupSnapshotsTest-1647710575 None] Lock "cinder-quobyte-d6a4fe04-3509-4295-bb95-3bf88a70ec92" acquired by "delete_snapshot" :: waited 0.062s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:29 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f5bd2855-a4cd-484f-a262-847c80e0b7c6 tempest-GroupSnapshotsTest-1647710575 None] Acquiring lock "cinder-quobyte-7397a299-0b37-4b65-a80e-66c72a7fc8ba" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:29 devstack sudo[95427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5f9ccce9-8fdf-4ada-8edc-3e00fab4c590 1073741824
Nov 06 17:10:29 devstack sudo[95427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:29 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-4714bcd6-5f91-4ba1-b0e3-80b74ac74bb9 tempest-VolumesServicesTestJSON-903287624 None] Volume volume-0723c8be-f5dd-498c-b0ea-9b24b8998001 (0723c8be-f5dd-498c-b0ea-9b24b8998001): created successfully
Nov 06 17:10:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4714bcd6-5f91-4ba1-b0e3-80b74ac74bb9 tempest-VolumesServicesTestJSON-903287624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6133817d-c0dd-4169-821e-907a8a14ac48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4714bcd6-5f91-4ba1-b0e3-80b74ac74bb9 tempest-VolumesServicesTestJSON-903287624 None] Flow 'volume_create_manager' (0f7008e6-8b51-455a-979f-7a59843b3c1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:10:29 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f5bd2855-a4cd-484f-a262-847c80e0b7c6 tempest-GroupSnapshotsTest-1647710575 None] Lock "cinder-quobyte-7397a299-0b37-4b65-a80e-66c72a7fc8ba" acquired by "_delete_snapshot" :: waited 0.057s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:29 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-f5bd2855-a4cd-484f-a262-847c80e0b7c6 tempest-GroupSnapshotsTest-1647710575 None] Deleting offline snapshot 7397a299-0b37-4b65-a80e-66c72a7fc8ba of volume d6a4fe04-3509-4295-bb95-3bf88a70ec92 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:10:29 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-f5bd2855-a4cd-484f-a262-847c80e0b7c6 tempest-GroupSnapshotsTest-1647710575 None] snapshot_file for this snap is: volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92.7397a299-0b37-4b65-a80e-66c72a7fc8ba {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:10:29 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-4714bcd6-5f91-4ba1-b0e3-80b74ac74bb9 tempest-VolumesServicesTestJSON-903287624 None] Created volume successfully.
Nov 06 17:10:29 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad89074f-1a58-4dc5-ab90-20cd35b73da0]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:10:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f5bd2855-a4cd-484f-a262-847c80e0b7c6 tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92.7397a299-0b37-4b65-a80e-66c72a7fc8ba {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:29 devstack sudo[95429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92.7397a299-0b37-4b65-a80e-66c72a7fc8ba
Nov 06 17:10:29 devstack sudo[95429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:29 devstack sudo[95427]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3a81e070-b501-4ce0-9ee7-cebe45af66e4 tempest-VolumesActionsTest-619378497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5f9ccce9-8fdf-4ada-8edc-3e00fab4c590 1073741824" returned: 0 in 0.534s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3a81e070-b501-4ce0-9ee7-cebe45af66e4 tempest-VolumesActionsTest-619378497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5f9ccce9-8fdf-4ada-8edc-3e00fab4c590 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:29 devstack sudo[95429]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f5bd2855-a4cd-484f-a262-847c80e0b7c6 tempest-GroupSnapshotsTest-1647710575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92.7397a299-0b37-4b65-a80e-66c72a7fc8ba" returned: 0 in 0.438s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:29 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-f5bd2855-a4cd-484f-a262-847c80e0b7c6 tempest-GroupSnapshotsTest-1647710575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:10:29 devstack sudo[95440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5f9ccce9-8fdf-4ada-8edc-3e00fab4c590
Nov 06 17:10:29 devstack sudo[95440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:29 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[418e62c5-ae1f-4873-b359-cf19317147ae]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:10:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f5bd2855-a4cd-484f-a262-847c80e0b7c6 tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:30 devstack sudo[95442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92
Nov 06 17:10:30 devstack sudo[95442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:30 devstack sudo[95440]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3a81e070-b501-4ce0-9ee7-cebe45af66e4 tempest-VolumesActionsTest-619378497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5f9ccce9-8fdf-4ada-8edc-3e00fab4c590" returned: 0 in 0.379s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:30 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3a81e070-b501-4ce0-9ee7-cebe45af66e4 tempest-VolumesActionsTest-619378497 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:10:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3a81e070-b501-4ce0-9ee7-cebe45af66e4 tempest-VolumesActionsTest-619378497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3a81e070-b501-4ce0-9ee7-cebe45af66e4 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f688e160-6042-47ea-ab91-32bb68dcb5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f9ccce9-8fdf-4ada-8edc-3e00fab4c590', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3a81e070-b501-4ce0-9ee7-cebe45af66e4 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aff83288-fad7-4b63-8b83-f87310c349d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:30 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bdcca1eb-375c-4973-9b36-b5f6826b80fd tempest-VolumesServicesTestJSON-903287624 None] Acquiring lock "cinder-0723c8be-f5dd-498c-b0ea-9b24b8998001-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:30 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bf613ef-6841-47ad-a653-f5289695c8a7 tempest-VolumesDeleteCascade-2117513304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:10:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4bf613ef-6841-47ad-a653-f5289695c8a7 tempest-VolumesDeleteCascade-2117513304 None] Flow 'volume_create_manager' (fb447c34-c56d-497c-a9f3-75ba3941d98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:10:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4bf613ef-6841-47ad-a653-f5289695c8a7 tempest-VolumesDeleteCascade-2117513304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da109bf5-c720-4216-a23f-7aaac6d7c674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:30 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-3a81e070-b501-4ce0-9ee7-cebe45af66e4 tempest-VolumesActionsTest-619378497 None] Volume volume-5f9ccce9-8fdf-4ada-8edc-3e00fab4c590 (5f9ccce9-8fdf-4ada-8edc-3e00fab4c590): created successfully
Nov 06 17:10:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3a81e070-b501-4ce0-9ee7-cebe45af66e4 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aff83288-fad7-4b63-8b83-f87310c349d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3a81e070-b501-4ce0-9ee7-cebe45af66e4 tempest-VolumesActionsTest-619378497 None] Flow 'volume_create_manager' (bd774278-3de0-4ca3-97fd-33889856f2ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:10:30 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bdcca1eb-375c-4973-9b36-b5f6826b80fd tempest-VolumesServicesTestJSON-903287624 None] Lock "cinder-0723c8be-f5dd-498c-b0ea-9b24b8998001-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:30 devstack sudo[95442]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4bf613ef-6841-47ad-a653-f5289695c8a7 tempest-VolumesDeleteCascade-2117513304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da109bf5-c720-4216-a23f-7aaac6d7c674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2068749920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2b4af97-8dec-4194-8a59-0cdee807d50f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8761530ba84deea7471d5abd6f96eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:10:30Z,use_quota=True,user_id='adc2b85166044b0c9b17b7ab4475beda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4bf613ef-6841-47ad-a653-f5289695c8a7 tempest-VolumesDeleteCascade-2117513304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d1838f2-f7fd-4f92-80ec-4c94a603eef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4bf613ef-6841-47ad-a653-f5289695c8a7 tempest-VolumesDeleteCascade-2117513304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d1838f2-f7fd-4f92-80ec-4c94a603eef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4bf613ef-6841-47ad-a653-f5289695c8a7 tempest-VolumesDeleteCascade-2117513304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddd2cccb-5f00-4013-9d52-c5ad15274768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4bf613ef-6841-47ad-a653-f5289695c8a7 tempest-VolumesDeleteCascade-2117513304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddd2cccb-5f00-4013-9d52-c5ad15274768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2b4af97-8dec-4194-8a59-0cdee807d50f', 'volume_name': 'volume-d2b4af97-8dec-4194-8a59-0cdee807d50f', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4bf613ef-6841-47ad-a653-f5289695c8a7 tempest-VolumesDeleteCascade-2117513304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01cc2565-7590-46f7-8dc3-2cf1cc0fed14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4bf613ef-6841-47ad-a653-f5289695c8a7 tempest-VolumesDeleteCascade-2117513304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01cc2565-7590-46f7-8dc3-2cf1cc0fed14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4bf613ef-6841-47ad-a653-f5289695c8a7 tempest-VolumesDeleteCascade-2117513304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2263f5da-b039-4ae8-97dd-a716eeb0cc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:30 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-4bf613ef-6841-47ad-a653-f5289695c8a7 tempest-VolumesDeleteCascade-2117513304 None] Volume d2b4af97-8dec-4194-8a59-0cdee807d50f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2b4af97-8dec-4194-8a59-0cdee807d50f', 'volume_size': 1}
Nov 06 17:10:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4bf613ef-6841-47ad-a653-f5289695c8a7 tempest-VolumesDeleteCascade-2117513304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4bf613ef-6841-47ad-a653-f5289695c8a7 tempest-VolumesDeleteCascade-2117513304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:30 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4bf613ef-6841-47ad-a653-f5289695c8a7 tempest-VolumesDeleteCascade-2117513304 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2068749920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2b4af97-8dec-4194-8a59-0cdee807d50f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8761530ba84deea7471d5abd6f96eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:10:30Z,use_quota=True,user_id='adc2b85166044b0c9b17b7ab4475beda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:10:30 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-4bf613ef-6841-47ad-a653-f5289695c8a7 tempest-VolumesDeleteCascade-2117513304 None] Creating volume d2b4af97-8dec-4194-8a59-0cdee807d50f {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:10:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4bf613ef-6841-47ad-a653-f5289695c8a7 tempest-VolumesDeleteCascade-2117513304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4bf613ef-6841-47ad-a653-f5289695c8a7 tempest-VolumesDeleteCascade-2117513304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:30 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4bf613ef-6841-47ad-a653-f5289695c8a7 tempest-VolumesDeleteCascade-2117513304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:10:30 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4bf613ef-6841-47ad-a653-f5289695c8a7 tempest-VolumesDeleteCascade-2117513304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:10:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4bf613ef-6841-47ad-a653-f5289695c8a7 tempest-VolumesDeleteCascade-2117513304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:30 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4bf613ef-6841-47ad-a653-f5289695c8a7 tempest-VolumesDeleteCascade-2117513304 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:10:30 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-4bf613ef-6841-47ad-a653-f5289695c8a7 tempest-VolumesDeleteCascade-2117513304 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:10:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4bf613ef-6841-47ad-a653-f5289695c8a7 tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f5bd2855-a4cd-484f-a262-847c80e0b7c6 tempest-GroupSnapshotsTest-1647710575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92" returned: 0 in 0.622s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:30 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-3a81e070-b501-4ce0-9ee7-cebe45af66e4 tempest-VolumesActionsTest-619378497 None] Created volume successfully.
Nov 06 17:10:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f5bd2855-a4cd-484f-a262-847c80e0b7c6 tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92.7397a299-0b37-4b65-a80e-66c72a7fc8ba {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:30 devstack sudo[95449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f 1073741824
Nov 06 17:10:30 devstack sudo[95449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:30 devstack sudo[95450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92.7397a299-0b37-4b65-a80e-66c72a7fc8ba
Nov 06 17:10:30 devstack sudo[95450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:30 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bdcca1eb-375c-4973-9b36-b5f6826b80fd tempest-VolumesServicesTestJSON-903287624 None] Acquiring lock "cinder-quobyte-0723c8be-f5dd-498c-b0ea-9b24b8998001" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:30 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bdcca1eb-375c-4973-9b36-b5f6826b80fd tempest-VolumesServicesTestJSON-903287624 None] Lock "cinder-quobyte-0723c8be-f5dd-498c-b0ea-9b24b8998001" acquired by "delete_volume" :: waited 0.022s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:30 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[25562bf1-f9e7-4b81-891b-67511b984a23]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:10:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bdcca1eb-375c-4973-9b36-b5f6826b80fd tempest-VolumesServicesTestJSON-903287624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0723c8be-f5dd-498c-b0ea-9b24b8998001 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:30 devstack sudo[95453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0723c8be-f5dd-498c-b0ea-9b24b8998001
Nov 06 17:10:30 devstack sudo[95453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:30 devstack sudo[95450]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f5bd2855-a4cd-484f-a262-847c80e0b7c6 tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92.7397a299-0b37-4b65-a80e-66c72a7fc8ba" returned: 0 in 0.385s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f5bd2855-a4cd-484f-a262-847c80e0b7c6 tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92.7397a299-0b37-4b65-a80e-66c72a7fc8ba {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:31 devstack sudo[95463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92.7397a299-0b37-4b65-a80e-66c72a7fc8ba
Nov 06 17:10:31 devstack sudo[95463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:31 devstack sudo[95449]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4bf613ef-6841-47ad-a653-f5289695c8a7 tempest-VolumesDeleteCascade-2117513304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f 1073741824" returned: 0 in 0.471s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4bf613ef-6841-47ad-a653-f5289695c8a7 tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:31 devstack sudo[95453]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bdcca1eb-375c-4973-9b36-b5f6826b80fd tempest-VolumesServicesTestJSON-903287624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0723c8be-f5dd-498c-b0ea-9b24b8998001" returned: 0 in 0.388s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bdcca1eb-375c-4973-9b36-b5f6826b80fd tempest-VolumesServicesTestJSON-903287624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0723c8be-f5dd-498c-b0ea-9b24b8998001 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:31 devstack sudo[95469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f
Nov 06 17:10:31 devstack sudo[95469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:31 devstack sudo[95470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0723c8be-f5dd-498c-b0ea-9b24b8998001
Nov 06 17:10:31 devstack sudo[95470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:31 devstack sudo[95463]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f5bd2855-a4cd-484f-a262-847c80e0b7c6 tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92.7397a299-0b37-4b65-a80e-66c72a7fc8ba" returned: 0 in 0.271s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:31 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f5bd2855-a4cd-484f-a262-847c80e0b7c6 tempest-GroupSnapshotsTest-1647710575 None] Lock "cinder-quobyte-7397a299-0b37-4b65-a80e-66c72a7fc8ba" released by "_delete_snapshot" :: held 1.877s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:31 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f5bd2855-a4cd-484f-a262-847c80e0b7c6 tempest-GroupSnapshotsTest-1647710575 None] Lock "cinder-quobyte-d6a4fe04-3509-4295-bb95-3bf88a70ec92" released by "delete_snapshot" :: held 1.947s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:31 devstack cinder-volume[86856]: WARNING cinder.quota [None req-f5bd2855-a4cd-484f-a262-847c80e0b7c6 tempest-GroupSnapshotsTest-1647710575 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-22009983 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-22009983, it is now deprecated. Please use the default quota class for default quota.
Nov 06 17:10:31 devstack cinder-volume[86856]: WARNING cinder.quota [None req-f5bd2855-a4cd-484f-a262-847c80e0b7c6 tempest-GroupSnapshotsTest-1647710575 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-22009983 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-22009983, it is now deprecated. Please use the default quota class for default quota.
Nov 06 17:10:31 devstack sudo[95469]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:31 devstack sudo[95470]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4bf613ef-6841-47ad-a653-f5289695c8a7 tempest-VolumesDeleteCascade-2117513304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f" returned: 0 in 0.301s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:31 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4bf613ef-6841-47ad-a653-f5289695c8a7 tempest-VolumesDeleteCascade-2117513304 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:10:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4bf613ef-6841-47ad-a653-f5289695c8a7 tempest-VolumesDeleteCascade-2117513304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bdcca1eb-375c-4973-9b36-b5f6826b80fd tempest-VolumesServicesTestJSON-903287624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0723c8be-f5dd-498c-b0ea-9b24b8998001" returned: 0 in 0.289s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4bf613ef-6841-47ad-a653-f5289695c8a7 tempest-VolumesDeleteCascade-2117513304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2263f5da-b039-4ae8-97dd-a716eeb0cc48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2b4af97-8dec-4194-8a59-0cdee807d50f', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4bf613ef-6841-47ad-a653-f5289695c8a7 tempest-VolumesDeleteCascade-2117513304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e78f3a0b-5d9e-4cdc-a815-3667a1ab432b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:31 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bdcca1eb-375c-4973-9b36-b5f6826b80fd tempest-VolumesServicesTestJSON-903287624 None] Lock "cinder-quobyte-0723c8be-f5dd-498c-b0ea-9b24b8998001" released by "delete_volume" :: held 0.745s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:31 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-f5bd2855-a4cd-484f-a262-847c80e0b7c6 tempest-GroupSnapshotsTest-1647710575 None] Created reservations ['4887fb2d-42b3-4b09-9088-dd66f69fb104', '45d3aae8-d31a-47e3-bf68-74409af4a97a', '3dbbdd4d-c703-491b-b13f-552de1181ae0', 'ae832730-6d1f-4f6b-b57c-e582ffbef2c1'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:10:31 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-4bf613ef-6841-47ad-a653-f5289695c8a7 tempest-VolumesDeleteCascade-2117513304 None] Volume volume-d2b4af97-8dec-4194-8a59-0cdee807d50f (d2b4af97-8dec-4194-8a59-0cdee807d50f): created successfully
Nov 06 17:10:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4bf613ef-6841-47ad-a653-f5289695c8a7 tempest-VolumesDeleteCascade-2117513304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e78f3a0b-5d9e-4cdc-a815-3667a1ab432b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4bf613ef-6841-47ad-a653-f5289695c8a7 tempest-VolumesDeleteCascade-2117513304 None] Flow 'volume_create_manager' (fb447c34-c56d-497c-a9f3-75ba3941d98c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:10:31 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-4bf613ef-6841-47ad-a653-f5289695c8a7 tempest-VolumesDeleteCascade-2117513304 None] Created volume successfully.
Nov 06 17:10:31 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-bdcca1eb-375c-4973-9b36-b5f6826b80fd tempest-VolumesServicesTestJSON-903287624 None] Created reservations ['f058303f-935f-4738-9cee-0aa520ac043a', '14112cd1-3c0f-447c-b266-79b17ef6f449', '2db19373-d146-48e4-a71b-a98313826597', '660e478d-361a-4a97-9410-18d17a76ef23'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:10:31 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-f5bd2855-a4cd-484f-a262-847c80e0b7c6 tempest-GroupSnapshotsTest-1647710575 None] group_snapshot 26d29ae7-5f70-467a-b67d-87b78df1abf5: deleted successfully
Nov 06 17:10:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bdcca1eb-375c-4973-9b36-b5f6826b80fd tempest-VolumesServicesTestJSON-903287624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bdcca1eb-375c-4973-9b36-b5f6826b80fd tempest-VolumesServicesTestJSON-903287624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:31 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bdcca1eb-375c-4973-9b36-b5f6826b80fd tempest-VolumesServicesTestJSON-903287624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:10:31 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bdcca1eb-375c-4973-9b36-b5f6826b80fd tempest-VolumesServicesTestJSON-903287624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:10:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bdcca1eb-375c-4973-9b36-b5f6826b80fd tempest-VolumesServicesTestJSON-903287624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bdcca1eb-375c-4973-9b36-b5f6826b80fd tempest-VolumesServicesTestJSON-903287624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:31 devstack sudo[95476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:10:31 devstack sudo[95476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:31 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-2ee22434-c432-4461-bf01-be3174644b9b tempest-VolumesActionsTest-912802788 None] Acquiring lock "cinder-5f9ccce9-8fdf-4ada-8edc-3e00fab4c590-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:31 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-2ee22434-c432-4461-bf01-be3174644b9b tempest-VolumesActionsTest-912802788 None] Lock "cinder-5f9ccce9-8fdf-4ada-8edc-3e00fab4c590-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:31 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-2ee22434-c432-4461-bf01-be3174644b9b tempest-VolumesActionsTest-912802788 None] Acquiring lock "cinder-quobyte-5f9ccce9-8fdf-4ada-8edc-3e00fab4c590" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:31 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-2ee22434-c432-4461-bf01-be3174644b9b tempest-VolumesActionsTest-912802788 None] Lock "cinder-quobyte-5f9ccce9-8fdf-4ada-8edc-3e00fab4c590" acquired by "delete_volume" :: waited 0.017s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:31 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3bfd92-1791-4f15-8aa6-ac1104cf0b62]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:10:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2ee22434-c432-4461-bf01-be3174644b9b tempest-VolumesActionsTest-912802788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5f9ccce9-8fdf-4ada-8edc-3e00fab4c590 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:31 devstack sudo[95478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5f9ccce9-8fdf-4ada-8edc-3e00fab4c590
Nov 06 17:10:31 devstack sudo[95478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:31 devstack sudo[95476]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bdcca1eb-375c-4973-9b36-b5f6826b80fd tempest-VolumesServicesTestJSON-903287624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.303s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:31 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-bdcca1eb-375c-4973-9b36-b5f6826b80fd tempest-VolumesServicesTestJSON-903287624 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:10:31 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-bdcca1eb-375c-4973-9b36-b5f6826b80fd tempest-VolumesServicesTestJSON-903287624 None] Deleted volume successfully.
Nov 06 17:10:31 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bdcca1eb-375c-4973-9b36-b5f6826b80fd tempest-VolumesServicesTestJSON-903287624 None] Lock "cinder-0723c8be-f5dd-498c-b0ea-9b24b8998001-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:32 devstack sudo[95478]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2ee22434-c432-4461-bf01-be3174644b9b tempest-VolumesActionsTest-912802788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5f9ccce9-8fdf-4ada-8edc-3e00fab4c590" returned: 0 in 0.375s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2ee22434-c432-4461-bf01-be3174644b9b tempest-VolumesActionsTest-912802788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5f9ccce9-8fdf-4ada-8edc-3e00fab4c590 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:32 devstack sudo[95484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5f9ccce9-8fdf-4ada-8edc-3e00fab4c590
Nov 06 17:10:32 devstack sudo[95484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:32 devstack sudo[95484]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2ee22434-c432-4461-bf01-be3174644b9b tempest-VolumesActionsTest-912802788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5f9ccce9-8fdf-4ada-8edc-3e00fab4c590" returned: 0 in 0.249s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:32 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-2ee22434-c432-4461-bf01-be3174644b9b tempest-VolumesActionsTest-912802788 None] Lock "cinder-quobyte-5f9ccce9-8fdf-4ada-8edc-3e00fab4c590" released by "delete_volume" :: held 0.678s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:32 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-2ee22434-c432-4461-bf01-be3174644b9b tempest-VolumesActionsTest-912802788 None] Created reservations ['8062815b-851c-4d52-af62-cb0e6cd935a6', '528a0f91-5f3e-48b9-80c3-61debe01dc86', 'd27e64f6-03b6-4970-bee2-bd235d963318', 'b9602ec5-890c-4da4-b7b5-5b03bdc0dbff'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:10:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d5ba0c39-bfa9-4795-a879-d340cd532348 tempest-VolumesDeleteCascade-2117513304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d5ba0c39-bfa9-4795-a879-d340cd532348 tempest-VolumesDeleteCascade-2117513304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:32 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-d5ba0c39-bfa9-4795-a879-d340cd532348 tempest-VolumesDeleteCascade-2117513304 None] Creating offline snapshot 984a3889-e73e-4375-ad39-f2dd2abc139f of volume d2b4af97-8dec-4194-8a59-0cdee807d50f {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:10:32 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e81744e-bf61-4c99-85ae-e482eada2166]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:10:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d5ba0c39-bfa9-4795-a879-d340cd532348 tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2ee22434-c432-4461-bf01-be3174644b9b tempest-VolumesActionsTest-912802788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2ee22434-c432-4461-bf01-be3174644b9b tempest-VolumesActionsTest-912802788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:32 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-2ee22434-c432-4461-bf01-be3174644b9b tempest-VolumesActionsTest-912802788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:10:32 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-2ee22434-c432-4461-bf01-be3174644b9b tempest-VolumesActionsTest-912802788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:10:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2ee22434-c432-4461-bf01-be3174644b9b tempest-VolumesActionsTest-912802788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2ee22434-c432-4461-bf01-be3174644b9b tempest-VolumesActionsTest-912802788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:32 devstack sudo[95488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:10:32 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:32 devstack sudo[95487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f
Nov 06 17:10:32 devstack sudo[95487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:32 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2ee22434-c432-4461-bf01-be3174644b9b tempest-VolumesActionsTest-912802788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.319s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:32 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-2ee22434-c432-4461-bf01-be3174644b9b tempest-VolumesActionsTest-912802788 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:10:32 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-2ee22434-c432-4461-bf01-be3174644b9b tempest-VolumesActionsTest-912802788 None] Deleted volume successfully.
Nov 06 17:10:32 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-2ee22434-c432-4461-bf01-be3174644b9b tempest-VolumesActionsTest-912802788 None] Lock "cinder-5f9ccce9-8fdf-4ada-8edc-3e00fab4c590-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:33 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9df28881-9eaf-4cc3-9b06-6fb0c25c6aea tempest-GroupSnapshotsTest-1647710575 None] Acquiring lock "cinder-quobyte-d6a4fe04-3509-4295-bb95-3bf88a70ec92" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:33 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9df28881-9eaf-4cc3-9b06-6fb0c25c6aea tempest-GroupSnapshotsTest-1647710575 None] Lock "cinder-quobyte-d6a4fe04-3509-4295-bb95-3bf88a70ec92" acquired by "delete_volume" :: waited 0.025s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:33 devstack sudo[95487]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d5ba0c39-bfa9-4795-a879-d340cd532348 tempest-VolumesDeleteCascade-2117513304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f" returned: 0 in 0.570s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d5ba0c39-bfa9-4795-a879-d340cd532348 tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f.984a3889-e73e-4375-ad39-f2dd2abc139f 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:33 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a54e33-efb5-479d-9e7d-c974c8f3f5a9]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:10:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9df28881-9eaf-4cc3-9b06-6fb0c25c6aea tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:33 devstack sudo[95495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f.984a3889-e73e-4375-ad39-f2dd2abc139f 1G
Nov 06 17:10:33 devstack sudo[95495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:33 devstack sudo[95496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92
Nov 06 17:10:33 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:33 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-5204c608-2e19-4d85-9e95-baa27cefb244 tempest-VolumesActionsTest-619378497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:10:33 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5204c608-2e19-4d85-9e95-baa27cefb244 tempest-VolumesActionsTest-619378497 None] Flow 'volume_create_manager' (7cea139f-b831-4c62-8327-4f381512e818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:10:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5204c608-2e19-4d85-9e95-baa27cefb244 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f3bab12-2aea-4325-a221-83f645fa7180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9df28881-9eaf-4cc3-9b06-6fb0c25c6aea tempest-GroupSnapshotsTest-1647710575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92" returned: 0 in 0.517s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9df28881-9eaf-4cc3-9b06-6fb0c25c6aea tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:33 devstack sudo[95506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92
Nov 06 17:10:33 devstack sudo[95506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5204c608-2e19-4d85-9e95-baa27cefb244 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f3bab12-2aea-4325-a221-83f645fa7180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-555422838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f65992-7645-46cb-aefe-286912b73712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db018548e4294a7d90917ec2cd21b08f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:10:34Z,use_quota=True,user_id='3c3572b432f640ab90152886669b3fc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5204c608-2e19-4d85-9e95-baa27cefb244 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58c4afb9-7f49-4a15-a85f-78335a9d5472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5204c608-2e19-4d85-9e95-baa27cefb244 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58c4afb9-7f49-4a15-a85f-78335a9d5472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:33 devstack sudo[95495]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5204c608-2e19-4d85-9e95-baa27cefb244 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30b59e11-a5da-4d29-a9d3-6c2297a7e07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5204c608-2e19-4d85-9e95-baa27cefb244 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30b59e11-a5da-4d29-a9d3-6c2297a7e07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61f65992-7645-46cb-aefe-286912b73712', 'volume_name': 'volume-61f65992-7645-46cb-aefe-286912b73712', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5204c608-2e19-4d85-9e95-baa27cefb244 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e1a79a8-b11a-4df1-a661-5d2a501ac83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5204c608-2e19-4d85-9e95-baa27cefb244 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e1a79a8-b11a-4df1-a661-5d2a501ac83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5204c608-2e19-4d85-9e95-baa27cefb244 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa56d0d6-083b-46a6-88d5-148c122415ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:33 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-5204c608-2e19-4d85-9e95-baa27cefb244 tempest-VolumesActionsTest-619378497 None] Volume 61f65992-7645-46cb-aefe-286912b73712: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61f65992-7645-46cb-aefe-286912b73712', 'volume_size': 1}
Nov 06 17:10:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5204c608-2e19-4d85-9e95-baa27cefb244 tempest-VolumesActionsTest-619378497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d5ba0c39-bfa9-4795-a879-d340cd532348 tempest-VolumesDeleteCascade-2117513304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f.984a3889-e73e-4375-ad39-f2dd2abc139f 1G" returned: 0 in 0.615s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d5ba0c39-bfa9-4795-a879-d340cd532348 tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2b4af97-8dec-4194-8a59-0cdee807d50f -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f.984a3889-e73e-4375-ad39-f2dd2abc139f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:33 devstack sudo[95508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2b4af97-8dec-4194-8a59-0cdee807d50f -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f.984a3889-e73e-4375-ad39-f2dd2abc139f
Nov 06 17:10:33 devstack sudo[95508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:33 devstack sudo[95506]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9df28881-9eaf-4cc3-9b06-6fb0c25c6aea tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d6a4fe04-3509-4295-bb95-3bf88a70ec92" returned: 0 in 0.272s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:33 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9df28881-9eaf-4cc3-9b06-6fb0c25c6aea tempest-GroupSnapshotsTest-1647710575 None] Lock "cinder-quobyte-d6a4fe04-3509-4295-bb95-3bf88a70ec92" released by "delete_volume" :: held 0.892s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:34 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-9df28881-9eaf-4cc3-9b06-6fb0c25c6aea tempest-GroupSnapshotsTest-1647710575 None] Created reservations ['1638b220-855e-40e2-8b8d-9eaa04449a79'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:10:34 devstack sudo[95508]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:34 devstack cinder-volume[86856]: WARNING cinder.quota [None req-9df28881-9eaf-4cc3-9b06-6fb0c25c6aea tempest-GroupSnapshotsTest-1647710575 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-22009983 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-22009983, it is now deprecated. Please use the default quota class for default quota.
Nov 06 17:10:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d5ba0c39-bfa9-4795-a879-d340cd532348 tempest-VolumesDeleteCascade-2117513304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2b4af97-8dec-4194-8a59-0cdee807d50f -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f.984a3889-e73e-4375-ad39-f2dd2abc139f" returned: 0 in 0.327s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:34 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-d5ba0c39-bfa9-4795-a879-d340cd532348 tempest-VolumesDeleteCascade-2117513304 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f.984a3889-e73e-4375-ad39-f2dd2abc139f is being set with open permissions: ugo+rw
Nov 06 17:10:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d5ba0c39-bfa9-4795-a879-d340cd532348 tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f.984a3889-e73e-4375-ad39-f2dd2abc139f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:34 devstack sudo[95514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f.984a3889-e73e-4375-ad39-f2dd2abc139f
Nov 06 17:10:34 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:34 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-9df28881-9eaf-4cc3-9b06-6fb0c25c6aea tempest-GroupSnapshotsTest-1647710575 None] Created reservations ['1a0ae8a8-3e9c-4c49-a1d3-736cdea45441', 'e6fd4836-d699-4d21-8f29-08ab7bd1d9e7', '8e435050-90bc-4276-8cc8-f671f37298db', '853a580c-998a-47c0-bb3b-b00b33034306'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:10:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9df28881-9eaf-4cc3-9b06-6fb0c25c6aea tempest-GroupSnapshotsTest-1647710575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9df28881-9eaf-4cc3-9b06-6fb0c25c6aea tempest-GroupSnapshotsTest-1647710575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-9df28881-9eaf-4cc3-9b06-6fb0c25c6aea tempest-GroupSnapshotsTest-1647710575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:10:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-9df28881-9eaf-4cc3-9b06-6fb0c25c6aea tempest-GroupSnapshotsTest-1647710575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:10:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9df28881-9eaf-4cc3-9b06-6fb0c25c6aea tempest-GroupSnapshotsTest-1647710575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9df28881-9eaf-4cc3-9b06-6fb0c25c6aea tempest-GroupSnapshotsTest-1647710575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:34 devstack sudo[95516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:10:34 devstack sudo[95516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:34 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d5ba0c39-bfa9-4795-a879-d340cd532348 tempest-VolumesDeleteCascade-2117513304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f.984a3889-e73e-4375-ad39-f2dd2abc139f" returned: 0 in 0.335s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d5ba0c39-bfa9-4795-a879-d340cd532348 tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:34 devstack sudo[95519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f.info
Nov 06 17:10:34 devstack sudo[95519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:34 devstack sudo[95516]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9df28881-9eaf-4cc3-9b06-6fb0c25c6aea tempest-GroupSnapshotsTest-1647710575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.386s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:34 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-9df28881-9eaf-4cc3-9b06-6fb0c25c6aea tempest-GroupSnapshotsTest-1647710575 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:10:34 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-9df28881-9eaf-4cc3-9b06-6fb0c25c6aea tempest-GroupSnapshotsTest-1647710575 None] Delete group completed successfully.
Nov 06 17:10:34 devstack sudo[95519]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d5ba0c39-bfa9-4795-a879-d340cd532348 tempest-VolumesDeleteCascade-2117513304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f.info" returned: 0 in 0.351s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:34 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-d5ba0c39-bfa9-4795-a879-d340cd532348 tempest-VolumesDeleteCascade-2117513304 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f.info is being set with open permissions: ugo+rw
Nov 06 17:10:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d5ba0c39-bfa9-4795-a879-d340cd532348 tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:34 devstack sudo[95523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f.info
Nov 06 17:10:34 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:35 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d5ba0c39-bfa9-4795-a879-d340cd532348 tempest-VolumesDeleteCascade-2117513304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f.info" returned: 0 in 0.270s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d5ba0c39-bfa9-4795-a879-d340cd532348 tempest-VolumesDeleteCascade-2117513304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.621s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5204c608-2e19-4d85-9e95-baa27cefb244 tempest-VolumesActionsTest-619378497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.378s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5204c608-2e19-4d85-9e95-baa27cefb244 tempest-VolumesActionsTest-619378497 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-555422838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f65992-7645-46cb-aefe-286912b73712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db018548e4294a7d90917ec2cd21b08f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:10:34Z,use_quota=True,user_id='3c3572b432f640ab90152886669b3fc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:10:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-5204c608-2e19-4d85-9e95-baa27cefb244 tempest-VolumesActionsTest-619378497 None] Creating volume 61f65992-7645-46cb-aefe-286912b73712 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:10:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5204c608-2e19-4d85-9e95-baa27cefb244 tempest-VolumesActionsTest-619378497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5204c608-2e19-4d85-9e95-baa27cefb244 tempest-VolumesActionsTest-619378497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5204c608-2e19-4d85-9e95-baa27cefb244 tempest-VolumesActionsTest-619378497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:10:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5204c608-2e19-4d85-9e95-baa27cefb244 tempest-VolumesActionsTest-619378497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:10:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5204c608-2e19-4d85-9e95-baa27cefb244 tempest-VolumesActionsTest-619378497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5204c608-2e19-4d85-9e95-baa27cefb244 tempest-VolumesActionsTest-619378497 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:10:35 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-5204c608-2e19-4d85-9e95-baa27cefb244 tempest-VolumesActionsTest-619378497 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:10:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5204c608-2e19-4d85-9e95-baa27cefb244 tempest-VolumesActionsTest-619378497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-61f65992-7645-46cb-aefe-286912b73712 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:35 devstack sudo[95526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-61f65992-7645-46cb-aefe-286912b73712 1073741824
Nov 06 17:10:35 devstack sudo[95526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:35 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-d5ba0c39-bfa9-4795-a879-d340cd532348 tempest-VolumesDeleteCascade-2117513304 None] Create snapshot completed successfully
Nov 06 17:10:35 devstack sudo[95526]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5204c608-2e19-4d85-9e95-baa27cefb244 tempest-VolumesActionsTest-619378497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-61f65992-7645-46cb-aefe-286912b73712 1073741824" returned: 0 in 0.587s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5204c608-2e19-4d85-9e95-baa27cefb244 tempest-VolumesActionsTest-619378497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-61f65992-7645-46cb-aefe-286912b73712 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:35 devstack sudo[95532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-61f65992-7645-46cb-aefe-286912b73712
Nov 06 17:10:35 devstack sudo[95532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:36 devstack sudo[95532]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5204c608-2e19-4d85-9e95-baa27cefb244 tempest-VolumesActionsTest-619378497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-61f65992-7645-46cb-aefe-286912b73712" returned: 0 in 0.348s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:36 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5204c608-2e19-4d85-9e95-baa27cefb244 tempest-VolumesActionsTest-619378497 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:10:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5204c608-2e19-4d85-9e95-baa27cefb244 tempest-VolumesActionsTest-619378497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:36 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5204c608-2e19-4d85-9e95-baa27cefb244 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa56d0d6-083b-46a6-88d5-148c122415ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61f65992-7645-46cb-aefe-286912b73712', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:36 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5204c608-2e19-4d85-9e95-baa27cefb244 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45b0c127-8a11-4963-8ce1-095005874b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:36 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-5204c608-2e19-4d85-9e95-baa27cefb244 tempest-VolumesActionsTest-619378497 None] Volume volume-61f65992-7645-46cb-aefe-286912b73712 (61f65992-7645-46cb-aefe-286912b73712): created successfully
Nov 06 17:10:36 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5204c608-2e19-4d85-9e95-baa27cefb244 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45b0c127-8a11-4963-8ce1-095005874b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:36 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5204c608-2e19-4d85-9e95-baa27cefb244 tempest-VolumesActionsTest-619378497 None] Flow 'volume_create_manager' (7cea139f-b831-4c62-8327-4f381512e818) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:10:36 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-5204c608-2e19-4d85-9e95-baa27cefb244 tempest-VolumesActionsTest-619378497 None] Created volume successfully.
Nov 06 17:10:36 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:10:36 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Flow 'volume_create_manager' (b68245e6-3ce1-4786-8fb4-311fa8b938c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:10:36 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59da5f7e-2344-4649-b6a5-e2855324b338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:36 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59da5f7e-2344-4649-b6a5-e2855324b338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1435393426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d1574f8-ec2e-4291-9856-b68cd14660ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8761530ba84deea7471d5abd6f96eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=984a3889-e73e-4375-ad39-f2dd2abc139f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:10:36Z,use_quota=True,user_id='adc2b85166044b0c9b17b7ab4475beda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:36 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64154c92-3808-4370-a0c2-455e6d2986b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:36 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64154c92-3808-4370-a0c2-455e6d2986b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:36 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f71c29-214c-4900-95be-22bacf5bcf65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:36 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f71c29-214c-4900-95be-22bacf5bcf65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0d1574f8-ec2e-4291-9856-b68cd14660ef', 'volume_name': 'volume-0d1574f8-ec2e-4291-9856-b68cd14660ef', 'volume_size': 1, 'snapshot_id': '984a3889-e73e-4375-ad39-f2dd2abc139f'}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:36 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ca622d7-67fb-47d9-b431-db0d94a2246f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:36 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ca622d7-67fb-47d9-b431-db0d94a2246f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:36 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86fe0b20-f296-4c58-a184-31324f9cf42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:36 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Volume 0d1574f8-ec2e-4291-9856-b68cd14660ef: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0d1574f8-ec2e-4291-9856-b68cd14660ef', 'volume_size': 1, 'snapshot_id': '984a3889-e73e-4375-ad39-f2dd2abc139f'}
Nov 06 17:10:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:36 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Acquiring lock "cinder-quobyte-984a3889-e73e-4375-ad39-f2dd2abc139f-0d1574f8-ec2e-4291-9856-b68cd14660ef" by "_create_volume_from_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:36 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Lock "cinder-quobyte-984a3889-e73e-4375-ad39-f2dd2abc139f-0d1574f8-ec2e-4291-9856-b68cd14660ef" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:36 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Creating volume 0d1574f8-ec2e-4291-9856-b68cd14660ef from snapshot 984a3889-e73e-4375-ad39-f2dd2abc139f {{(pid=86856) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 06 17:10:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:36 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:10:36 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:10:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:36 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:10:36 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Acquiring lock "cinder-quobyte-0d1574f8-ec2e-4291-9856-b68cd14660ef" by "_copy_volume_from_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:36 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Lock "cinder-quobyte-0d1574f8-ec2e-4291-9856-b68cd14660ef" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:36 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] snapshot: 984a3889-e73e-4375-ad39-f2dd2abc139f, volume: 0d1574f8-ec2e-4291-9856-b68cd14660ef,  {{(pid=86856) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 06 17:10:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:36 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:10:36 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:10:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:36 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec04e60-04b2-4ba2-a730-d7442a4bee17]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:10:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f.984a3889-e73e-4375-ad39-f2dd2abc139f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:36 devstack sudo[95535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f.984a3889-e73e-4375-ad39-f2dd2abc139f
Nov 06 17:10:36 devstack sudo[95535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-31b67bd5-0667-46a6-831d-9ea2c6f373f5 tempest-VolumesActionsTest-912802788 None] Acquiring lock "cinder-61f65992-7645-46cb-aefe-286912b73712-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-31b67bd5-0667-46a6-831d-9ea2c6f373f5 tempest-VolumesActionsTest-912802788 None] Lock "cinder-61f65992-7645-46cb-aefe-286912b73712-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:37 devstack sudo[95535]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f.984a3889-e73e-4375-ad39-f2dd2abc139f" returned: 0 in 0.553s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:37 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2b4af97-8dec-4194-8a59-0cdee807d50f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:10:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-31b67bd5-0667-46a6-831d-9ea2c6f373f5 tempest-VolumesActionsTest-912802788 None] Acquiring lock "cinder-quobyte-61f65992-7645-46cb-aefe-286912b73712" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:37 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[928a5592-f933-4f9c-b233-fcd705bd803b]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:10:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-31b67bd5-0667-46a6-831d-9ea2c6f373f5 tempest-VolumesActionsTest-912802788 None] Lock "cinder-quobyte-61f65992-7645-46cb-aefe-286912b73712" acquired by "delete_volume" :: waited 0.040s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:37 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[890af213-cfce-4fe9-bd75-ad2b1584b179]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:10:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-31b67bd5-0667-46a6-831d-9ea2c6f373f5 tempest-VolumesActionsTest-912802788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-61f65992-7645-46cb-aefe-286912b73712 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:37 devstack sudo[95542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f
Nov 06 17:10:37 devstack sudo[95542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:37 devstack sudo[95543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-61f65992-7645-46cb-aefe-286912b73712
Nov 06 17:10:37 devstack sudo[95543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:37 devstack sudo[95542]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f" returned: 0 in 0.553s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:37 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f {{(pid=86856) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 06 17:10:37 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Creating direct copy from snapshot {{(pid=86856) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 06 17:10:37 devstack cinder-volume[86856]: DEBUG cinder.utils [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Path /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0d1574f8-ec2e-4291-9856-b68cd14660ef not found in is_blk_device check {{(pid=86856) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 06 17:10:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0d1574f8-ec2e-4291-9856-b68cd14660ef {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:37 devstack sudo[95552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0d1574f8-ec2e-4291-9856-b68cd14660ef
Nov 06 17:10:37 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:37 devstack sudo[95543]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-31b67bd5-0667-46a6-831d-9ea2c6f373f5 tempest-VolumesActionsTest-912802788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-61f65992-7645-46cb-aefe-286912b73712" returned: 0 in 0.526s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-31b67bd5-0667-46a6-831d-9ea2c6f373f5 tempest-VolumesActionsTest-912802788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-61f65992-7645-46cb-aefe-286912b73712 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:37 devstack sudo[95554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-61f65992-7645-46cb-aefe-286912b73712
Nov 06 17:10:37 devstack sudo[95554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:38 devstack sudo[95554]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-31b67bd5-0667-46a6-831d-9ea2c6f373f5 tempest-VolumesActionsTest-912802788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-61f65992-7645-46cb-aefe-286912b73712" returned: 0 in 0.325s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:38 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-31b67bd5-0667-46a6-831d-9ea2c6f373f5 tempest-VolumesActionsTest-912802788 None] Lock "cinder-quobyte-61f65992-7645-46cb-aefe-286912b73712" released by "delete_volume" :: held 0.939s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:38 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-31b67bd5-0667-46a6-831d-9ea2c6f373f5 tempest-VolumesActionsTest-912802788 None] Created reservations ['5930f32a-0f76-4130-bf39-01ab81967f21', '718507dc-c665-4656-87b1-32c5bcba9475', '09c762e6-e879-4e75-b220-48ab469636e5', 'fb8bbdfb-b315-4285-95d8-78c62f0782fb'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:10:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-31b67bd5-0667-46a6-831d-9ea2c6f373f5 tempest-VolumesActionsTest-912802788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-31b67bd5-0667-46a6-831d-9ea2c6f373f5 tempest-VolumesActionsTest-912802788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:38 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-31b67bd5-0667-46a6-831d-9ea2c6f373f5 tempest-VolumesActionsTest-912802788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:10:38 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-31b67bd5-0667-46a6-831d-9ea2c6f373f5 tempest-VolumesActionsTest-912802788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:10:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-31b67bd5-0667-46a6-831d-9ea2c6f373f5 tempest-VolumesActionsTest-912802788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-31b67bd5-0667-46a6-831d-9ea2c6f373f5 tempest-VolumesActionsTest-912802788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:38 devstack sudo[95561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:10:38 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:38 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-31b67bd5-0667-46a6-831d-9ea2c6f373f5 tempest-VolumesActionsTest-912802788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.347s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:38 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-31b67bd5-0667-46a6-831d-9ea2c6f373f5 tempest-VolumesActionsTest-912802788 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:10:38 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-31b67bd5-0667-46a6-831d-9ea2c6f373f5 tempest-VolumesActionsTest-912802788 None] Deleted volume successfully.
Nov 06 17:10:38 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-31b67bd5-0667-46a6-831d-9ea2c6f373f5 tempest-VolumesActionsTest-912802788 None] Lock "cinder-61f65992-7645-46cb-aefe-286912b73712-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:40 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-734df61f-fb8d-407a-9b43-50dcf61de5a5 tempest-VolumesActionsTest-619378497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:10:40 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-734df61f-fb8d-407a-9b43-50dcf61de5a5 tempest-VolumesActionsTest-619378497 None] Flow 'volume_create_manager' (97f5fd58-cc04-43d1-b9c9-e1c6bc7a5fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:10:40 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-734df61f-fb8d-407a-9b43-50dcf61de5a5 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a06fbc99-b810-4c9b-a172-b6771800c2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:40 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=214,cinder:UPDATE=235,cinder:INSERT=61,cinder:DELETE=13 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:10:40 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-734df61f-fb8d-407a-9b43-50dcf61de5a5 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a06fbc99-b810-4c9b-a172-b6771800c2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1244936539',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ac2e822-636d-43c2-ad31-3eb950e361c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db018548e4294a7d90917ec2cd21b08f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:10:40Z,use_quota=True,user_id='3c3572b432f640ab90152886669b3fc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:40 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-734df61f-fb8d-407a-9b43-50dcf61de5a5 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d3c3f7b-6ec8-4818-98ce-b0439659b19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:40 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-734df61f-fb8d-407a-9b43-50dcf61de5a5 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d3c3f7b-6ec8-4818-98ce-b0439659b19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:40 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-734df61f-fb8d-407a-9b43-50dcf61de5a5 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9a411f3-b577-40b9-a512-a82e14d17c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:40 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-734df61f-fb8d-407a-9b43-50dcf61de5a5 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9a411f3-b577-40b9-a512-a82e14d17c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ac2e822-636d-43c2-ad31-3eb950e361c7', 'volume_name': 'volume-0ac2e822-636d-43c2-ad31-3eb950e361c7', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:40 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-734df61f-fb8d-407a-9b43-50dcf61de5a5 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f8988d0-7785-4ecf-8dcc-3ed8cd429b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:40 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-734df61f-fb8d-407a-9b43-50dcf61de5a5 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f8988d0-7785-4ecf-8dcc-3ed8cd429b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:40 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-734df61f-fb8d-407a-9b43-50dcf61de5a5 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77d73bca-9d1a-4bcc-ba87-81671cbdd0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:40 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-734df61f-fb8d-407a-9b43-50dcf61de5a5 tempest-VolumesActionsTest-619378497 None] Volume 0ac2e822-636d-43c2-ad31-3eb950e361c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ac2e822-636d-43c2-ad31-3eb950e361c7', 'volume_size': 1}
Nov 06 17:10:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-734df61f-fb8d-407a-9b43-50dcf61de5a5 tempest-VolumesActionsTest-619378497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:42 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:10:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:10:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:10:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:42 devstack sudo[95607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:10:42 devstack sudo[95607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:43 devstack sudo[95607]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.766s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:43 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:10:43 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager._thread_info {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:10:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread count: 28 {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 17:10:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread info: [<_MainThread(MainThread, started 125183137599616)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125183027608256)>, <Thread(Thread-3 (stat_writer), started daemon 125183025243776)>, <Thread(Rabbit-heartbeat, started daemon 125183023512896)>, <Thread(Thread-5 (_runner), started daemon 125183023357120)>, <Thread(Thread-7 (_runner), started daemon 125183021306496)>, <Thread(fd_logger, started daemon 125183018711616)>, <Thread(privsep_reader, started daemon 125183017484224)>, <Thread(tpool_thread_0, started daemon 125183013742272)>, <Thread(tpool_thread_1, started daemon 125183005349568)>, <Thread(tpool_thread_2, started daemon 125182996956864)>, <Thread(tpool_thread_3, started daemon 125182988564160)>, <Thread(tpool_thread_4, started daemon 125182980171456)>, <Thread(tpool_thread_5, started daemon 125182971778752)>, <Thread(tpool_thread_6, started daemon 125182963386048)>, <Thread(tpool_thread_7, started daemon 125182954993344)>, <Thread(tpool_thread_8, started daemon 125182946600640)>, <Thread(tpool_thread_9, started daemon 125182938207936)>, <Thread(tpool_thread_10, started daemon 125182929815232)>, <Thread(tpool_thread_11, started daemon 125182921422528)>, <Thread(tpool_thread_12, started daemon 125182913013440)>, <Thread(tpool_thread_13, started daemon 125182904604352)>, <Thread(tpool_thread_14, started daemon 125182896195264)>, <Thread(tpool_thread_15, started daemon 125182887786176)>, <Thread(tpool_thread_16, started daemon 125182879377088)>, <Thread(tpool_thread_17, started daemon 125182870968000)>, <Thread(tpool_thread_18, started daemon 125182862558912)>, <Thread(tpool_thread_19, started daemon 125182854149824)>] {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 17:10:43 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-46dee31c-ecbb-47dd-a161-886bdab8122c tempest-VolumeTypesAccessTest-1849808291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:10:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-46dee31c-ecbb-47dd-a161-886bdab8122c tempest-VolumeTypesAccessTest-1849808291 None] Flow 'volume_create_manager' (58d1b62f-f499-4e7b-9652-0d0e4ee9369d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:10:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-46dee31c-ecbb-47dd-a161-886bdab8122c tempest-VolumeTypesAccessTest-1849808291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d438b944-1822-4931-9c08-9e04eb772c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:43 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=208,cinder:INSERT=64,cinder:UPDATE=223,cinder:DELETE=12 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:10:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-46dee31c-ecbb-47dd-a161-886bdab8122c tempest-VolumeTypesAccessTest-1849808291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d438b944-1822-4931-9c08-9e04eb772c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-41974920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0837a3c8-6584-4aff-955c-ae22c4defb8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='479320e63ed54570844c435f31cdc470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:10:43Z,use_quota=True,user_id='7a78963ed3f141958ab665f2c8cdc87d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f1b06430-4e70-4508-9c97-dd3cdefbc13e),volume_type_id=f1b06430-4e70-4508-9c97-dd3cdefbc13e)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-46dee31c-ecbb-47dd-a161-886bdab8122c tempest-VolumeTypesAccessTest-1849808291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d932f4c7-a22b-47d6-8927-b5fd23587dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-46dee31c-ecbb-47dd-a161-886bdab8122c tempest-VolumeTypesAccessTest-1849808291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d932f4c7-a22b-47d6-8927-b5fd23587dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-46dee31c-ecbb-47dd-a161-886bdab8122c tempest-VolumeTypesAccessTest-1849808291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aa02608-3a21-4dc9-8458-f44d84d20d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-46dee31c-ecbb-47dd-a161-886bdab8122c tempest-VolumeTypesAccessTest-1849808291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aa02608-3a21-4dc9-8458-f44d84d20d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0837a3c8-6584-4aff-955c-ae22c4defb8b', 'volume_name': 'volume-0837a3c8-6584-4aff-955c-ae22c4defb8b', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-46dee31c-ecbb-47dd-a161-886bdab8122c tempest-VolumeTypesAccessTest-1849808291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e16d6f61-e892-4255-bd58-123a916e2a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-46dee31c-ecbb-47dd-a161-886bdab8122c tempest-VolumeTypesAccessTest-1849808291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e16d6f61-e892-4255-bd58-123a916e2a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-46dee31c-ecbb-47dd-a161-886bdab8122c tempest-VolumeTypesAccessTest-1849808291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a0078f1-eacb-4b72-8745-b3ec5525c308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:43 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-46dee31c-ecbb-47dd-a161-886bdab8122c tempest-VolumeTypesAccessTest-1849808291 None] Volume 0837a3c8-6584-4aff-955c-ae22c4defb8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0837a3c8-6584-4aff-955c-ae22c4defb8b', 'volume_size': 1}
Nov 06 17:10:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-46dee31c-ecbb-47dd-a161-886bdab8122c tempest-VolumeTypesAccessTest-1849808291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:46 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0d1574f8-ec2e-4291-9856-b68cd14660ef" returned: 0 in 8.641s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:46 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Image conversion details: src /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f, size 1024.00 MB, duration 8.64 sec, destination /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0d1574f8-ec2e-4291-9856-b68cd14660ef {{(pid=86856) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 17:10:46 devstack cinder-volume[86856]: INFO cinder.image.image_utils [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Converted 1024.00 MB image at 118.49 MB/s
Nov 06 17:10:46 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0d1574f8-ec2e-4291-9856-b68cd14660ef is being set with open permissions: ugo+rw
Nov 06 17:10:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0d1574f8-ec2e-4291-9856-b68cd14660ef {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:46 devstack sudo[95618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0d1574f8-ec2e-4291-9856-b68cd14660ef
Nov 06 17:10:46 devstack sudo[95618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:46 devstack sudo[95618]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0d1574f8-ec2e-4291-9856-b68cd14660ef" returned: 0 in 0.249s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:46 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Lock "cinder-quobyte-0d1574f8-ec2e-4291-9856-b68cd14660ef" released by "_copy_volume_from_snapshot" :: held 10.136s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:46 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Lock "cinder-quobyte-984a3889-e73e-4375-ad39-f2dd2abc139f-0d1574f8-ec2e-4291-9856-b68cd14660ef" released by "_create_volume_from_snapshot" :: held 10.211s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.230s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-734df61f-fb8d-407a-9b43-50dcf61de5a5 tempest-VolumesActionsTest-619378497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.128s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:46 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-734df61f-fb8d-407a-9b43-50dcf61de5a5 tempest-VolumesActionsTest-619378497 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1244936539',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ac2e822-636d-43c2-ad31-3eb950e361c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db018548e4294a7d90917ec2cd21b08f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:10:40Z,use_quota=True,user_id='3c3572b432f640ab90152886669b3fc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:10:46 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-734df61f-fb8d-407a-9b43-50dcf61de5a5 tempest-VolumesActionsTest-619378497 None] Creating volume 0ac2e822-636d-43c2-ad31-3eb950e361c7 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:10:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-734df61f-fb8d-407a-9b43-50dcf61de5a5 tempest-VolumesActionsTest-619378497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-734df61f-fb8d-407a-9b43-50dcf61de5a5 tempest-VolumesActionsTest-619378497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:46 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-734df61f-fb8d-407a-9b43-50dcf61de5a5 tempest-VolumesActionsTest-619378497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:10:46 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-734df61f-fb8d-407a-9b43-50dcf61de5a5 tempest-VolumesActionsTest-619378497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:10:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-734df61f-fb8d-407a-9b43-50dcf61de5a5 tempest-VolumesActionsTest-619378497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:46 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-734df61f-fb8d-407a-9b43-50dcf61de5a5 tempest-VolumesActionsTest-619378497 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:10:46 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-734df61f-fb8d-407a-9b43-50dcf61de5a5 tempest-VolumesActionsTest-619378497 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:10:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-734df61f-fb8d-407a-9b43-50dcf61de5a5 tempest-VolumesActionsTest-619378497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0ac2e822-636d-43c2-ad31-3eb950e361c7 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:46 devstack sudo[95621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0ac2e822-636d-43c2-ad31-3eb950e361c7 1073741824
Nov 06 17:10:46 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:46 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86fe0b20-f296-4c58-a184-31324f9cf42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d1574f8-ec2e-4291-9856-b68cd14660ef', 'volume_size': 1, 'snapshot_id': '984a3889-e73e-4375-ad39-f2dd2abc139f'}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:46 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd458533-d186-4937-aa62-33d9153f77ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:46 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Volume volume-0d1574f8-ec2e-4291-9856-b68cd14660ef (0d1574f8-ec2e-4291-9856-b68cd14660ef): created successfully
Nov 06 17:10:46 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd458533-d186-4937-aa62-33d9153f77ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:46 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Flow 'volume_create_manager' (b68245e6-3ce1-4786-8fb4-311fa8b938c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:10:46 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-6eca13cc-17bb-471f-8dd5-2a13d5553eb9 tempest-VolumesDeleteCascade-2117513304 None] Created volume successfully.
Nov 06 17:10:47 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-734df61f-fb8d-407a-9b43-50dcf61de5a5 tempest-VolumesActionsTest-619378497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0ac2e822-636d-43c2-ad31-3eb950e361c7 1073741824" returned: 0 in 0.472s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-734df61f-fb8d-407a-9b43-50dcf61de5a5 tempest-VolumesActionsTest-619378497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0ac2e822-636d-43c2-ad31-3eb950e361c7 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:47 devstack sudo[95627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0ac2e822-636d-43c2-ad31-3eb950e361c7
Nov 06 17:10:47 devstack sudo[95627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:47 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] Acquiring lock "cinder-d2b4af97-8dec-4194-8a59-0cdee807d50f-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:47 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] Lock "cinder-d2b4af97-8dec-4194-8a59-0cdee807d50f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:47 devstack sudo[95627]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-734df61f-fb8d-407a-9b43-50dcf61de5a5 tempest-VolumesActionsTest-619378497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0ac2e822-636d-43c2-ad31-3eb950e361c7" returned: 0 in 0.297s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-734df61f-fb8d-407a-9b43-50dcf61de5a5 tempest-VolumesActionsTest-619378497 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:10:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-734df61f-fb8d-407a-9b43-50dcf61de5a5 tempest-VolumesActionsTest-619378497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-46dee31c-ecbb-47dd-a161-886bdab8122c tempest-VolumeTypesAccessTest-1849808291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.127s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-46dee31c-ecbb-47dd-a161-886bdab8122c tempest-VolumeTypesAccessTest-1849808291 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-41974920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0837a3c8-6584-4aff-955c-ae22c4defb8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='479320e63ed54570844c435f31cdc470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:10:43Z,use_quota=True,user_id='7a78963ed3f141958ab665f2c8cdc87d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f1b06430-4e70-4508-9c97-dd3cdefbc13e),volume_type_id=f1b06430-4e70-4508-9c97-dd3cdefbc13e)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:10:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-46dee31c-ecbb-47dd-a161-886bdab8122c tempest-VolumeTypesAccessTest-1849808291 None] Creating volume 0837a3c8-6584-4aff-955c-ae22c4defb8b {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:10:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-46dee31c-ecbb-47dd-a161-886bdab8122c tempest-VolumeTypesAccessTest-1849808291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-46dee31c-ecbb-47dd-a161-886bdab8122c tempest-VolumeTypesAccessTest-1849808291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-46dee31c-ecbb-47dd-a161-886bdab8122c tempest-VolumeTypesAccessTest-1849808291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:10:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-46dee31c-ecbb-47dd-a161-886bdab8122c tempest-VolumeTypesAccessTest-1849808291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:10:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-46dee31c-ecbb-47dd-a161-886bdab8122c tempest-VolumeTypesAccessTest-1849808291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-46dee31c-ecbb-47dd-a161-886bdab8122c tempest-VolumeTypesAccessTest-1849808291 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:10:47 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-46dee31c-ecbb-47dd-a161-886bdab8122c tempest-VolumeTypesAccessTest-1849808291 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:10:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-46dee31c-ecbb-47dd-a161-886bdab8122c tempest-VolumeTypesAccessTest-1849808291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0837a3c8-6584-4aff-955c-ae22c4defb8b 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-734df61f-fb8d-407a-9b43-50dcf61de5a5 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77d73bca-9d1a-4bcc-ba87-81671cbdd0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ac2e822-636d-43c2-ad31-3eb950e361c7', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-734df61f-fb8d-407a-9b43-50dcf61de5a5 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e9ac0c3-2dfc-4493-8656-003b590a54d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:47 devstack sudo[95630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0837a3c8-6584-4aff-955c-ae22c4defb8b 1073741824
Nov 06 17:10:47 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:47 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-734df61f-fb8d-407a-9b43-50dcf61de5a5 tempest-VolumesActionsTest-619378497 None] Volume volume-0ac2e822-636d-43c2-ad31-3eb950e361c7 (0ac2e822-636d-43c2-ad31-3eb950e361c7): created successfully
Nov 06 17:10:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-734df61f-fb8d-407a-9b43-50dcf61de5a5 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e9ac0c3-2dfc-4493-8656-003b590a54d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-734df61f-fb8d-407a-9b43-50dcf61de5a5 tempest-VolumesActionsTest-619378497 None] Flow 'volume_create_manager' (97f5fd58-cc04-43d1-b9c9-e1c6bc7a5fa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:10:47 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-734df61f-fb8d-407a-9b43-50dcf61de5a5 tempest-VolumesActionsTest-619378497 None] Created volume successfully.
Nov 06 17:10:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] Performing cascade delete. {{(pid=86856) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 06 17:10:47 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] Acquiring lock "cinder-984a3889-e73e-4375-ad39-f2dd2abc139f-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:47 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] Lock "cinder-984a3889-e73e-4375-ad39-f2dd2abc139f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:47 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] Acquiring lock "cinder-quobyte-d2b4af97-8dec-4194-8a59-0cdee807d50f" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:47 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] Lock "cinder-quobyte-d2b4af97-8dec-4194-8a59-0cdee807d50f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:47 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] Acquiring lock "cinder-quobyte-984a3889-e73e-4375-ad39-f2dd2abc139f" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:47 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] Lock "cinder-quobyte-984a3889-e73e-4375-ad39-f2dd2abc139f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] Deleting offline snapshot 984a3889-e73e-4375-ad39-f2dd2abc139f of volume d2b4af97-8dec-4194-8a59-0cdee807d50f {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:10:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] snapshot_file for this snap is: volume-d2b4af97-8dec-4194-8a59-0cdee807d50f.984a3889-e73e-4375-ad39-f2dd2abc139f {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:10:47 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf096ca7-7241-4988-9d6e-884b101c95d0]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:10:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f.984a3889-e73e-4375-ad39-f2dd2abc139f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:47 devstack sudo[95632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f.984a3889-e73e-4375-ad39-f2dd2abc139f
Nov 06 17:10:47 devstack sudo[95632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:48 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-46dee31c-ecbb-47dd-a161-886bdab8122c tempest-VolumeTypesAccessTest-1849808291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0837a3c8-6584-4aff-955c-ae22c4defb8b 1073741824" returned: 0 in 0.584s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-46dee31c-ecbb-47dd-a161-886bdab8122c tempest-VolumeTypesAccessTest-1849808291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0837a3c8-6584-4aff-955c-ae22c4defb8b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:48 devstack sudo[95641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0837a3c8-6584-4aff-955c-ae22c4defb8b
Nov 06 17:10:48 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:48 devstack sudo[95632]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f.984a3889-e73e-4375-ad39-f2dd2abc139f" returned: 0 in 0.460s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:48 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2b4af97-8dec-4194-8a59-0cdee807d50f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:10:48 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea32c58-1d1e-4a94-bbe5-0330f34f5f95]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:10:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:48 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5d276527-d1ea-4754-b14a-5741428258f5 tempest-VolumesActionsTest-912802788 None] Acquiring lock "cinder-0ac2e822-636d-43c2-ad31-3eb950e361c7-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:48 devstack sudo[95643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f
Nov 06 17:10:48 devstack sudo[95643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:48 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5d276527-d1ea-4754-b14a-5741428258f5 tempest-VolumesActionsTest-912802788 None] Lock "cinder-0ac2e822-636d-43c2-ad31-3eb950e361c7-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:48 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5d276527-d1ea-4754-b14a-5741428258f5 tempest-VolumesActionsTest-912802788 None] Acquiring lock "cinder-quobyte-0ac2e822-636d-43c2-ad31-3eb950e361c7" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:48 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5d276527-d1ea-4754-b14a-5741428258f5 tempest-VolumesActionsTest-912802788 None] Lock "cinder-quobyte-0ac2e822-636d-43c2-ad31-3eb950e361c7" acquired by "delete_volume" :: waited 0.021s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:48 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-46dee31c-ecbb-47dd-a161-886bdab8122c tempest-VolumeTypesAccessTest-1849808291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0837a3c8-6584-4aff-955c-ae22c4defb8b" returned: 0 in 0.366s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:48 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-46dee31c-ecbb-47dd-a161-886bdab8122c tempest-VolumeTypesAccessTest-1849808291 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:10:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-46dee31c-ecbb-47dd-a161-886bdab8122c tempest-VolumeTypesAccessTest-1849808291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:48 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[45da8a9b-6ba5-4023-bbde-96ff8452aa14]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:10:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d276527-d1ea-4754-b14a-5741428258f5 tempest-VolumesActionsTest-912802788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0ac2e822-636d-43c2-ad31-3eb950e361c7 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:48 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-46dee31c-ecbb-47dd-a161-886bdab8122c tempest-VolumeTypesAccessTest-1849808291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a0078f1-eacb-4b72-8745-b3ec5525c308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0837a3c8-6584-4aff-955c-ae22c4defb8b', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:48 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-46dee31c-ecbb-47dd-a161-886bdab8122c tempest-VolumeTypesAccessTest-1849808291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6beb3881-1550-49db-b0fd-602075f695f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:48 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-46dee31c-ecbb-47dd-a161-886bdab8122c tempest-VolumeTypesAccessTest-1849808291 None] Volume volume-0837a3c8-6584-4aff-955c-ae22c4defb8b (0837a3c8-6584-4aff-955c-ae22c4defb8b): created successfully
Nov 06 17:10:48 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-46dee31c-ecbb-47dd-a161-886bdab8122c tempest-VolumeTypesAccessTest-1849808291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6beb3881-1550-49db-b0fd-602075f695f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:48 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-46dee31c-ecbb-47dd-a161-886bdab8122c tempest-VolumeTypesAccessTest-1849808291 None] Flow 'volume_create_manager' (58d1b62f-f499-4e7b-9652-0d0e4ee9369d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:10:48 devstack sudo[95646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0ac2e822-636d-43c2-ad31-3eb950e361c7
Nov 06 17:10:48 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:48 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-46dee31c-ecbb-47dd-a161-886bdab8122c tempest-VolumeTypesAccessTest-1849808291 None] Created volume successfully.
Nov 06 17:10:49 devstack sudo[95643]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:49 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f" returned: 0 in 0.700s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f.984a3889-e73e-4375-ad39-f2dd2abc139f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d276527-d1ea-4754-b14a-5741428258f5 tempest-VolumesActionsTest-912802788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0ac2e822-636d-43c2-ad31-3eb950e361c7" returned: 0 in 0.451s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d276527-d1ea-4754-b14a-5741428258f5 tempest-VolumesActionsTest-912802788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0ac2e822-636d-43c2-ad31-3eb950e361c7 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:49 devstack sudo[95655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f.984a3889-e73e-4375-ad39-f2dd2abc139f
Nov 06 17:10:49 devstack sudo[95655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:49 devstack sudo[95656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0ac2e822-636d-43c2-ad31-3eb950e361c7
Nov 06 17:10:49 devstack sudo[95656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:49 devstack sudo[95656]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d276527-d1ea-4754-b14a-5741428258f5 tempest-VolumesActionsTest-912802788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0ac2e822-636d-43c2-ad31-3eb950e361c7" returned: 0 in 0.268s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:49 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5d276527-d1ea-4754-b14a-5741428258f5 tempest-VolumesActionsTest-912802788 None] Lock "cinder-quobyte-0ac2e822-636d-43c2-ad31-3eb950e361c7" released by "delete_volume" :: held 0.776s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:49 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-5d276527-d1ea-4754-b14a-5741428258f5 tempest-VolumesActionsTest-912802788 None] Created reservations ['0bfb8c4f-ae5c-4756-8073-c4cb7689e7ca', '43812500-a8ca-46c4-8968-c14327f93832', '12cd472f-7e64-4606-acd2-000fa8191e14', '3ae0fc0c-86ed-4c7e-8bcd-3b892a1708e2'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:10:49 devstack sudo[95655]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f.984a3889-e73e-4375-ad39-f2dd2abc139f" returned: 0 in 0.401s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f.984a3889-e73e-4375-ad39-f2dd2abc139f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:49 devstack sudo[95664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f.984a3889-e73e-4375-ad39-f2dd2abc139f
Nov 06 17:10:49 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5d276527-d1ea-4754-b14a-5741428258f5 tempest-VolumesActionsTest-912802788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5d276527-d1ea-4754-b14a-5741428258f5 tempest-VolumesActionsTest-912802788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:49 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5d276527-d1ea-4754-b14a-5741428258f5 tempest-VolumesActionsTest-912802788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:10:49 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5d276527-d1ea-4754-b14a-5741428258f5 tempest-VolumesActionsTest-912802788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:10:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5d276527-d1ea-4754-b14a-5741428258f5 tempest-VolumesActionsTest-912802788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d276527-d1ea-4754-b14a-5741428258f5 tempest-VolumesActionsTest-912802788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:49 devstack sudo[95666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:10:49 devstack sudo[95666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:49 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f.984a3889-e73e-4375-ad39-f2dd2abc139f" returned: 0 in 0.327s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:49 devstack sudo[95666]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d276527-d1ea-4754-b14a-5741428258f5 tempest-VolumesActionsTest-912802788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.317s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:49 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-5d276527-d1ea-4754-b14a-5741428258f5 tempest-VolumesActionsTest-912802788 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:10:49 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] Lock "cinder-quobyte-984a3889-e73e-4375-ad39-f2dd2abc139f" released by "_delete_snapshot" :: held 2.036s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:49 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-5d276527-d1ea-4754-b14a-5741428258f5 tempest-VolumesActionsTest-912802788 None] Deleted volume successfully.
Nov 06 17:10:49 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] Lock "cinder-quobyte-d2b4af97-8dec-4194-8a59-0cdee807d50f" released by "delete_snapshot" :: held 2.069s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:49 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5d276527-d1ea-4754-b14a-5741428258f5 tempest-VolumesActionsTest-912802788 None] Lock "cinder-0ac2e822-636d-43c2-ad31-3eb950e361c7-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:49 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c69c3e2f-123b-4369-8085-2e4d025fdff0 tempest-VolumeTypesAccessTest-1849808291 None] Acquiring lock "cinder-0837a3c8-6584-4aff-955c-ae22c4defb8b-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:49 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c69c3e2f-123b-4369-8085-2e4d025fdff0 tempest-VolumeTypesAccessTest-1849808291 None] Lock "cinder-0837a3c8-6584-4aff-955c-ae22c4defb8b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:49 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c69c3e2f-123b-4369-8085-2e4d025fdff0 tempest-VolumeTypesAccessTest-1849808291 None] Acquiring lock "cinder-quobyte-0837a3c8-6584-4aff-955c-ae22c4defb8b" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:49 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] Created reservations ['8cd8de02-da0e-458d-a5ce-f9a88df4de9e', 'a577e703-f226-482c-9542-3b848f89cf6c', '3917bcdc-b580-486a-9d69-2b7653db0801', '2a67adbb-adf9-4654-9df8-934d8777776b'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:10:50 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c69c3e2f-123b-4369-8085-2e4d025fdff0 tempest-VolumeTypesAccessTest-1849808291 None] Lock "cinder-quobyte-0837a3c8-6584-4aff-955c-ae22c4defb8b" acquired by "delete_volume" :: waited 0.027s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:50 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[83042a9f-2d9f-427a-8fb9-8cffc1f877fb]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:10:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c69c3e2f-123b-4369-8085-2e4d025fdff0 tempest-VolumeTypesAccessTest-1849808291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0837a3c8-6584-4aff-955c-ae22c4defb8b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:50 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] Delete snapshot completed successfully.
Nov 06 17:10:50 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] Lock "cinder-984a3889-e73e-4375-ad39-f2dd2abc139f-delete_snapshot" released by "delete_snapshot" :: held 2.395s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] Snapshots deleted, issuing volume delete {{(pid=86856) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 06 17:10:50 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] Acquiring lock "cinder-quobyte-d2b4af97-8dec-4194-8a59-0cdee807d50f" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:50 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] Lock "cinder-quobyte-d2b4af97-8dec-4194-8a59-0cdee807d50f" acquired by "delete_volume" :: waited 0.029s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:50 devstack sudo[95670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0837a3c8-6584-4aff-955c-ae22c4defb8b
Nov 06 17:10:50 devstack sudo[95670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:50 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b74a9a-bc19-41bd-bbd2-a587dc4d7acd]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:10:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:50 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc983237-8086-42f7-ac45-c2f1242f0a11 tempest-VolumesActionsTest-619378497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:10:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bc983237-8086-42f7-ac45-c2f1242f0a11 tempest-VolumesActionsTest-619378497 None] Flow 'volume_create_manager' (5705a6c6-385e-47d1-aca7-d4dbd57ac7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:10:50 devstack sudo[95672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f
Nov 06 17:10:50 devstack sudo[95672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bc983237-8086-42f7-ac45-c2f1242f0a11 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b380875-835d-4792-a231-4f579770d3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bc983237-8086-42f7-ac45-c2f1242f0a11 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b380875-835d-4792-a231-4f579770d3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-493202422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ef3fdc0-ca2b-45f8-a8f2-1709a643f672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db018548e4294a7d90917ec2cd21b08f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:10:50Z,use_quota=True,user_id='3c3572b432f640ab90152886669b3fc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bc983237-8086-42f7-ac45-c2f1242f0a11 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2acf441-c275-4db7-b559-5c896a76db49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bc983237-8086-42f7-ac45-c2f1242f0a11 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2acf441-c275-4db7-b559-5c896a76db49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bc983237-8086-42f7-ac45-c2f1242f0a11 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (134f72aa-bfbd-46ed-8ec5-d14f6eedacd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bc983237-8086-42f7-ac45-c2f1242f0a11 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (134f72aa-bfbd-46ed-8ec5-d14f6eedacd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ef3fdc0-ca2b-45f8-a8f2-1709a643f672', 'volume_name': 'volume-0ef3fdc0-ca2b-45f8-a8f2-1709a643f672', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bc983237-8086-42f7-ac45-c2f1242f0a11 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b0597de-725c-49de-8b38-eb28aee045fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bc983237-8086-42f7-ac45-c2f1242f0a11 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b0597de-725c-49de-8b38-eb28aee045fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bc983237-8086-42f7-ac45-c2f1242f0a11 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58441bab-6ec5-4f7f-8931-c017b02b5f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:50 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-bc983237-8086-42f7-ac45-c2f1242f0a11 tempest-VolumesActionsTest-619378497 None] Volume 0ef3fdc0-ca2b-45f8-a8f2-1709a643f672: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ef3fdc0-ca2b-45f8-a8f2-1709a643f672', 'volume_size': 1}
Nov 06 17:10:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bc983237-8086-42f7-ac45-c2f1242f0a11 tempest-VolumesActionsTest-619378497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bc983237-8086-42f7-ac45-c2f1242f0a11 tempest-VolumesActionsTest-619378497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bc983237-8086-42f7-ac45-c2f1242f0a11 tempest-VolumesActionsTest-619378497 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-493202422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ef3fdc0-ca2b-45f8-a8f2-1709a643f672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db018548e4294a7d90917ec2cd21b08f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:10:50Z,use_quota=True,user_id='3c3572b432f640ab90152886669b3fc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:10:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-bc983237-8086-42f7-ac45-c2f1242f0a11 tempest-VolumesActionsTest-619378497 None] Creating volume 0ef3fdc0-ca2b-45f8-a8f2-1709a643f672 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:10:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bc983237-8086-42f7-ac45-c2f1242f0a11 tempest-VolumesActionsTest-619378497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bc983237-8086-42f7-ac45-c2f1242f0a11 tempest-VolumesActionsTest-619378497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bc983237-8086-42f7-ac45-c2f1242f0a11 tempest-VolumesActionsTest-619378497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:10:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bc983237-8086-42f7-ac45-c2f1242f0a11 tempest-VolumesActionsTest-619378497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:10:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bc983237-8086-42f7-ac45-c2f1242f0a11 tempest-VolumesActionsTest-619378497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bc983237-8086-42f7-ac45-c2f1242f0a11 tempest-VolumesActionsTest-619378497 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:10:50 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-bc983237-8086-42f7-ac45-c2f1242f0a11 tempest-VolumesActionsTest-619378497 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:10:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bc983237-8086-42f7-ac45-c2f1242f0a11 tempest-VolumesActionsTest-619378497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0ef3fdc0-ca2b-45f8-a8f2-1709a643f672 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:50 devstack sudo[95670]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c69c3e2f-123b-4369-8085-2e4d025fdff0 tempest-VolumeTypesAccessTest-1849808291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0837a3c8-6584-4aff-955c-ae22c4defb8b" returned: 0 in 0.489s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c69c3e2f-123b-4369-8085-2e4d025fdff0 tempest-VolumeTypesAccessTest-1849808291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0837a3c8-6584-4aff-955c-ae22c4defb8b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:50 devstack sudo[95678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0ef3fdc0-ca2b-45f8-a8f2-1709a643f672 1073741824
Nov 06 17:10:50 devstack sudo[95678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:50 devstack sudo[95679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0837a3c8-6584-4aff-955c-ae22c4defb8b
Nov 06 17:10:50 devstack sudo[95679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:50 devstack sudo[95672]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f" returned: 0 in 0.524s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:50 devstack sudo[95688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f
Nov 06 17:10:50 devstack sudo[95688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:50 devstack sudo[95679]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c69c3e2f-123b-4369-8085-2e4d025fdff0 tempest-VolumeTypesAccessTest-1849808291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0837a3c8-6584-4aff-955c-ae22c4defb8b" returned: 0 in 0.309s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:50 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c69c3e2f-123b-4369-8085-2e4d025fdff0 tempest-VolumeTypesAccessTest-1849808291 None] Lock "cinder-quobyte-0837a3c8-6584-4aff-955c-ae22c4defb8b" released by "delete_volume" :: held 0.880s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:50 devstack cinder-volume[86856]: WARNING cinder.quota [None req-c69c3e2f-123b-4369-8085-2e4d025fdff0 tempest-VolumeTypesAccessTest-1849808291 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1709558588 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1709558588, it is now deprecated. Please use the default quota class for default quota.
Nov 06 17:10:50 devstack cinder-volume[86856]: WARNING cinder.quota [None req-c69c3e2f-123b-4369-8085-2e4d025fdff0 tempest-VolumeTypesAccessTest-1849808291 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1709558588 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1709558588, it is now deprecated. Please use the default quota class for default quota.
Nov 06 17:10:51 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-c69c3e2f-123b-4369-8085-2e4d025fdff0 tempest-VolumeTypesAccessTest-1849808291 None] Created reservations ['a290220f-31c7-4327-a1f1-c4cd7293abce', '054dbaa0-f84b-47db-ac03-81c4420b2327', '9b880330-fbea-42e8-88bb-fb06979d0d5e', 'f57132e6-7f48-476a-a32f-854cb8fc320a'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:10:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c69c3e2f-123b-4369-8085-2e4d025fdff0 tempest-VolumeTypesAccessTest-1849808291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c69c3e2f-123b-4369-8085-2e4d025fdff0 tempest-VolumeTypesAccessTest-1849808291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:51 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c69c3e2f-123b-4369-8085-2e4d025fdff0 tempest-VolumeTypesAccessTest-1849808291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:10:51 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c69c3e2f-123b-4369-8085-2e4d025fdff0 tempest-VolumeTypesAccessTest-1849808291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:10:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c69c3e2f-123b-4369-8085-2e4d025fdff0 tempest-VolumeTypesAccessTest-1849808291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c69c3e2f-123b-4369-8085-2e4d025fdff0 tempest-VolumeTypesAccessTest-1849808291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:51 devstack sudo[95688]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d2b4af97-8dec-4194-8a59-0cdee807d50f" returned: 0 in 0.363s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:51 devstack sudo[95678]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:51 devstack sudo[95693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:10:51 devstack sudo[95693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bc983237-8086-42f7-ac45-c2f1242f0a11 tempest-VolumesActionsTest-619378497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0ef3fdc0-ca2b-45f8-a8f2-1709a643f672 1073741824" returned: 0 in 0.651s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:51 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] Lock "cinder-quobyte-d2b4af97-8dec-4194-8a59-0cdee807d50f" released by "delete_volume" :: held 1.002s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bc983237-8086-42f7-ac45-c2f1242f0a11 tempest-VolumesActionsTest-619378497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0ef3fdc0-ca2b-45f8-a8f2-1709a643f672 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:51 devstack sudo[95695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0ef3fdc0-ca2b-45f8-a8f2-1709a643f672
Nov 06 17:10:51 devstack sudo[95695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:51 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] Created reservations ['90e968e1-f343-492f-b271-356b259814c4', '8ed4ab49-dba4-41f7-8528-9bc0d95e5c6e', 'c32c6ffd-09c3-4995-8ac4-f0309f186c78', '0c9e5c06-137b-453e-ae0a-5a0cd65ff9a6'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:10:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:51 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:10:51 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:10:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:51 devstack sudo[95697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:10:51 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:51 devstack sudo[95693]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c69c3e2f-123b-4369-8085-2e4d025fdff0 tempest-VolumeTypesAccessTest-1849808291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.347s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:51 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-c69c3e2f-123b-4369-8085-2e4d025fdff0 tempest-VolumeTypesAccessTest-1849808291 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:10:51 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-c69c3e2f-123b-4369-8085-2e4d025fdff0 tempest-VolumeTypesAccessTest-1849808291 None] Deleted volume successfully.
Nov 06 17:10:51 devstack sudo[95695]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bc983237-8086-42f7-ac45-c2f1242f0a11 tempest-VolumesActionsTest-619378497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0ef3fdc0-ca2b-45f8-a8f2-1709a643f672" returned: 0 in 0.302s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:51 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bc983237-8086-42f7-ac45-c2f1242f0a11 tempest-VolumesActionsTest-619378497 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:10:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bc983237-8086-42f7-ac45-c2f1242f0a11 tempest-VolumesActionsTest-619378497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:51 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c69c3e2f-123b-4369-8085-2e4d025fdff0 tempest-VolumeTypesAccessTest-1849808291 None] Lock "cinder-0837a3c8-6584-4aff-955c-ae22c4defb8b-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bc983237-8086-42f7-ac45-c2f1242f0a11 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58441bab-6ec5-4f7f-8931-c017b02b5f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ef3fdc0-ca2b-45f8-a8f2-1709a643f672', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bc983237-8086-42f7-ac45-c2f1242f0a11 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (115573ba-74c5-465a-9e8c-710e15b31774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:51 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-bc983237-8086-42f7-ac45-c2f1242f0a11 tempest-VolumesActionsTest-619378497 None] Volume volume-0ef3fdc0-ca2b-45f8-a8f2-1709a643f672 (0ef3fdc0-ca2b-45f8-a8f2-1709a643f672): created successfully
Nov 06 17:10:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bc983237-8086-42f7-ac45-c2f1242f0a11 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (115573ba-74c5-465a-9e8c-710e15b31774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bc983237-8086-42f7-ac45-c2f1242f0a11 tempest-VolumesActionsTest-619378497 None] Flow 'volume_create_manager' (5705a6c6-385e-47d1-aca7-d4dbd57ac7e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:10:51 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-bc983237-8086-42f7-ac45-c2f1242f0a11 tempest-VolumesActionsTest-619378497 None] Created volume successfully.
Nov 06 17:10:51 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.288s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:51 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:10:51 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] Deleted volume successfully.
Nov 06 17:10:51 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ee517bcc-c98c-47e0-aabc-a76a74409897 tempest-VolumesDeleteCascade-2117513304 None] Lock "cinder-d2b4af97-8dec-4194-8a59-0cdee807d50f-delete_volume" released by "delete_volume" :: held 4.125s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:52 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-30a957e8-0c12-4fce-abcf-20c31fd9e0f4 tempest-VolumesDeleteCascade-2117513304 None] Acquiring lock "cinder-0d1574f8-ec2e-4291-9856-b68cd14660ef-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:52 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-30a957e8-0c12-4fce-abcf-20c31fd9e0f4 tempest-VolumesDeleteCascade-2117513304 None] Lock "cinder-0d1574f8-ec2e-4291-9856-b68cd14660ef-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:52 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-30a957e8-0c12-4fce-abcf-20c31fd9e0f4 tempest-VolumesDeleteCascade-2117513304 None] Acquiring lock "cinder-quobyte-0d1574f8-ec2e-4291-9856-b68cd14660ef" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:52 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-30a957e8-0c12-4fce-abcf-20c31fd9e0f4 tempest-VolumesDeleteCascade-2117513304 None] Lock "cinder-quobyte-0d1574f8-ec2e-4291-9856-b68cd14660ef" acquired by "delete_volume" :: waited 0.021s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:52 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c53a55-0e80-46f3-8dfa-bdb4d2c43b59]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:10:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-30a957e8-0c12-4fce-abcf-20c31fd9e0f4 tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0d1574f8-ec2e-4291-9856-b68cd14660ef {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:52 devstack sudo[95702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0d1574f8-ec2e-4291-9856-b68cd14660ef
Nov 06 17:10:52 devstack sudo[95702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:52 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-fad1d044-fcc7-4211-826f-cc57f51fcd5d tempest-VolumesActionsTest-912802788 None] Acquiring lock "cinder-0ef3fdc0-ca2b-45f8-a8f2-1709a643f672-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:52 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-fad1d044-fcc7-4211-826f-cc57f51fcd5d tempest-VolumesActionsTest-912802788 None] Lock "cinder-0ef3fdc0-ca2b-45f8-a8f2-1709a643f672-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:52 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-fad1d044-fcc7-4211-826f-cc57f51fcd5d tempest-VolumesActionsTest-912802788 None] Acquiring lock "cinder-quobyte-0ef3fdc0-ca2b-45f8-a8f2-1709a643f672" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:52 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-fad1d044-fcc7-4211-826f-cc57f51fcd5d tempest-VolumesActionsTest-912802788 None] Lock "cinder-quobyte-0ef3fdc0-ca2b-45f8-a8f2-1709a643f672" acquired by "delete_volume" :: waited 0.019s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:52 devstack sudo[95702]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-30a957e8-0c12-4fce-abcf-20c31fd9e0f4 tempest-VolumesDeleteCascade-2117513304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0d1574f8-ec2e-4291-9856-b68cd14660ef" returned: 0 in 0.448s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-30a957e8-0c12-4fce-abcf-20c31fd9e0f4 tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0d1574f8-ec2e-4291-9856-b68cd14660ef {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:52 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95b7fda-75af-4d95-8b1a-c704b43cda90]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:10:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fad1d044-fcc7-4211-826f-cc57f51fcd5d tempest-VolumesActionsTest-912802788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0ef3fdc0-ca2b-45f8-a8f2-1709a643f672 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:52 devstack sudo[95707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0d1574f8-ec2e-4291-9856-b68cd14660ef
Nov 06 17:10:52 devstack sudo[95707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:52 devstack sudo[95708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0ef3fdc0-ca2b-45f8-a8f2-1709a643f672
Nov 06 17:10:52 devstack sudo[95708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:53 devstack sudo[95707]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-30a957e8-0c12-4fce-abcf-20c31fd9e0f4 tempest-VolumesDeleteCascade-2117513304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0d1574f8-ec2e-4291-9856-b68cd14660ef" returned: 0 in 0.294s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:53 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-30a957e8-0c12-4fce-abcf-20c31fd9e0f4 tempest-VolumesDeleteCascade-2117513304 None] Lock "cinder-quobyte-0d1574f8-ec2e-4291-9856-b68cd14660ef" released by "delete_volume" :: held 0.816s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:53 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-30a957e8-0c12-4fce-abcf-20c31fd9e0f4 tempest-VolumesDeleteCascade-2117513304 None] Created reservations ['fab1c523-7603-40d7-a324-dd34a1fc4dba', 'cda4a4fd-9bdf-4342-8796-c1e795a4e84f', 'fa9ab42d-b859-4059-a883-5f2dfef466ca', 'efdf1cfe-e92f-425a-9a30-32a2b04c93f5'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:10:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-30a957e8-0c12-4fce-abcf-20c31fd9e0f4 tempest-VolumesDeleteCascade-2117513304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-30a957e8-0c12-4fce-abcf-20c31fd9e0f4 tempest-VolumesDeleteCascade-2117513304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:53 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-30a957e8-0c12-4fce-abcf-20c31fd9e0f4 tempest-VolumesDeleteCascade-2117513304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:10:53 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-30a957e8-0c12-4fce-abcf-20c31fd9e0f4 tempest-VolumesDeleteCascade-2117513304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:10:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-30a957e8-0c12-4fce-abcf-20c31fd9e0f4 tempest-VolumesDeleteCascade-2117513304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-30a957e8-0c12-4fce-abcf-20c31fd9e0f4 tempest-VolumesDeleteCascade-2117513304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:53 devstack sudo[95708]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fad1d044-fcc7-4211-826f-cc57f51fcd5d tempest-VolumesActionsTest-912802788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0ef3fdc0-ca2b-45f8-a8f2-1709a643f672" returned: 0 in 0.517s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fad1d044-fcc7-4211-826f-cc57f51fcd5d tempest-VolumesActionsTest-912802788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0ef3fdc0-ca2b-45f8-a8f2-1709a643f672 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:53 devstack sudo[95715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:10:53 devstack sudo[95715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:53 devstack sudo[95716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0ef3fdc0-ca2b-45f8-a8f2-1709a643f672
Nov 06 17:10:53 devstack sudo[95716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:53 devstack sudo[95715]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-30a957e8-0c12-4fce-abcf-20c31fd9e0f4 tempest-VolumesDeleteCascade-2117513304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.304s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:53 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-30a957e8-0c12-4fce-abcf-20c31fd9e0f4 tempest-VolumesDeleteCascade-2117513304 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:10:53 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-30a957e8-0c12-4fce-abcf-20c31fd9e0f4 tempest-VolumesDeleteCascade-2117513304 None] Deleted volume successfully.
Nov 06 17:10:53 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-30a957e8-0c12-4fce-abcf-20c31fd9e0f4 tempest-VolumesDeleteCascade-2117513304 None] Lock "cinder-0d1574f8-ec2e-4291-9856-b68cd14660ef-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:53 devstack sudo[95716]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fad1d044-fcc7-4211-826f-cc57f51fcd5d tempest-VolumesActionsTest-912802788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0ef3fdc0-ca2b-45f8-a8f2-1709a643f672" returned: 0 in 0.357s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:53 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-fad1d044-fcc7-4211-826f-cc57f51fcd5d tempest-VolumesActionsTest-912802788 None] Lock "cinder-quobyte-0ef3fdc0-ca2b-45f8-a8f2-1709a643f672" released by "delete_volume" :: held 0.934s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:53 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-fad1d044-fcc7-4211-826f-cc57f51fcd5d tempest-VolumesActionsTest-912802788 None] Created reservations ['d17b5e40-33c7-45a4-8ede-115f9a5ab7b3', 'f3ab20a9-b646-4702-87c4-f7cfbd3c6712', 'd13902b4-7d82-4208-8f8f-dc350257317f', '51612b31-7606-4758-9f90-f0651005c1bc'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:10:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-fad1d044-fcc7-4211-826f-cc57f51fcd5d tempest-VolumesActionsTest-912802788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-fad1d044-fcc7-4211-826f-cc57f51fcd5d tempest-VolumesActionsTest-912802788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:53 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-fad1d044-fcc7-4211-826f-cc57f51fcd5d tempest-VolumesActionsTest-912802788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:10:53 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-fad1d044-fcc7-4211-826f-cc57f51fcd5d tempest-VolumesActionsTest-912802788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:10:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-fad1d044-fcc7-4211-826f-cc57f51fcd5d tempest-VolumesActionsTest-912802788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fad1d044-fcc7-4211-826f-cc57f51fcd5d tempest-VolumesActionsTest-912802788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:53 devstack sudo[95721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:10:53 devstack sudo[95721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:54 devstack sudo[95721]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fad1d044-fcc7-4211-826f-cc57f51fcd5d tempest-VolumesActionsTest-912802788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.285s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:54 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-fad1d044-fcc7-4211-826f-cc57f51fcd5d tempest-VolumesActionsTest-912802788 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:10:54 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-fad1d044-fcc7-4211-826f-cc57f51fcd5d tempest-VolumesActionsTest-912802788 None] Deleted volume successfully.
Nov 06 17:10:54 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-fad1d044-fcc7-4211-826f-cc57f51fcd5d tempest-VolumesActionsTest-912802788 None] Lock "cinder-0ef3fdc0-ca2b-45f8-a8f2-1709a643f672-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:54 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-506610c8-23d4-434f-9558-0f4aa9a45126 tempest-VolumesActionsTest-619378497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:10:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-506610c8-23d4-434f-9558-0f4aa9a45126 tempest-VolumesActionsTest-619378497 None] Flow 'volume_create_manager' (be94086d-76b6-410e-a26d-367ee4cc218c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:10:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-506610c8-23d4-434f-9558-0f4aa9a45126 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec56242a-273f-4e81-9174-68147ee8076a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-506610c8-23d4-434f-9558-0f4aa9a45126 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec56242a-273f-4e81-9174-68147ee8076a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1502490760',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0e841a7-cfef-4dcc-a993-3c102b80d857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db018548e4294a7d90917ec2cd21b08f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:10:54Z,use_quota=True,user_id='3c3572b432f640ab90152886669b3fc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-506610c8-23d4-434f-9558-0f4aa9a45126 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48b3c9e3-1266-4dfb-868d-9c5f18adb5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-506610c8-23d4-434f-9558-0f4aa9a45126 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48b3c9e3-1266-4dfb-868d-9c5f18adb5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-506610c8-23d4-434f-9558-0f4aa9a45126 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14484174-6d77-459a-a193-c6be38c1104f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-506610c8-23d4-434f-9558-0f4aa9a45126 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14484174-6d77-459a-a193-c6be38c1104f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0e841a7-cfef-4dcc-a993-3c102b80d857', 'volume_name': 'volume-a0e841a7-cfef-4dcc-a993-3c102b80d857', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-506610c8-23d4-434f-9558-0f4aa9a45126 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba19e7d8-d5a7-4804-b7ed-088c9d8f6cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-506610c8-23d4-434f-9558-0f4aa9a45126 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba19e7d8-d5a7-4804-b7ed-088c9d8f6cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-506610c8-23d4-434f-9558-0f4aa9a45126 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f42efd-9804-4dd1-86f4-f77bee7f1c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:54 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-506610c8-23d4-434f-9558-0f4aa9a45126 tempest-VolumesActionsTest-619378497 None] Volume a0e841a7-cfef-4dcc-a993-3c102b80d857: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0e841a7-cfef-4dcc-a993-3c102b80d857', 'volume_size': 1}
Nov 06 17:10:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-506610c8-23d4-434f-9558-0f4aa9a45126 tempest-VolumesActionsTest-619378497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-506610c8-23d4-434f-9558-0f4aa9a45126 tempest-VolumesActionsTest-619378497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-506610c8-23d4-434f-9558-0f4aa9a45126 tempest-VolumesActionsTest-619378497 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1502490760',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0e841a7-cfef-4dcc-a993-3c102b80d857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db018548e4294a7d90917ec2cd21b08f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:10:54Z,use_quota=True,user_id='3c3572b432f640ab90152886669b3fc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:10:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-506610c8-23d4-434f-9558-0f4aa9a45126 tempest-VolumesActionsTest-619378497 None] Creating volume a0e841a7-cfef-4dcc-a993-3c102b80d857 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:10:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-506610c8-23d4-434f-9558-0f4aa9a45126 tempest-VolumesActionsTest-619378497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-506610c8-23d4-434f-9558-0f4aa9a45126 tempest-VolumesActionsTest-619378497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-506610c8-23d4-434f-9558-0f4aa9a45126 tempest-VolumesActionsTest-619378497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:10:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-506610c8-23d4-434f-9558-0f4aa9a45126 tempest-VolumesActionsTest-619378497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:10:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-506610c8-23d4-434f-9558-0f4aa9a45126 tempest-VolumesActionsTest-619378497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-506610c8-23d4-434f-9558-0f4aa9a45126 tempest-VolumesActionsTest-619378497 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:10:54 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-506610c8-23d4-434f-9558-0f4aa9a45126 tempest-VolumesActionsTest-619378497 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:10:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-506610c8-23d4-434f-9558-0f4aa9a45126 tempest-VolumesActionsTest-619378497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a0e841a7-cfef-4dcc-a993-3c102b80d857 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:54 devstack sudo[95724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a0e841a7-cfef-4dcc-a993-3c102b80d857 1073741824
Nov 06 17:10:54 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:55 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-506610c8-23d4-434f-9558-0f4aa9a45126 tempest-VolumesActionsTest-619378497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a0e841a7-cfef-4dcc-a993-3c102b80d857 1073741824" returned: 0 in 0.690s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-506610c8-23d4-434f-9558-0f4aa9a45126 tempest-VolumesActionsTest-619378497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a0e841a7-cfef-4dcc-a993-3c102b80d857 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:55 devstack sudo[95730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a0e841a7-cfef-4dcc-a993-3c102b80d857
Nov 06 17:10:55 devstack sudo[95730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:55 devstack sudo[95730]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-506610c8-23d4-434f-9558-0f4aa9a45126 tempest-VolumesActionsTest-619378497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a0e841a7-cfef-4dcc-a993-3c102b80d857" returned: 0 in 0.343s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:55 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-506610c8-23d4-434f-9558-0f4aa9a45126 tempest-VolumesActionsTest-619378497 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:10:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-506610c8-23d4-434f-9558-0f4aa9a45126 tempest-VolumesActionsTest-619378497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-506610c8-23d4-434f-9558-0f4aa9a45126 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f42efd-9804-4dd1-86f4-f77bee7f1c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0e841a7-cfef-4dcc-a993-3c102b80d857', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-506610c8-23d4-434f-9558-0f4aa9a45126 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6be817c2-1d1a-44a0-84c0-02bfa9f7b91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:10:55 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-506610c8-23d4-434f-9558-0f4aa9a45126 tempest-VolumesActionsTest-619378497 None] Volume volume-a0e841a7-cfef-4dcc-a993-3c102b80d857 (a0e841a7-cfef-4dcc-a993-3c102b80d857): created successfully
Nov 06 17:10:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-506610c8-23d4-434f-9558-0f4aa9a45126 tempest-VolumesActionsTest-619378497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6be817c2-1d1a-44a0-84c0-02bfa9f7b91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:10:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-506610c8-23d4-434f-9558-0f4aa9a45126 tempest-VolumesActionsTest-619378497 None] Flow 'volume_create_manager' (be94086d-76b6-410e-a26d-367ee4cc218c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:10:55 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-506610c8-23d4-434f-9558-0f4aa9a45126 tempest-VolumesActionsTest-619378497 None] Created volume successfully.
Nov 06 17:10:57 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f784d922-67c2-4b10-88aa-193a1efe111f tempest-VolumesActionsTest-619378497 None] Acquiring lock "cinder-a0e841a7-cfef-4dcc-a993-3c102b80d857-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:57 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f784d922-67c2-4b10-88aa-193a1efe111f tempest-VolumesActionsTest-619378497 None] Lock "cinder-a0e841a7-cfef-4dcc-a993-3c102b80d857-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:57 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f784d922-67c2-4b10-88aa-193a1efe111f tempest-VolumesActionsTest-619378497 None] Acquiring lock "cinder-quobyte-a0e841a7-cfef-4dcc-a993-3c102b80d857" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:10:57 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f784d922-67c2-4b10-88aa-193a1efe111f tempest-VolumesActionsTest-619378497 None] Lock "cinder-quobyte-a0e841a7-cfef-4dcc-a993-3c102b80d857" acquired by "delete_volume" :: waited 0.022s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:10:57 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e021bdc-cbb6-41e7-b252-2c62435ce784]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:10:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f784d922-67c2-4b10-88aa-193a1efe111f tempest-VolumesActionsTest-619378497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a0e841a7-cfef-4dcc-a993-3c102b80d857 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:57 devstack sudo[95734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a0e841a7-cfef-4dcc-a993-3c102b80d857
Nov 06 17:10:57 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:58 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f784d922-67c2-4b10-88aa-193a1efe111f tempest-VolumesActionsTest-619378497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a0e841a7-cfef-4dcc-a993-3c102b80d857" returned: 0 in 0.472s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f784d922-67c2-4b10-88aa-193a1efe111f tempest-VolumesActionsTest-619378497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a0e841a7-cfef-4dcc-a993-3c102b80d857 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:58 devstack sudo[95739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a0e841a7-cfef-4dcc-a993-3c102b80d857
Nov 06 17:10:58 devstack sudo[95739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:58 devstack sudo[95739]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f784d922-67c2-4b10-88aa-193a1efe111f tempest-VolumesActionsTest-619378497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a0e841a7-cfef-4dcc-a993-3c102b80d857" returned: 0 in 0.292s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:58 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f784d922-67c2-4b10-88aa-193a1efe111f tempest-VolumesActionsTest-619378497 None] Lock "cinder-quobyte-a0e841a7-cfef-4dcc-a993-3c102b80d857" released by "delete_volume" :: held 0.841s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:10:58 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-f784d922-67c2-4b10-88aa-193a1efe111f tempest-VolumesActionsTest-619378497 None] Created reservations ['38d3f512-5c3f-4f29-b5d2-7f450f18990b', 'e81947a8-352c-46b3-9099-fe436ee66f4f', '2638f7d6-ade4-428c-b489-0bd418a72090', '15c39d58-390c-4f51-beae-e2aa376ab45d'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:10:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f784d922-67c2-4b10-88aa-193a1efe111f tempest-VolumesActionsTest-619378497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:10:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f784d922-67c2-4b10-88aa-193a1efe111f tempest-VolumesActionsTest-619378497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:10:58 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-f784d922-67c2-4b10-88aa-193a1efe111f tempest-VolumesActionsTest-619378497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:10:58 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-f784d922-67c2-4b10-88aa-193a1efe111f tempest-VolumesActionsTest-619378497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:10:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f784d922-67c2-4b10-88aa-193a1efe111f tempest-VolumesActionsTest-619378497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:10:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f784d922-67c2-4b10-88aa-193a1efe111f tempest-VolumesActionsTest-619378497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:10:58 devstack sudo[95742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:10:58 devstack sudo[95742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:10:58 devstack sudo[95742]: pam_unix(sudo:session): session closed for user root
Nov 06 17:10:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f784d922-67c2-4b10-88aa-193a1efe111f tempest-VolumesActionsTest-619378497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.341s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:10:58 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-f784d922-67c2-4b10-88aa-193a1efe111f tempest-VolumesActionsTest-619378497 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:10:58 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-f784d922-67c2-4b10-88aa-193a1efe111f tempest-VolumesActionsTest-619378497 None] Deleted volume successfully.
Nov 06 17:10:58 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f784d922-67c2-4b10-88aa-193a1efe111f tempest-VolumesActionsTest-619378497 None] Lock "cinder-a0e841a7-cfef-4dcc-a993-3c102b80d857-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:11:03 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb67e689-bbf4-4328-aa59-8e004735e2a1 tempest-VolumesListAdminTestJSON-1634641856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:11:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bb67e689-bbf4-4328-aa59-8e004735e2a1 tempest-VolumesListAdminTestJSON-1634641856 None] Flow 'volume_create_manager' (06bdbe6c-a430-4d48-8d6d-d1e41f3e69ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:11:04 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bb67e689-bbf4-4328-aa59-8e004735e2a1 tempest-VolumesListAdminTestJSON-1634641856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb38cdef-04b3-4275-b20b-9d5f5c4d22a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:04 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bb67e689-bbf4-4328-aa59-8e004735e2a1 tempest-VolumesListAdminTestJSON-1634641856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb38cdef-04b3-4275-b20b-9d5f5c4d22a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1281034979',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54715f23-bef0-4d43-a8d5-e76aa507fd3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb6794a980c242a1a7aaa0f06f9b4c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:11:04Z,use_quota=True,user_id='4b3790dd40fa49438e9c5d1c4d9ca371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:04 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bb67e689-bbf4-4328-aa59-8e004735e2a1 tempest-VolumesListAdminTestJSON-1634641856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678e7fe6-8d7f-4393-a6d6-f9e9543ebfd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:04 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bb67e689-bbf4-4328-aa59-8e004735e2a1 tempest-VolumesListAdminTestJSON-1634641856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678e7fe6-8d7f-4393-a6d6-f9e9543ebfd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:04 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bb67e689-bbf4-4328-aa59-8e004735e2a1 tempest-VolumesListAdminTestJSON-1634641856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86d16953-e3cf-485d-8b3c-62dde92f3ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:04 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bb67e689-bbf4-4328-aa59-8e004735e2a1 tempest-VolumesListAdminTestJSON-1634641856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86d16953-e3cf-485d-8b3c-62dde92f3ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54715f23-bef0-4d43-a8d5-e76aa507fd3c', 'volume_name': 'volume-54715f23-bef0-4d43-a8d5-e76aa507fd3c', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:04 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bb67e689-bbf4-4328-aa59-8e004735e2a1 tempest-VolumesListAdminTestJSON-1634641856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (364aabd7-2d34-4a5e-af32-48f0aa6d3bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:04 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bb67e689-bbf4-4328-aa59-8e004735e2a1 tempest-VolumesListAdminTestJSON-1634641856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (364aabd7-2d34-4a5e-af32-48f0aa6d3bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:04 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bb67e689-bbf4-4328-aa59-8e004735e2a1 tempest-VolumesListAdminTestJSON-1634641856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c350be74-b8d6-4a4f-9688-8c3c2160cbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:04 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-bb67e689-bbf4-4328-aa59-8e004735e2a1 tempest-VolumesListAdminTestJSON-1634641856 None] Volume 54715f23-bef0-4d43-a8d5-e76aa507fd3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54715f23-bef0-4d43-a8d5-e76aa507fd3c', 'volume_size': 1}
Nov 06 17:11:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bb67e689-bbf4-4328-aa59-8e004735e2a1 tempest-VolumesListAdminTestJSON-1634641856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:11:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bb67e689-bbf4-4328-aa59-8e004735e2a1 tempest-VolumesListAdminTestJSON-1634641856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:11:04 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bb67e689-bbf4-4328-aa59-8e004735e2a1 tempest-VolumesListAdminTestJSON-1634641856 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1281034979',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54715f23-bef0-4d43-a8d5-e76aa507fd3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb6794a980c242a1a7aaa0f06f9b4c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:11:04Z,use_quota=True,user_id='4b3790dd40fa49438e9c5d1c4d9ca371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:11:04 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-bb67e689-bbf4-4328-aa59-8e004735e2a1 tempest-VolumesListAdminTestJSON-1634641856 None] Creating volume 54715f23-bef0-4d43-a8d5-e76aa507fd3c {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:11:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bb67e689-bbf4-4328-aa59-8e004735e2a1 tempest-VolumesListAdminTestJSON-1634641856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:11:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bb67e689-bbf4-4328-aa59-8e004735e2a1 tempest-VolumesListAdminTestJSON-1634641856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:11:04 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bb67e689-bbf4-4328-aa59-8e004735e2a1 tempest-VolumesListAdminTestJSON-1634641856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:11:04 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bb67e689-bbf4-4328-aa59-8e004735e2a1 tempest-VolumesListAdminTestJSON-1634641856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:11:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bb67e689-bbf4-4328-aa59-8e004735e2a1 tempest-VolumesListAdminTestJSON-1634641856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:11:04 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bb67e689-bbf4-4328-aa59-8e004735e2a1 tempest-VolumesListAdminTestJSON-1634641856 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:11:04 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-bb67e689-bbf4-4328-aa59-8e004735e2a1 tempest-VolumesListAdminTestJSON-1634641856 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:11:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bb67e689-bbf4-4328-aa59-8e004735e2a1 tempest-VolumesListAdminTestJSON-1634641856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-54715f23-bef0-4d43-a8d5-e76aa507fd3c 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:04 devstack sudo[95748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-54715f23-bef0-4d43-a8d5-e76aa507fd3c 1073741824
Nov 06 17:11:04 devstack sudo[95748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:04 devstack sudo[95748]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bb67e689-bbf4-4328-aa59-8e004735e2a1 tempest-VolumesListAdminTestJSON-1634641856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-54715f23-bef0-4d43-a8d5-e76aa507fd3c 1073741824" returned: 0 in 0.576s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bb67e689-bbf4-4328-aa59-8e004735e2a1 tempest-VolumesListAdminTestJSON-1634641856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-54715f23-bef0-4d43-a8d5-e76aa507fd3c {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:04 devstack sudo[95754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-54715f23-bef0-4d43-a8d5-e76aa507fd3c
Nov 06 17:11:04 devstack sudo[95754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:05 devstack sudo[95754]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bb67e689-bbf4-4328-aa59-8e004735e2a1 tempest-VolumesListAdminTestJSON-1634641856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-54715f23-bef0-4d43-a8d5-e76aa507fd3c" returned: 0 in 0.360s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:05 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bb67e689-bbf4-4328-aa59-8e004735e2a1 tempest-VolumesListAdminTestJSON-1634641856 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:11:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bb67e689-bbf4-4328-aa59-8e004735e2a1 tempest-VolumesListAdminTestJSON-1634641856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:11:05 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bb67e689-bbf4-4328-aa59-8e004735e2a1 tempest-VolumesListAdminTestJSON-1634641856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c350be74-b8d6-4a4f-9688-8c3c2160cbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54715f23-bef0-4d43-a8d5-e76aa507fd3c', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:05 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bb67e689-bbf4-4328-aa59-8e004735e2a1 tempest-VolumesListAdminTestJSON-1634641856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0585cd6-55ae-4fe0-b7c4-8e5d0890062e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:05 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-bb67e689-bbf4-4328-aa59-8e004735e2a1 tempest-VolumesListAdminTestJSON-1634641856 None] Volume volume-54715f23-bef0-4d43-a8d5-e76aa507fd3c (54715f23-bef0-4d43-a8d5-e76aa507fd3c): created successfully
Nov 06 17:11:05 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bb67e689-bbf4-4328-aa59-8e004735e2a1 tempest-VolumesListAdminTestJSON-1634641856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0585cd6-55ae-4fe0-b7c4-8e5d0890062e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:05 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bb67e689-bbf4-4328-aa59-8e004735e2a1 tempest-VolumesListAdminTestJSON-1634641856 None] Flow 'volume_create_manager' (06bdbe6c-a430-4d48-8d6d-d1e41f3e69ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:11:05 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-bb67e689-bbf4-4328-aa59-8e004735e2a1 tempest-VolumesListAdminTestJSON-1634641856 None] Created volume successfully.
Nov 06 17:11:06 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-63abc03a-9231-45f7-b72e-00111a317cf9 tempest-VolumesListAdminTestJSON-1634641856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:11:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-63abc03a-9231-45f7-b72e-00111a317cf9 tempest-VolumesListAdminTestJSON-1634641856 None] Flow 'volume_create_manager' (67fcc6be-4470-481b-82ac-c6ec45a91d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:11:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-63abc03a-9231-45f7-b72e-00111a317cf9 tempest-VolumesListAdminTestJSON-1634641856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e58611-9fa0-4897-9b66-e941b521f826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-63abc03a-9231-45f7-b72e-00111a317cf9 tempest-VolumesListAdminTestJSON-1634641856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e58611-9fa0-4897-9b66-e941b521f826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1859839054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b639f43e-e890-4252-bfc8-ceb8466027fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb6794a980c242a1a7aaa0f06f9b4c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:11:07Z,use_quota=True,user_id='4b3790dd40fa49438e9c5d1c4d9ca371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-63abc03a-9231-45f7-b72e-00111a317cf9 tempest-VolumesListAdminTestJSON-1634641856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dee49e50-daa1-4d5d-bf0e-7e20fdf78fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-63abc03a-9231-45f7-b72e-00111a317cf9 tempest-VolumesListAdminTestJSON-1634641856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dee49e50-daa1-4d5d-bf0e-7e20fdf78fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-63abc03a-9231-45f7-b72e-00111a317cf9 tempest-VolumesListAdminTestJSON-1634641856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe34825-00a6-4483-93b0-3ab6fd734e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-63abc03a-9231-45f7-b72e-00111a317cf9 tempest-VolumesListAdminTestJSON-1634641856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe34825-00a6-4483-93b0-3ab6fd734e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b639f43e-e890-4252-bfc8-ceb8466027fc', 'volume_name': 'volume-b639f43e-e890-4252-bfc8-ceb8466027fc', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-63abc03a-9231-45f7-b72e-00111a317cf9 tempest-VolumesListAdminTestJSON-1634641856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ef0c03a-ecbd-456a-b8f7-18b8a3d5c1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-63abc03a-9231-45f7-b72e-00111a317cf9 tempest-VolumesListAdminTestJSON-1634641856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ef0c03a-ecbd-456a-b8f7-18b8a3d5c1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-63abc03a-9231-45f7-b72e-00111a317cf9 tempest-VolumesListAdminTestJSON-1634641856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9841b188-7ea3-48e3-b8c0-bbfb78fd3edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:06 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-63abc03a-9231-45f7-b72e-00111a317cf9 tempest-VolumesListAdminTestJSON-1634641856 None] Volume b639f43e-e890-4252-bfc8-ceb8466027fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b639f43e-e890-4252-bfc8-ceb8466027fc', 'volume_size': 1}
Nov 06 17:11:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-63abc03a-9231-45f7-b72e-00111a317cf9 tempest-VolumesListAdminTestJSON-1634641856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:11:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-63abc03a-9231-45f7-b72e-00111a317cf9 tempest-VolumesListAdminTestJSON-1634641856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:11:06 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-63abc03a-9231-45f7-b72e-00111a317cf9 tempest-VolumesListAdminTestJSON-1634641856 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1859839054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b639f43e-e890-4252-bfc8-ceb8466027fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb6794a980c242a1a7aaa0f06f9b4c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:11:07Z,use_quota=True,user_id='4b3790dd40fa49438e9c5d1c4d9ca371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:11:06 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-63abc03a-9231-45f7-b72e-00111a317cf9 tempest-VolumesListAdminTestJSON-1634641856 None] Creating volume b639f43e-e890-4252-bfc8-ceb8466027fc {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:11:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-63abc03a-9231-45f7-b72e-00111a317cf9 tempest-VolumesListAdminTestJSON-1634641856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:11:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-63abc03a-9231-45f7-b72e-00111a317cf9 tempest-VolumesListAdminTestJSON-1634641856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:11:06 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-63abc03a-9231-45f7-b72e-00111a317cf9 tempest-VolumesListAdminTestJSON-1634641856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:11:06 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-63abc03a-9231-45f7-b72e-00111a317cf9 tempest-VolumesListAdminTestJSON-1634641856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:11:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-63abc03a-9231-45f7-b72e-00111a317cf9 tempest-VolumesListAdminTestJSON-1634641856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:11:06 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-63abc03a-9231-45f7-b72e-00111a317cf9 tempest-VolumesListAdminTestJSON-1634641856 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:11:06 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-63abc03a-9231-45f7-b72e-00111a317cf9 tempest-VolumesListAdminTestJSON-1634641856 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:11:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-63abc03a-9231-45f7-b72e-00111a317cf9 tempest-VolumesListAdminTestJSON-1634641856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b639f43e-e890-4252-bfc8-ceb8466027fc 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:06 devstack sudo[95759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b639f43e-e890-4252-bfc8-ceb8466027fc 1073741824
Nov 06 17:11:06 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:07 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-63abc03a-9231-45f7-b72e-00111a317cf9 tempest-VolumesListAdminTestJSON-1634641856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b639f43e-e890-4252-bfc8-ceb8466027fc 1073741824" returned: 0 in 0.611s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-63abc03a-9231-45f7-b72e-00111a317cf9 tempest-VolumesListAdminTestJSON-1634641856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b639f43e-e890-4252-bfc8-ceb8466027fc {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:07 devstack sudo[95765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b639f43e-e890-4252-bfc8-ceb8466027fc
Nov 06 17:11:07 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:07 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-63abc03a-9231-45f7-b72e-00111a317cf9 tempest-VolumesListAdminTestJSON-1634641856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b639f43e-e890-4252-bfc8-ceb8466027fc" returned: 0 in 0.283s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:07 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-63abc03a-9231-45f7-b72e-00111a317cf9 tempest-VolumesListAdminTestJSON-1634641856 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:11:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-63abc03a-9231-45f7-b72e-00111a317cf9 tempest-VolumesListAdminTestJSON-1634641856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:11:07 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-63abc03a-9231-45f7-b72e-00111a317cf9 tempest-VolumesListAdminTestJSON-1634641856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9841b188-7ea3-48e3-b8c0-bbfb78fd3edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b639f43e-e890-4252-bfc8-ceb8466027fc', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:07 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-63abc03a-9231-45f7-b72e-00111a317cf9 tempest-VolumesListAdminTestJSON-1634641856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09f35dff-0a1e-4886-8317-66ed48ff12ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:07 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-63abc03a-9231-45f7-b72e-00111a317cf9 tempest-VolumesListAdminTestJSON-1634641856 None] Volume volume-b639f43e-e890-4252-bfc8-ceb8466027fc (b639f43e-e890-4252-bfc8-ceb8466027fc): created successfully
Nov 06 17:11:07 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-63abc03a-9231-45f7-b72e-00111a317cf9 tempest-VolumesListAdminTestJSON-1634641856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09f35dff-0a1e-4886-8317-66ed48ff12ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:07 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-63abc03a-9231-45f7-b72e-00111a317cf9 tempest-VolumesListAdminTestJSON-1634641856 None] Flow 'volume_create_manager' (67fcc6be-4470-481b-82ac-c6ec45a91d1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:11:07 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-63abc03a-9231-45f7-b72e-00111a317cf9 tempest-VolumesListAdminTestJSON-1634641856 None] Created volume successfully.
Nov 06 17:11:09 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-384d71a7-e3fe-4ced-8702-2326f82147f5 tempest-VolumesListAdminTestJSON-1634641856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:11:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-384d71a7-e3fe-4ced-8702-2326f82147f5 tempest-VolumesListAdminTestJSON-1634641856 None] Flow 'volume_create_manager' (b04e2a1f-31c4-43a4-b17e-1b5ecc730a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:11:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-384d71a7-e3fe-4ced-8702-2326f82147f5 tempest-VolumesListAdminTestJSON-1634641856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba9e5199-d2a7-4d42-9952-b26f32fafb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-384d71a7-e3fe-4ced-8702-2326f82147f5 tempest-VolumesListAdminTestJSON-1634641856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba9e5199-d2a7-4d42-9952-b26f32fafb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-347151193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcecdd3f-41f1-472a-8995-2c18b2862047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb6794a980c242a1a7aaa0f06f9b4c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:11:09Z,use_quota=True,user_id='4b3790dd40fa49438e9c5d1c4d9ca371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-384d71a7-e3fe-4ced-8702-2326f82147f5 tempest-VolumesListAdminTestJSON-1634641856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e6927bd-44d3-4821-8dcb-152a0c6a4953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-384d71a7-e3fe-4ced-8702-2326f82147f5 tempest-VolumesListAdminTestJSON-1634641856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e6927bd-44d3-4821-8dcb-152a0c6a4953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-384d71a7-e3fe-4ced-8702-2326f82147f5 tempest-VolumesListAdminTestJSON-1634641856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c06e6ef-cb3b-48fd-87cf-155c4e548f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-384d71a7-e3fe-4ced-8702-2326f82147f5 tempest-VolumesListAdminTestJSON-1634641856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c06e6ef-cb3b-48fd-87cf-155c4e548f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcecdd3f-41f1-472a-8995-2c18b2862047', 'volume_name': 'volume-dcecdd3f-41f1-472a-8995-2c18b2862047', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-384d71a7-e3fe-4ced-8702-2326f82147f5 tempest-VolumesListAdminTestJSON-1634641856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a0a4120-68d5-48a1-8063-fd3a415dd0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-384d71a7-e3fe-4ced-8702-2326f82147f5 tempest-VolumesListAdminTestJSON-1634641856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a0a4120-68d5-48a1-8063-fd3a415dd0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-384d71a7-e3fe-4ced-8702-2326f82147f5 tempest-VolumesListAdminTestJSON-1634641856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f5fbe35-4b53-4db0-abdf-00f5e97200f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:09 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-384d71a7-e3fe-4ced-8702-2326f82147f5 tempest-VolumesListAdminTestJSON-1634641856 None] Volume dcecdd3f-41f1-472a-8995-2c18b2862047: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcecdd3f-41f1-472a-8995-2c18b2862047', 'volume_size': 1}
Nov 06 17:11:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-384d71a7-e3fe-4ced-8702-2326f82147f5 tempest-VolumesListAdminTestJSON-1634641856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:11:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-384d71a7-e3fe-4ced-8702-2326f82147f5 tempest-VolumesListAdminTestJSON-1634641856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:11:09 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-384d71a7-e3fe-4ced-8702-2326f82147f5 tempest-VolumesListAdminTestJSON-1634641856 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-347151193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcecdd3f-41f1-472a-8995-2c18b2862047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb6794a980c242a1a7aaa0f06f9b4c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:11:09Z,use_quota=True,user_id='4b3790dd40fa49438e9c5d1c4d9ca371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:11:09 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-384d71a7-e3fe-4ced-8702-2326f82147f5 tempest-VolumesListAdminTestJSON-1634641856 None] Creating volume dcecdd3f-41f1-472a-8995-2c18b2862047 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:11:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-384d71a7-e3fe-4ced-8702-2326f82147f5 tempest-VolumesListAdminTestJSON-1634641856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:11:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-384d71a7-e3fe-4ced-8702-2326f82147f5 tempest-VolumesListAdminTestJSON-1634641856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:11:09 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-384d71a7-e3fe-4ced-8702-2326f82147f5 tempest-VolumesListAdminTestJSON-1634641856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:11:09 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-384d71a7-e3fe-4ced-8702-2326f82147f5 tempest-VolumesListAdminTestJSON-1634641856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:11:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-384d71a7-e3fe-4ced-8702-2326f82147f5 tempest-VolumesListAdminTestJSON-1634641856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:11:09 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-384d71a7-e3fe-4ced-8702-2326f82147f5 tempest-VolumesListAdminTestJSON-1634641856 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:11:09 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-384d71a7-e3fe-4ced-8702-2326f82147f5 tempest-VolumesListAdminTestJSON-1634641856 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:11:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-384d71a7-e3fe-4ced-8702-2326f82147f5 tempest-VolumesListAdminTestJSON-1634641856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-dcecdd3f-41f1-472a-8995-2c18b2862047 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:09 devstack sudo[95768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-dcecdd3f-41f1-472a-8995-2c18b2862047 1073741824
Nov 06 17:11:09 devstack sudo[95768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:09 devstack sudo[95768]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-384d71a7-e3fe-4ced-8702-2326f82147f5 tempest-VolumesListAdminTestJSON-1634641856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-dcecdd3f-41f1-472a-8995-2c18b2862047 1073741824" returned: 0 in 0.655s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-384d71a7-e3fe-4ced-8702-2326f82147f5 tempest-VolumesListAdminTestJSON-1634641856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-dcecdd3f-41f1-472a-8995-2c18b2862047 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:10 devstack sudo[95774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-dcecdd3f-41f1-472a-8995-2c18b2862047
Nov 06 17:11:10 devstack sudo[95774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:10 devstack sudo[95774]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-384d71a7-e3fe-4ced-8702-2326f82147f5 tempest-VolumesListAdminTestJSON-1634641856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-dcecdd3f-41f1-472a-8995-2c18b2862047" returned: 0 in 0.360s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:10 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-384d71a7-e3fe-4ced-8702-2326f82147f5 tempest-VolumesListAdminTestJSON-1634641856 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:11:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-384d71a7-e3fe-4ced-8702-2326f82147f5 tempest-VolumesListAdminTestJSON-1634641856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:11:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-384d71a7-e3fe-4ced-8702-2326f82147f5 tempest-VolumesListAdminTestJSON-1634641856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f5fbe35-4b53-4db0-abdf-00f5e97200f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcecdd3f-41f1-472a-8995-2c18b2862047', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-384d71a7-e3fe-4ced-8702-2326f82147f5 tempest-VolumesListAdminTestJSON-1634641856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f66a436e-a6fd-49c0-a6b4-0dffcbc6bac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:10 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-384d71a7-e3fe-4ced-8702-2326f82147f5 tempest-VolumesListAdminTestJSON-1634641856 None] Volume volume-dcecdd3f-41f1-472a-8995-2c18b2862047 (dcecdd3f-41f1-472a-8995-2c18b2862047): created successfully
Nov 06 17:11:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-384d71a7-e3fe-4ced-8702-2326f82147f5 tempest-VolumesListAdminTestJSON-1634641856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f66a436e-a6fd-49c0-a6b4-0dffcbc6bac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-384d71a7-e3fe-4ced-8702-2326f82147f5 tempest-VolumesListAdminTestJSON-1634641856 None] Flow 'volume_create_manager' (b04e2a1f-31c4-43a4-b17e-1b5ecc730a21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:11:10 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-384d71a7-e3fe-4ced-8702-2326f82147f5 tempest-VolumesListAdminTestJSON-1634641856 None] Created volume successfully.
Nov 06 17:11:11 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e98b4c1-1fba-45a3-8d97-0b9cd7a424fb tempest-VolumesActionsTest-4139085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:11:11 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3e98b4c1-1fba-45a3-8d97-0b9cd7a424fb tempest-VolumesActionsTest-4139085 None] Flow 'volume_create_manager' (c43c862e-4f88-4cbc-892c-8c555ba0851f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:11:11 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3e98b4c1-1fba-45a3-8d97-0b9cd7a424fb tempest-VolumesActionsTest-4139085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bac2fa1-4ee0-4ef3-875d-b37477792596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:11 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3e98b4c1-1fba-45a3-8d97-0b9cd7a424fb tempest-VolumesActionsTest-4139085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bac2fa1-4ee0-4ef3-875d-b37477792596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2003761240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=784376fe-59d9-4d8b-9498-8bd17847925b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5284841fd3b40d3ae530cc76214422c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:11:12Z,use_quota=True,user_id='1995ec17469546f68fa09aefba6b8c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:11 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3e98b4c1-1fba-45a3-8d97-0b9cd7a424fb tempest-VolumesActionsTest-4139085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fef6b03-bbd0-438d-9127-6522eae2dec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:11 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3e98b4c1-1fba-45a3-8d97-0b9cd7a424fb tempest-VolumesActionsTest-4139085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fef6b03-bbd0-438d-9127-6522eae2dec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:11 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3e98b4c1-1fba-45a3-8d97-0b9cd7a424fb tempest-VolumesActionsTest-4139085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0991e5b-d1ef-4189-bb0b-6feac3ae7385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:11 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3e98b4c1-1fba-45a3-8d97-0b9cd7a424fb tempest-VolumesActionsTest-4139085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0991e5b-d1ef-4189-bb0b-6feac3ae7385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '784376fe-59d9-4d8b-9498-8bd17847925b', 'volume_name': 'volume-784376fe-59d9-4d8b-9498-8bd17847925b', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:11 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3e98b4c1-1fba-45a3-8d97-0b9cd7a424fb tempest-VolumesActionsTest-4139085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56ab7388-bf9c-4849-8b96-812987b0dd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:11 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3e98b4c1-1fba-45a3-8d97-0b9cd7a424fb tempest-VolumesActionsTest-4139085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56ab7388-bf9c-4849-8b96-812987b0dd04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:11 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3e98b4c1-1fba-45a3-8d97-0b9cd7a424fb tempest-VolumesActionsTest-4139085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26e15be1-3c85-4db4-85a7-ea222809c2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:11 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-3e98b4c1-1fba-45a3-8d97-0b9cd7a424fb tempest-VolumesActionsTest-4139085 None] Volume 784376fe-59d9-4d8b-9498-8bd17847925b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-784376fe-59d9-4d8b-9498-8bd17847925b', 'volume_size': 1}
Nov 06 17:11:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3e98b4c1-1fba-45a3-8d97-0b9cd7a424fb tempest-VolumesActionsTest-4139085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:11:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3e98b4c1-1fba-45a3-8d97-0b9cd7a424fb tempest-VolumesActionsTest-4139085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:11:11 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3e98b4c1-1fba-45a3-8d97-0b9cd7a424fb tempest-VolumesActionsTest-4139085 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2003761240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=784376fe-59d9-4d8b-9498-8bd17847925b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5284841fd3b40d3ae530cc76214422c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:11:12Z,use_quota=True,user_id='1995ec17469546f68fa09aefba6b8c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:11:11 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-3e98b4c1-1fba-45a3-8d97-0b9cd7a424fb tempest-VolumesActionsTest-4139085 None] Creating volume 784376fe-59d9-4d8b-9498-8bd17847925b {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:11:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3e98b4c1-1fba-45a3-8d97-0b9cd7a424fb tempest-VolumesActionsTest-4139085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:11:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3e98b4c1-1fba-45a3-8d97-0b9cd7a424fb tempest-VolumesActionsTest-4139085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:11:11 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3e98b4c1-1fba-45a3-8d97-0b9cd7a424fb tempest-VolumesActionsTest-4139085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:11:11 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3e98b4c1-1fba-45a3-8d97-0b9cd7a424fb tempest-VolumesActionsTest-4139085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:11:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3e98b4c1-1fba-45a3-8d97-0b9cd7a424fb tempest-VolumesActionsTest-4139085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:11:11 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3e98b4c1-1fba-45a3-8d97-0b9cd7a424fb tempest-VolumesActionsTest-4139085 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:11:11 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-3e98b4c1-1fba-45a3-8d97-0b9cd7a424fb tempest-VolumesActionsTest-4139085 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:11:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3e98b4c1-1fba-45a3-8d97-0b9cd7a424fb tempest-VolumesActionsTest-4139085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-784376fe-59d9-4d8b-9498-8bd17847925b 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:11 devstack sudo[95779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-784376fe-59d9-4d8b-9498-8bd17847925b 1073741824
Nov 06 17:11:11 devstack sudo[95779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:12 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc7b5ad3-ad5c-47c6-919f-aca815dfcbfd tempest-VolumesListAdminTestJSON-1327587041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:11:12 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cc7b5ad3-ad5c-47c6-919f-aca815dfcbfd tempest-VolumesListAdminTestJSON-1327587041 None] Flow 'volume_create_manager' (93f1147a-045e-4beb-a20f-7729ac2f667f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:11:12 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cc7b5ad3-ad5c-47c6-919f-aca815dfcbfd tempest-VolumesListAdminTestJSON-1327587041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d2f9d03-f10a-4266-af47-47c5776091ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:12 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cc7b5ad3-ad5c-47c6-919f-aca815dfcbfd tempest-VolumesListAdminTestJSON-1327587041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d2f9d03-f10a-4266-af47-47c5776091ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c859333-0128-4cc5-8280-ca445285f4d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d567d8f00c645c6a5c5ba8d6e14bc8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:11:12Z,use_quota=True,user_id='c47317017d824e37a862db6ee93e8d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:12 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cc7b5ad3-ad5c-47c6-919f-aca815dfcbfd tempest-VolumesListAdminTestJSON-1327587041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cf2c165-4e10-4324-b554-42f2e8cb29de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:12 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cc7b5ad3-ad5c-47c6-919f-aca815dfcbfd tempest-VolumesListAdminTestJSON-1327587041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cf2c165-4e10-4324-b554-42f2e8cb29de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:12 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cc7b5ad3-ad5c-47c6-919f-aca815dfcbfd tempest-VolumesListAdminTestJSON-1327587041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16048da1-9a9f-46d5-a9d9-06cea24c0bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:12 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cc7b5ad3-ad5c-47c6-919f-aca815dfcbfd tempest-VolumesListAdminTestJSON-1327587041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16048da1-9a9f-46d5-a9d9-06cea24c0bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c859333-0128-4cc5-8280-ca445285f4d4', 'volume_name': 'volume-8c859333-0128-4cc5-8280-ca445285f4d4', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:12 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cc7b5ad3-ad5c-47c6-919f-aca815dfcbfd tempest-VolumesListAdminTestJSON-1327587041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e31b0280-32de-4288-906a-7e912c5d8450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:12 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cc7b5ad3-ad5c-47c6-919f-aca815dfcbfd tempest-VolumesListAdminTestJSON-1327587041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e31b0280-32de-4288-906a-7e912c5d8450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:12 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cc7b5ad3-ad5c-47c6-919f-aca815dfcbfd tempest-VolumesListAdminTestJSON-1327587041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3419b0cb-d2a6-4253-971d-6d5d144e756a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:12 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-cc7b5ad3-ad5c-47c6-919f-aca815dfcbfd tempest-VolumesListAdminTestJSON-1327587041 None] Volume 8c859333-0128-4cc5-8280-ca445285f4d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c859333-0128-4cc5-8280-ca445285f4d4', 'volume_size': 1}
Nov 06 17:11:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-cc7b5ad3-ad5c-47c6-919f-aca815dfcbfd tempest-VolumesListAdminTestJSON-1327587041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:11:12 devstack sudo[95779]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3e98b4c1-1fba-45a3-8d97-0b9cd7a424fb tempest-VolumesActionsTest-4139085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-784376fe-59d9-4d8b-9498-8bd17847925b 1073741824" returned: 0 in 0.602s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3e98b4c1-1fba-45a3-8d97-0b9cd7a424fb tempest-VolumesActionsTest-4139085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-784376fe-59d9-4d8b-9498-8bd17847925b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:12 devstack sudo[95784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-784376fe-59d9-4d8b-9498-8bd17847925b
Nov 06 17:11:12 devstack sudo[95784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:12 devstack sudo[95784]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3e98b4c1-1fba-45a3-8d97-0b9cd7a424fb tempest-VolumesActionsTest-4139085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-784376fe-59d9-4d8b-9498-8bd17847925b" returned: 0 in 0.273s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:12 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3e98b4c1-1fba-45a3-8d97-0b9cd7a424fb tempest-VolumesActionsTest-4139085 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:11:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3e98b4c1-1fba-45a3-8d97-0b9cd7a424fb tempest-VolumesActionsTest-4139085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:11:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-cc7b5ad3-ad5c-47c6-919f-aca815dfcbfd tempest-VolumesListAdminTestJSON-1327587041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.361s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:11:12 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-cc7b5ad3-ad5c-47c6-919f-aca815dfcbfd tempest-VolumesListAdminTestJSON-1327587041 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c859333-0128-4cc5-8280-ca445285f4d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d567d8f00c645c6a5c5ba8d6e14bc8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:11:12Z,use_quota=True,user_id='c47317017d824e37a862db6ee93e8d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:11:12 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-cc7b5ad3-ad5c-47c6-919f-aca815dfcbfd tempest-VolumesListAdminTestJSON-1327587041 None] Creating volume 8c859333-0128-4cc5-8280-ca445285f4d4 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:11:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-cc7b5ad3-ad5c-47c6-919f-aca815dfcbfd tempest-VolumesListAdminTestJSON-1327587041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:11:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-cc7b5ad3-ad5c-47c6-919f-aca815dfcbfd tempest-VolumesListAdminTestJSON-1327587041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:11:12 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-cc7b5ad3-ad5c-47c6-919f-aca815dfcbfd tempest-VolumesListAdminTestJSON-1327587041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:11:12 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-cc7b5ad3-ad5c-47c6-919f-aca815dfcbfd tempest-VolumesListAdminTestJSON-1327587041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:11:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-cc7b5ad3-ad5c-47c6-919f-aca815dfcbfd tempest-VolumesListAdminTestJSON-1327587041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:11:12 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-cc7b5ad3-ad5c-47c6-919f-aca815dfcbfd tempest-VolumesListAdminTestJSON-1327587041 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:11:12 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-cc7b5ad3-ad5c-47c6-919f-aca815dfcbfd tempest-VolumesListAdminTestJSON-1327587041 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:11:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cc7b5ad3-ad5c-47c6-919f-aca815dfcbfd tempest-VolumesListAdminTestJSON-1327587041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8c859333-0128-4cc5-8280-ca445285f4d4 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:12 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3e98b4c1-1fba-45a3-8d97-0b9cd7a424fb tempest-VolumesActionsTest-4139085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26e15be1-3c85-4db4-85a7-ea222809c2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-784376fe-59d9-4d8b-9498-8bd17847925b', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:12 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3e98b4c1-1fba-45a3-8d97-0b9cd7a424fb tempest-VolumesActionsTest-4139085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cefc93c-ac93-414c-9177-72397ccf103c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:12 devstack sudo[95787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8c859333-0128-4cc5-8280-ca445285f4d4 1073741824
Nov 06 17:11:12 devstack sudo[95787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:12 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-3e98b4c1-1fba-45a3-8d97-0b9cd7a424fb tempest-VolumesActionsTest-4139085 None] Volume volume-784376fe-59d9-4d8b-9498-8bd17847925b (784376fe-59d9-4d8b-9498-8bd17847925b): created successfully
Nov 06 17:11:12 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3e98b4c1-1fba-45a3-8d97-0b9cd7a424fb tempest-VolumesActionsTest-4139085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cefc93c-ac93-414c-9177-72397ccf103c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:12 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3e98b4c1-1fba-45a3-8d97-0b9cd7a424fb tempest-VolumesActionsTest-4139085 None] Flow 'volume_create_manager' (c43c862e-4f88-4cbc-892c-8c555ba0851f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:11:12 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-3e98b4c1-1fba-45a3-8d97-0b9cd7a424fb tempest-VolumesActionsTest-4139085 None] Created volume successfully.
Nov 06 17:11:13 devstack sudo[95787]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cc7b5ad3-ad5c-47c6-919f-aca815dfcbfd tempest-VolumesListAdminTestJSON-1327587041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8c859333-0128-4cc5-8280-ca445285f4d4 1073741824" returned: 0 in 0.616s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cc7b5ad3-ad5c-47c6-919f-aca815dfcbfd tempest-VolumesListAdminTestJSON-1327587041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8c859333-0128-4cc5-8280-ca445285f4d4 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:13 devstack sudo[95792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8c859333-0128-4cc5-8280-ca445285f4d4
Nov 06 17:11:13 devstack sudo[95792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:13 devstack sudo[95792]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cc7b5ad3-ad5c-47c6-919f-aca815dfcbfd tempest-VolumesListAdminTestJSON-1327587041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8c859333-0128-4cc5-8280-ca445285f4d4" returned: 0 in 0.353s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:13 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-cc7b5ad3-ad5c-47c6-919f-aca815dfcbfd tempest-VolumesListAdminTestJSON-1327587041 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:11:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-cc7b5ad3-ad5c-47c6-919f-aca815dfcbfd tempest-VolumesListAdminTestJSON-1327587041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:11:13 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cc7b5ad3-ad5c-47c6-919f-aca815dfcbfd tempest-VolumesListAdminTestJSON-1327587041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3419b0cb-d2a6-4253-971d-6d5d144e756a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c859333-0128-4cc5-8280-ca445285f4d4', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:13 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cc7b5ad3-ad5c-47c6-919f-aca815dfcbfd tempest-VolumesListAdminTestJSON-1327587041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c252f547-0bb1-478c-90fc-ca22d2811198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:13 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-cc7b5ad3-ad5c-47c6-919f-aca815dfcbfd tempest-VolumesListAdminTestJSON-1327587041 None] Volume volume-8c859333-0128-4cc5-8280-ca445285f4d4 (8c859333-0128-4cc5-8280-ca445285f4d4): created successfully
Nov 06 17:11:13 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cc7b5ad3-ad5c-47c6-919f-aca815dfcbfd tempest-VolumesListAdminTestJSON-1327587041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c252f547-0bb1-478c-90fc-ca22d2811198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:13 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cc7b5ad3-ad5c-47c6-919f-aca815dfcbfd tempest-VolumesListAdminTestJSON-1327587041 None] Flow 'volume_create_manager' (93f1147a-045e-4beb-a20f-7729ac2f667f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:11:13 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-cc7b5ad3-ad5c-47c6-919f-aca815dfcbfd tempest-VolumesListAdminTestJSON-1327587041 None] Created volume successfully.
Nov 06 17:11:14 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bae69281-4445-4f79-9b7f-dbfed19a5026 tempest-VolumesListAdminTestJSON-1327587041 None] Acquiring lock "cinder-8c859333-0128-4cc5-8280-ca445285f4d4-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:11:14 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bae69281-4445-4f79-9b7f-dbfed19a5026 tempest-VolumesListAdminTestJSON-1327587041 None] Lock "cinder-8c859333-0128-4cc5-8280-ca445285f4d4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:11:14 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bae69281-4445-4f79-9b7f-dbfed19a5026 tempest-VolumesListAdminTestJSON-1327587041 None] Acquiring lock "cinder-quobyte-8c859333-0128-4cc5-8280-ca445285f4d4" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:11:14 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bae69281-4445-4f79-9b7f-dbfed19a5026 tempest-VolumesListAdminTestJSON-1327587041 None] Lock "cinder-quobyte-8c859333-0128-4cc5-8280-ca445285f4d4" acquired by "delete_volume" :: waited 0.022s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:11:14 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e91a502-1528-4dd7-ac4e-a97c8114c6b4]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:11:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bae69281-4445-4f79-9b7f-dbfed19a5026 tempest-VolumesListAdminTestJSON-1327587041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8c859333-0128-4cc5-8280-ca445285f4d4 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:14 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-688eaa83-792c-4e74-8126-1df931c1f9f4 tempest-VolumesListAdminTestJSON-1634641856 None] Acquiring lock "cinder-dcecdd3f-41f1-472a-8995-2c18b2862047-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:11:14 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-688eaa83-792c-4e74-8126-1df931c1f9f4 tempest-VolumesListAdminTestJSON-1634641856 None] Lock "cinder-dcecdd3f-41f1-472a-8995-2c18b2862047-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:11:14 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-688eaa83-792c-4e74-8126-1df931c1f9f4 tempest-VolumesListAdminTestJSON-1634641856 None] Acquiring lock "cinder-quobyte-dcecdd3f-41f1-472a-8995-2c18b2862047" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:11:14 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-688eaa83-792c-4e74-8126-1df931c1f9f4 tempest-VolumesListAdminTestJSON-1634641856 None] Lock "cinder-quobyte-dcecdd3f-41f1-472a-8995-2c18b2862047" acquired by "delete_volume" :: waited 0.027s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:11:14 devstack sudo[95795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8c859333-0128-4cc5-8280-ca445285f4d4
Nov 06 17:11:14 devstack sudo[95795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:14 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[085dee72-3677-4125-a6ce-c24f2f5e6765]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:11:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-688eaa83-792c-4e74-8126-1df931c1f9f4 tempest-VolumesListAdminTestJSON-1634641856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-dcecdd3f-41f1-472a-8995-2c18b2862047 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:14 devstack sudo[95797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-dcecdd3f-41f1-472a-8995-2c18b2862047
Nov 06 17:11:14 devstack sudo[95797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:15 devstack sudo[95795]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bae69281-4445-4f79-9b7f-dbfed19a5026 tempest-VolumesListAdminTestJSON-1327587041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8c859333-0128-4cc5-8280-ca445285f4d4" returned: 0 in 0.613s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bae69281-4445-4f79-9b7f-dbfed19a5026 tempest-VolumesListAdminTestJSON-1327587041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8c859333-0128-4cc5-8280-ca445285f4d4 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:15 devstack sudo[95803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8c859333-0128-4cc5-8280-ca445285f4d4
Nov 06 17:11:15 devstack sudo[95803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:15 devstack sudo[95797]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-688eaa83-792c-4e74-8126-1df931c1f9f4 tempest-VolumesListAdminTestJSON-1634641856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-dcecdd3f-41f1-472a-8995-2c18b2862047" returned: 0 in 0.600s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-688eaa83-792c-4e74-8126-1df931c1f9f4 tempest-VolumesListAdminTestJSON-1634641856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-dcecdd3f-41f1-472a-8995-2c18b2862047 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:15 devstack sudo[95810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-dcecdd3f-41f1-472a-8995-2c18b2862047
Nov 06 17:11:15 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:15 devstack sudo[95803]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bae69281-4445-4f79-9b7f-dbfed19a5026 tempest-VolumesListAdminTestJSON-1327587041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8c859333-0128-4cc5-8280-ca445285f4d4" returned: 0 in 0.354s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:15 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bae69281-4445-4f79-9b7f-dbfed19a5026 tempest-VolumesListAdminTestJSON-1327587041 None] Lock "cinder-quobyte-8c859333-0128-4cc5-8280-ca445285f4d4" released by "delete_volume" :: held 1.034s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:11:15 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-bae69281-4445-4f79-9b7f-dbfed19a5026 tempest-VolumesListAdminTestJSON-1327587041 None] Created reservations ['b32784e0-0def-4eb5-be35-41d5d97ff83e', '0fe79876-7a78-43ea-bd79-36596358e2d4', '43739b65-aab5-4126-9e35-bec40b5a091d', '39e373f0-60e6-43ce-a623-db716b13a1e4'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:11:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bae69281-4445-4f79-9b7f-dbfed19a5026 tempest-VolumesListAdminTestJSON-1327587041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:11:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bae69281-4445-4f79-9b7f-dbfed19a5026 tempest-VolumesListAdminTestJSON-1327587041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:11:15 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bae69281-4445-4f79-9b7f-dbfed19a5026 tempest-VolumesListAdminTestJSON-1327587041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:11:15 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:15 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bae69281-4445-4f79-9b7f-dbfed19a5026 tempest-VolumesListAdminTestJSON-1327587041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:11:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bae69281-4445-4f79-9b7f-dbfed19a5026 tempest-VolumesListAdminTestJSON-1327587041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:11:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bae69281-4445-4f79-9b7f-dbfed19a5026 tempest-VolumesListAdminTestJSON-1327587041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-688eaa83-792c-4e74-8126-1df931c1f9f4 tempest-VolumesListAdminTestJSON-1634641856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-dcecdd3f-41f1-472a-8995-2c18b2862047" returned: 0 in 0.408s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:15 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-688eaa83-792c-4e74-8126-1df931c1f9f4 tempest-VolumesListAdminTestJSON-1634641856 None] Lock "cinder-quobyte-dcecdd3f-41f1-472a-8995-2c18b2862047" released by "delete_volume" :: held 1.094s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:11:15 devstack sudo[95814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:11:15 devstack sudo[95814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:15 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-688eaa83-792c-4e74-8126-1df931c1f9f4 tempest-VolumesListAdminTestJSON-1634641856 None] Created reservations ['126c090a-380a-4446-b59b-6c638db8b64a', 'b1d8a385-101b-42ee-a85d-021a7e9e3855', 'aac8e505-7030-4973-afb5-424ab24b6e03', '61b40880-244e-4714-ac3e-67392c4e3d9e'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:11:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-688eaa83-792c-4e74-8126-1df931c1f9f4 tempest-VolumesListAdminTestJSON-1634641856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:11:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-688eaa83-792c-4e74-8126-1df931c1f9f4 tempest-VolumesListAdminTestJSON-1634641856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:11:16 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-688eaa83-792c-4e74-8126-1df931c1f9f4 tempest-VolumesListAdminTestJSON-1634641856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:11:16 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-688eaa83-792c-4e74-8126-1df931c1f9f4 tempest-VolumesListAdminTestJSON-1634641856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:11:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-688eaa83-792c-4e74-8126-1df931c1f9f4 tempest-VolumesListAdminTestJSON-1634641856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:11:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-688eaa83-792c-4e74-8126-1df931c1f9f4 tempest-VolumesListAdminTestJSON-1634641856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:16 devstack sudo[95816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:11:16 devstack sudo[95816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:16 devstack sudo[95814]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bae69281-4445-4f79-9b7f-dbfed19a5026 tempest-VolumesListAdminTestJSON-1327587041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.365s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:16 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-bae69281-4445-4f79-9b7f-dbfed19a5026 tempest-VolumesListAdminTestJSON-1327587041 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:11:16 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-bae69281-4445-4f79-9b7f-dbfed19a5026 tempest-VolumesListAdminTestJSON-1327587041 None] Deleted volume successfully.
Nov 06 17:11:16 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bae69281-4445-4f79-9b7f-dbfed19a5026 tempest-VolumesListAdminTestJSON-1327587041 None] Lock "cinder-8c859333-0128-4cc5-8280-ca445285f4d4-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:11:16 devstack sudo[95816]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-688eaa83-792c-4e74-8126-1df931c1f9f4 tempest-VolumesListAdminTestJSON-1634641856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.356s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:16 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-688eaa83-792c-4e74-8126-1df931c1f9f4 tempest-VolumesListAdminTestJSON-1634641856 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:11:16 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-688eaa83-792c-4e74-8126-1df931c1f9f4 tempest-VolumesListAdminTestJSON-1634641856 None] Deleted volume successfully.
Nov 06 17:11:16 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-688eaa83-792c-4e74-8126-1df931c1f9f4 tempest-VolumesListAdminTestJSON-1634641856 None] Lock "cinder-dcecdd3f-41f1-472a-8995-2c18b2862047-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:11:17 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7e938aa4-53c7-4a09-8a4d-5962791b2b7b tempest-VolumesListAdminTestJSON-1634641856 None] Acquiring lock "cinder-b639f43e-e890-4252-bfc8-ceb8466027fc-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:11:17 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7e938aa4-53c7-4a09-8a4d-5962791b2b7b tempest-VolumesListAdminTestJSON-1634641856 None] Lock "cinder-b639f43e-e890-4252-bfc8-ceb8466027fc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:11:17 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7e938aa4-53c7-4a09-8a4d-5962791b2b7b tempest-VolumesListAdminTestJSON-1634641856 None] Acquiring lock "cinder-quobyte-b639f43e-e890-4252-bfc8-ceb8466027fc" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:11:17 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7e938aa4-53c7-4a09-8a4d-5962791b2b7b tempest-VolumesListAdminTestJSON-1634641856 None] Lock "cinder-quobyte-b639f43e-e890-4252-bfc8-ceb8466027fc" acquired by "delete_volume" :: waited 0.030s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:11:17 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9bb8c1-74c2-4abc-8af7-ccc174860a6a]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:11:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7e938aa4-53c7-4a09-8a4d-5962791b2b7b tempest-VolumesListAdminTestJSON-1634641856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b639f43e-e890-4252-bfc8-ceb8466027fc {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:17 devstack sudo[95820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b639f43e-e890-4252-bfc8-ceb8466027fc
Nov 06 17:11:17 devstack sudo[95820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:17 devstack sudo[95820]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7e938aa4-53c7-4a09-8a4d-5962791b2b7b tempest-VolumesListAdminTestJSON-1634641856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b639f43e-e890-4252-bfc8-ceb8466027fc" returned: 0 in 0.543s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7e938aa4-53c7-4a09-8a4d-5962791b2b7b tempest-VolumesListAdminTestJSON-1634641856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b639f43e-e890-4252-bfc8-ceb8466027fc {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:17 devstack sudo[95834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b639f43e-e890-4252-bfc8-ceb8466027fc
Nov 06 17:11:17 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:18 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7e938aa4-53c7-4a09-8a4d-5962791b2b7b tempest-VolumesListAdminTestJSON-1634641856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b639f43e-e890-4252-bfc8-ceb8466027fc" returned: 0 in 0.322s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:18 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7e938aa4-53c7-4a09-8a4d-5962791b2b7b tempest-VolumesListAdminTestJSON-1634641856 None] Lock "cinder-quobyte-b639f43e-e890-4252-bfc8-ceb8466027fc" released by "delete_volume" :: held 0.945s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:11:18 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-7e938aa4-53c7-4a09-8a4d-5962791b2b7b tempest-VolumesListAdminTestJSON-1634641856 None] Created reservations ['59c57ef2-46df-4abf-9bfb-3c6496ddb076', '664dac4a-bce7-4ed0-bad5-65315f2caa2d', '839a6028-26e8-4edd-9a83-b5008a579a63', '83632647-8469-4d96-8c23-40854cf5e754'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:11:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7e938aa4-53c7-4a09-8a4d-5962791b2b7b tempest-VolumesListAdminTestJSON-1634641856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:11:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7e938aa4-53c7-4a09-8a4d-5962791b2b7b tempest-VolumesListAdminTestJSON-1634641856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:11:18 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7e938aa4-53c7-4a09-8a4d-5962791b2b7b tempest-VolumesListAdminTestJSON-1634641856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:11:18 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7e938aa4-53c7-4a09-8a4d-5962791b2b7b tempest-VolumesListAdminTestJSON-1634641856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:11:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7e938aa4-53c7-4a09-8a4d-5962791b2b7b tempest-VolumesListAdminTestJSON-1634641856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:11:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7e938aa4-53c7-4a09-8a4d-5962791b2b7b tempest-VolumesListAdminTestJSON-1634641856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:18 devstack sudo[95843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:11:18 devstack sudo[95843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:18 devstack sudo[95843]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7e938aa4-53c7-4a09-8a4d-5962791b2b7b tempest-VolumesListAdminTestJSON-1634641856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.296s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:18 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-7e938aa4-53c7-4a09-8a4d-5962791b2b7b tempest-VolumesListAdminTestJSON-1634641856 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:11:18 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-7e938aa4-53c7-4a09-8a4d-5962791b2b7b tempest-VolumesListAdminTestJSON-1634641856 None] Deleted volume successfully.
Nov 06 17:11:18 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7e938aa4-53c7-4a09-8a4d-5962791b2b7b tempest-VolumesListAdminTestJSON-1634641856 None] Lock "cinder-b639f43e-e890-4252-bfc8-ceb8466027fc-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:11:19 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-89dab8ac-1c26-46a7-a97f-20a5139b75c5 tempest-VolumesListAdminTestJSON-1634641856 None] Acquiring lock "cinder-54715f23-bef0-4d43-a8d5-e76aa507fd3c-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:11:19 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-89dab8ac-1c26-46a7-a97f-20a5139b75c5 tempest-VolumesListAdminTestJSON-1634641856 None] Lock "cinder-54715f23-bef0-4d43-a8d5-e76aa507fd3c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:11:19 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-89dab8ac-1c26-46a7-a97f-20a5139b75c5 tempest-VolumesListAdminTestJSON-1634641856 None] Acquiring lock "cinder-quobyte-54715f23-bef0-4d43-a8d5-e76aa507fd3c" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:11:19 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-89dab8ac-1c26-46a7-a97f-20a5139b75c5 tempest-VolumesListAdminTestJSON-1634641856 None] Lock "cinder-quobyte-54715f23-bef0-4d43-a8d5-e76aa507fd3c" acquired by "delete_volume" :: waited 0.019s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:11:19 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[526cbdfd-3065-4016-aa7f-3b3f3d13aa20]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:11:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-89dab8ac-1c26-46a7-a97f-20a5139b75c5 tempest-VolumesListAdminTestJSON-1634641856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-54715f23-bef0-4d43-a8d5-e76aa507fd3c {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:19 devstack sudo[95847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-54715f23-bef0-4d43-a8d5-e76aa507fd3c
Nov 06 17:11:19 devstack sudo[95847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:20 devstack sudo[95847]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-89dab8ac-1c26-46a7-a97f-20a5139b75c5 tempest-VolumesListAdminTestJSON-1634641856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-54715f23-bef0-4d43-a8d5-e76aa507fd3c" returned: 0 in 0.463s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-89dab8ac-1c26-46a7-a97f-20a5139b75c5 tempest-VolumesListAdminTestJSON-1634641856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-54715f23-bef0-4d43-a8d5-e76aa507fd3c {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:20 devstack sudo[95852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-54715f23-bef0-4d43-a8d5-e76aa507fd3c
Nov 06 17:11:20 devstack sudo[95852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:20 devstack sudo[95852]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-89dab8ac-1c26-46a7-a97f-20a5139b75c5 tempest-VolumesListAdminTestJSON-1634641856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-54715f23-bef0-4d43-a8d5-e76aa507fd3c" returned: 0 in 0.342s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:20 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-89dab8ac-1c26-46a7-a97f-20a5139b75c5 tempest-VolumesListAdminTestJSON-1634641856 None] Lock "cinder-quobyte-54715f23-bef0-4d43-a8d5-e76aa507fd3c" released by "delete_volume" :: held 0.885s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:11:20 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-89dab8ac-1c26-46a7-a97f-20a5139b75c5 tempest-VolumesListAdminTestJSON-1634641856 None] Created reservations ['39734e1a-e310-4fae-97d6-fa046ffe3655', '609846dd-5098-41a1-bec1-74544bbe6ddb', '5d0c4f75-8339-4e1e-8b2f-a9cccbc10e6d', '12ee3042-827f-4ef8-9acc-da2bde43711d'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:11:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-89dab8ac-1c26-46a7-a97f-20a5139b75c5 tempest-VolumesListAdminTestJSON-1634641856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:11:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-89dab8ac-1c26-46a7-a97f-20a5139b75c5 tempest-VolumesListAdminTestJSON-1634641856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:11:20 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-89dab8ac-1c26-46a7-a97f-20a5139b75c5 tempest-VolumesListAdminTestJSON-1634641856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:11:20 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-89dab8ac-1c26-46a7-a97f-20a5139b75c5 tempest-VolumesListAdminTestJSON-1634641856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:11:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-89dab8ac-1c26-46a7-a97f-20a5139b75c5 tempest-VolumesListAdminTestJSON-1634641856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:11:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-89dab8ac-1c26-46a7-a97f-20a5139b75c5 tempest-VolumesListAdminTestJSON-1634641856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:21 devstack sudo[95866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:11:21 devstack sudo[95866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:21 devstack sudo[95866]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-89dab8ac-1c26-46a7-a97f-20a5139b75c5 tempest-VolumesListAdminTestJSON-1634641856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.592s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:21 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-89dab8ac-1c26-46a7-a97f-20a5139b75c5 tempest-VolumesListAdminTestJSON-1634641856 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:11:21 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-89dab8ac-1c26-46a7-a97f-20a5139b75c5 tempest-VolumesListAdminTestJSON-1634641856 None] Deleted volume successfully.
Nov 06 17:11:21 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-89dab8ac-1c26-46a7-a97f-20a5139b75c5 tempest-VolumesListAdminTestJSON-1634641856 None] Lock "cinder-54715f23-bef0-4d43-a8d5-e76aa507fd3c-delete_volume" released by "delete_volume" :: held 1.941s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:11:24 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-03fce035-06a7-42e9-bbd8-6e8a4c6f2899 tempest-VolumesActionsTest-4139085 None] Acquiring lock "cinder-784376fe-59d9-4d8b-9498-8bd17847925b" by "attach_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:11:24 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-03fce035-06a7-42e9-bbd8-6e8a4c6f2899 tempest-VolumesActionsTest-4139085 None] Lock "cinder-784376fe-59d9-4d8b-9498-8bd17847925b" acquired by "attach_volume" :: waited 0.033s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:11:24 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-03fce035-06a7-42e9-bbd8-6e8a4c6f2899 tempest-VolumesActionsTest-4139085 None] Attaching volume 784376fe-59d9-4d8b-9498-8bd17847925b to instance 6a5476a1-8439-4d7d-ab4a-645c3855b97b at mountpoint /dev/vdb on host None.
Nov 06 17:11:24 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-03fce035-06a7-42e9-bbd8-6e8a4c6f2899 tempest-VolumesActionsTest-4139085 None] Attach volume completed successfully.
Nov 06 17:11:24 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-03fce035-06a7-42e9-bbd8-6e8a4c6f2899 tempest-VolumesActionsTest-4139085 None] Lock "cinder-784376fe-59d9-4d8b-9498-8bd17847925b" released by "attach_volume" :: held 0.171s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:11:24 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ef90f4a1-015f-4b23-8302-cab9eebae7f0 tempest-VolumesActionsTest-4139085 None] Acquiring lock "cinder-784376fe-59d9-4d8b-9498-8bd17847925b-detach_volume" by "detach_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:11:25 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ef90f4a1-015f-4b23-8302-cab9eebae7f0 tempest-VolumesActionsTest-4139085 None] Lock "cinder-784376fe-59d9-4d8b-9498-8bd17847925b-detach_volume" acquired by "detach_volume" :: waited 0.053s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:11:25 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-ef90f4a1-015f-4b23-8302-cab9eebae7f0 tempest-VolumesActionsTest-4139085 None] Detaching volume 784376fe-59d9-4d8b-9498-8bd17847925b from instance 6a5476a1-8439-4d7d-ab4a-645c3855b97b.
Nov 06 17:11:25 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-ef90f4a1-015f-4b23-8302-cab9eebae7f0 tempest-VolumesActionsTest-4139085 None] Detach volume completed successfully.
Nov 06 17:11:25 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ef90f4a1-015f-4b23-8302-cab9eebae7f0 tempest-VolumesActionsTest-4139085 None] Lock "cinder-784376fe-59d9-4d8b-9498-8bd17847925b-detach_volume" released by "detach_volume" :: held 0.105s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:11:31 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cf0279d-ff49-47c9-b1fa-a705b2900aae tempest-SnapshotMetadataTestJSON-183063638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:11:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8cf0279d-ff49-47c9-b1fa-a705b2900aae tempest-SnapshotMetadataTestJSON-183063638 None] Flow 'volume_create_manager' (5ca46158-8871-4304-bcf6-21ba9e348964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:11:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8cf0279d-ff49-47c9-b1fa-a705b2900aae tempest-SnapshotMetadataTestJSON-183063638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ebd5277-f58d-4e6c-98c4-1cbe2c9358a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8cf0279d-ff49-47c9-b1fa-a705b2900aae tempest-SnapshotMetadataTestJSON-183063638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ebd5277-f58d-4e6c-98c4-1cbe2c9358a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-929302491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6877043-9a5b-4c65-bd28-bab6f1e7e382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='519ff3a1598342cc8c44427fba2e5305',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:11:32Z,use_quota=True,user_id='86e8d1cf22854dc485f6669edc4ed12b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8cf0279d-ff49-47c9-b1fa-a705b2900aae tempest-SnapshotMetadataTestJSON-183063638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5ab5ce6-d9f8-420b-a299-3504dfc58bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8cf0279d-ff49-47c9-b1fa-a705b2900aae tempest-SnapshotMetadataTestJSON-183063638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5ab5ce6-d9f8-420b-a299-3504dfc58bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8cf0279d-ff49-47c9-b1fa-a705b2900aae tempest-SnapshotMetadataTestJSON-183063638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12eff06c-05ee-47bf-87b6-b0b019e247c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8cf0279d-ff49-47c9-b1fa-a705b2900aae tempest-SnapshotMetadataTestJSON-183063638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12eff06c-05ee-47bf-87b6-b0b019e247c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6877043-9a5b-4c65-bd28-bab6f1e7e382', 'volume_name': 'volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8cf0279d-ff49-47c9-b1fa-a705b2900aae tempest-SnapshotMetadataTestJSON-183063638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b300ca-44fa-4be6-a4e1-b06eb9092493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8cf0279d-ff49-47c9-b1fa-a705b2900aae tempest-SnapshotMetadataTestJSON-183063638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b300ca-44fa-4be6-a4e1-b06eb9092493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8cf0279d-ff49-47c9-b1fa-a705b2900aae tempest-SnapshotMetadataTestJSON-183063638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3710995f-a344-42d0-9988-ca2b031b0c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:31 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-8cf0279d-ff49-47c9-b1fa-a705b2900aae tempest-SnapshotMetadataTestJSON-183063638 None] Volume e6877043-9a5b-4c65-bd28-bab6f1e7e382: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382', 'volume_size': 1}
Nov 06 17:11:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-8cf0279d-ff49-47c9-b1fa-a705b2900aae tempest-SnapshotMetadataTestJSON-183063638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:11:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-8cf0279d-ff49-47c9-b1fa-a705b2900aae tempest-SnapshotMetadataTestJSON-183063638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:11:31 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-8cf0279d-ff49-47c9-b1fa-a705b2900aae tempest-SnapshotMetadataTestJSON-183063638 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-929302491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6877043-9a5b-4c65-bd28-bab6f1e7e382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='519ff3a1598342cc8c44427fba2e5305',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:11:32Z,use_quota=True,user_id='86e8d1cf22854dc485f6669edc4ed12b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:11:31 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-8cf0279d-ff49-47c9-b1fa-a705b2900aae tempest-SnapshotMetadataTestJSON-183063638 None] Creating volume e6877043-9a5b-4c65-bd28-bab6f1e7e382 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:11:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-8cf0279d-ff49-47c9-b1fa-a705b2900aae tempest-SnapshotMetadataTestJSON-183063638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:11:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-8cf0279d-ff49-47c9-b1fa-a705b2900aae tempest-SnapshotMetadataTestJSON-183063638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:11:31 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-8cf0279d-ff49-47c9-b1fa-a705b2900aae tempest-SnapshotMetadataTestJSON-183063638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:11:31 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-8cf0279d-ff49-47c9-b1fa-a705b2900aae tempest-SnapshotMetadataTestJSON-183063638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:11:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-8cf0279d-ff49-47c9-b1fa-a705b2900aae tempest-SnapshotMetadataTestJSON-183063638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:11:31 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-8cf0279d-ff49-47c9-b1fa-a705b2900aae tempest-SnapshotMetadataTestJSON-183063638 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:11:31 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-8cf0279d-ff49-47c9-b1fa-a705b2900aae tempest-SnapshotMetadataTestJSON-183063638 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:11:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8cf0279d-ff49-47c9-b1fa-a705b2900aae tempest-SnapshotMetadataTestJSON-183063638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:31 devstack sudo[95974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382 1073741824
Nov 06 17:11:31 devstack sudo[95974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:32 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c8d7b78-85c6-471b-9102-be0e2ce29706 tempest-AbsoluteLimitsTests-623259187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:11:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9c8d7b78-85c6-471b-9102-be0e2ce29706 tempest-AbsoluteLimitsTests-623259187 None] Flow 'volume_create_manager' (876d36bb-1c67-4d40-934e-7c7da720d26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:11:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9c8d7b78-85c6-471b-9102-be0e2ce29706 tempest-AbsoluteLimitsTests-623259187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d54d9b67-6541-406e-b860-9a6b4a066a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9c8d7b78-85c6-471b-9102-be0e2ce29706 tempest-AbsoluteLimitsTests-623259187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d54d9b67-6541-406e-b860-9a6b4a066a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1471175740',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98fa3e03-5347-48b2-a7ca-f30175d7107e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95343db2a30749339dd4682c9832f0bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:11:32Z,use_quota=True,user_id='da2e18c35a3f4ac5a6c7132f289b73db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9c8d7b78-85c6-471b-9102-be0e2ce29706 tempest-AbsoluteLimitsTests-623259187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cddfcbd9-6ed2-40f9-b83c-1e978e12607a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9c8d7b78-85c6-471b-9102-be0e2ce29706 tempest-AbsoluteLimitsTests-623259187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cddfcbd9-6ed2-40f9-b83c-1e978e12607a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9c8d7b78-85c6-471b-9102-be0e2ce29706 tempest-AbsoluteLimitsTests-623259187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc4059a8-9d2d-44c4-9501-78aa877f7b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9c8d7b78-85c6-471b-9102-be0e2ce29706 tempest-AbsoluteLimitsTests-623259187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc4059a8-9d2d-44c4-9501-78aa877f7b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98fa3e03-5347-48b2-a7ca-f30175d7107e', 'volume_name': 'volume-98fa3e03-5347-48b2-a7ca-f30175d7107e', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9c8d7b78-85c6-471b-9102-be0e2ce29706 tempest-AbsoluteLimitsTests-623259187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc955295-674d-4732-ad08-34e4fe6650f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9c8d7b78-85c6-471b-9102-be0e2ce29706 tempest-AbsoluteLimitsTests-623259187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc955295-674d-4732-ad08-34e4fe6650f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9c8d7b78-85c6-471b-9102-be0e2ce29706 tempest-AbsoluteLimitsTests-623259187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ca05b6-bd03-4186-8c8e-205bb1aadac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:32 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-9c8d7b78-85c6-471b-9102-be0e2ce29706 tempest-AbsoluteLimitsTests-623259187 None] Volume 98fa3e03-5347-48b2-a7ca-f30175d7107e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98fa3e03-5347-48b2-a7ca-f30175d7107e', 'volume_size': 1}
Nov 06 17:11:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9c8d7b78-85c6-471b-9102-be0e2ce29706 tempest-AbsoluteLimitsTests-623259187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:11:32 devstack sudo[95974]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8cf0279d-ff49-47c9-b1fa-a705b2900aae tempest-SnapshotMetadataTestJSON-183063638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382 1073741824" returned: 0 in 0.615s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8cf0279d-ff49-47c9-b1fa-a705b2900aae tempest-SnapshotMetadataTestJSON-183063638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:32 devstack sudo[95980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382
Nov 06 17:11:32 devstack sudo[95980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:32 devstack sudo[95980]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8cf0279d-ff49-47c9-b1fa-a705b2900aae tempest-SnapshotMetadataTestJSON-183063638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382" returned: 0 in 0.293s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:32 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-8cf0279d-ff49-47c9-b1fa-a705b2900aae tempest-SnapshotMetadataTestJSON-183063638 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:11:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-8cf0279d-ff49-47c9-b1fa-a705b2900aae tempest-SnapshotMetadataTestJSON-183063638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:11:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9c8d7b78-85c6-471b-9102-be0e2ce29706 tempest-AbsoluteLimitsTests-623259187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.389s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:11:32 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-9c8d7b78-85c6-471b-9102-be0e2ce29706 tempest-AbsoluteLimitsTests-623259187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1471175740',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98fa3e03-5347-48b2-a7ca-f30175d7107e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95343db2a30749339dd4682c9832f0bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:11:32Z,use_quota=True,user_id='da2e18c35a3f4ac5a6c7132f289b73db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:11:32 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-9c8d7b78-85c6-471b-9102-be0e2ce29706 tempest-AbsoluteLimitsTests-623259187 None] Creating volume 98fa3e03-5347-48b2-a7ca-f30175d7107e {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:11:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9c8d7b78-85c6-471b-9102-be0e2ce29706 tempest-AbsoluteLimitsTests-623259187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:11:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9c8d7b78-85c6-471b-9102-be0e2ce29706 tempest-AbsoluteLimitsTests-623259187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:11:32 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-9c8d7b78-85c6-471b-9102-be0e2ce29706 tempest-AbsoluteLimitsTests-623259187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:11:32 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-9c8d7b78-85c6-471b-9102-be0e2ce29706 tempest-AbsoluteLimitsTests-623259187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:11:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9c8d7b78-85c6-471b-9102-be0e2ce29706 tempest-AbsoluteLimitsTests-623259187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:11:32 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-9c8d7b78-85c6-471b-9102-be0e2ce29706 tempest-AbsoluteLimitsTests-623259187 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:11:32 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-9c8d7b78-85c6-471b-9102-be0e2ce29706 tempest-AbsoluteLimitsTests-623259187 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:11:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9c8d7b78-85c6-471b-9102-be0e2ce29706 tempest-AbsoluteLimitsTests-623259187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98fa3e03-5347-48b2-a7ca-f30175d7107e 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:32 devstack sudo[95983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98fa3e03-5347-48b2-a7ca-f30175d7107e 1073741824
Nov 06 17:11:32 devstack sudo[95983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8cf0279d-ff49-47c9-b1fa-a705b2900aae tempest-SnapshotMetadataTestJSON-183063638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3710995f-a344-42d0-9988-ca2b031b0c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8cf0279d-ff49-47c9-b1fa-a705b2900aae tempest-SnapshotMetadataTestJSON-183063638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98b64176-4f64-4ec6-8a38-e3576922a61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:32 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-8cf0279d-ff49-47c9-b1fa-a705b2900aae tempest-SnapshotMetadataTestJSON-183063638 None] Volume volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382 (e6877043-9a5b-4c65-bd28-bab6f1e7e382): created successfully
Nov 06 17:11:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8cf0279d-ff49-47c9-b1fa-a705b2900aae tempest-SnapshotMetadataTestJSON-183063638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98b64176-4f64-4ec6-8a38-e3576922a61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8cf0279d-ff49-47c9-b1fa-a705b2900aae tempest-SnapshotMetadataTestJSON-183063638 None] Flow 'volume_create_manager' (5ca46158-8871-4304-bcf6-21ba9e348964) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:11:32 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-8cf0279d-ff49-47c9-b1fa-a705b2900aae tempest-SnapshotMetadataTestJSON-183063638 None] Created volume successfully.
Nov 06 17:11:33 devstack sudo[95983]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9c8d7b78-85c6-471b-9102-be0e2ce29706 tempest-AbsoluteLimitsTests-623259187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98fa3e03-5347-48b2-a7ca-f30175d7107e 1073741824" returned: 0 in 0.650s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9c8d7b78-85c6-471b-9102-be0e2ce29706 tempest-AbsoluteLimitsTests-623259187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98fa3e03-5347-48b2-a7ca-f30175d7107e {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:33 devstack sudo[95990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98fa3e03-5347-48b2-a7ca-f30175d7107e
Nov 06 17:11:33 devstack sudo[95990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:33 devstack sudo[95990]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9c8d7b78-85c6-471b-9102-be0e2ce29706 tempest-AbsoluteLimitsTests-623259187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98fa3e03-5347-48b2-a7ca-f30175d7107e" returned: 0 in 0.310s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:33 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-9c8d7b78-85c6-471b-9102-be0e2ce29706 tempest-AbsoluteLimitsTests-623259187 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:11:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9c8d7b78-85c6-471b-9102-be0e2ce29706 tempest-AbsoluteLimitsTests-623259187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:11:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9c8d7b78-85c6-471b-9102-be0e2ce29706 tempest-AbsoluteLimitsTests-623259187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ca05b6-bd03-4186-8c8e-205bb1aadac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98fa3e03-5347-48b2-a7ca-f30175d7107e', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9c8d7b78-85c6-471b-9102-be0e2ce29706 tempest-AbsoluteLimitsTests-623259187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed56e008-c41b-4b31-bdce-e35255479827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:33 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-9c8d7b78-85c6-471b-9102-be0e2ce29706 tempest-AbsoluteLimitsTests-623259187 None] Volume volume-98fa3e03-5347-48b2-a7ca-f30175d7107e (98fa3e03-5347-48b2-a7ca-f30175d7107e): created successfully
Nov 06 17:11:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9c8d7b78-85c6-471b-9102-be0e2ce29706 tempest-AbsoluteLimitsTests-623259187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed56e008-c41b-4b31-bdce-e35255479827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9c8d7b78-85c6-471b-9102-be0e2ce29706 tempest-AbsoluteLimitsTests-623259187 None] Flow 'volume_create_manager' (876d36bb-1c67-4d40-934e-7c7da720d26b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:11:33 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-9c8d7b78-85c6-471b-9102-be0e2ce29706 tempest-AbsoluteLimitsTests-623259187 None] Created volume successfully.
Nov 06 17:11:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5e635dd0-7ae4-47ff-a848-40b59fc9569a tempest-SnapshotMetadataTestJSON-183063638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:11:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5e635dd0-7ae4-47ff-a848-40b59fc9569a tempest-SnapshotMetadataTestJSON-183063638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:11:33 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-5e635dd0-7ae4-47ff-a848-40b59fc9569a tempest-SnapshotMetadataTestJSON-183063638 None] Creating offline snapshot 5bb076fc-ff00-4bcb-8587-7f38cfc32db3 of volume e6877043-9a5b-4c65-bd28-bab6f1e7e382 {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:11:34 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61704ab-19e9-4c5c-9ad0-65ba76d9cdfb]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:11:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5e635dd0-7ae4-47ff-a848-40b59fc9569a tempest-SnapshotMetadataTestJSON-183063638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:34 devstack sudo[95993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382
Nov 06 17:11:34 devstack sudo[95993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:35 devstack sudo[95993]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5e635dd0-7ae4-47ff-a848-40b59fc9569a tempest-SnapshotMetadataTestJSON-183063638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382" returned: 0 in 1.130s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5e635dd0-7ae4-47ff-a848-40b59fc9569a tempest-SnapshotMetadataTestJSON-183063638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382.5bb076fc-ff00-4bcb-8587-7f38cfc32db3 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:35 devstack sudo[96062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382.5bb076fc-ff00-4bcb-8587-7f38cfc32db3 1G
Nov 06 17:11:35 devstack sudo[96062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:35 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-6d407761-fbbc-413e-9ee5-67fc16ee2238 tempest-AbsoluteLimitsTests-623259187 None] Acquiring lock "cinder-98fa3e03-5347-48b2-a7ca-f30175d7107e-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:11:35 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aeb55b4-504f-4f49-87c9-8099f4ab2e3f tempest-VolumesTransfersV355Test-1132847726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:11:35 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0aeb55b4-504f-4f49-87c9-8099f4ab2e3f tempest-VolumesTransfersV355Test-1132847726 None] Flow 'volume_create_manager' (3efa1211-923a-44e2-a007-86991a832b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:11:35 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0aeb55b4-504f-4f49-87c9-8099f4ab2e3f tempest-VolumesTransfersV355Test-1132847726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7ad8d77-42d0-4f45-b6bc-7cf1819406cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:35 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0aeb55b4-504f-4f49-87c9-8099f4ab2e3f tempest-VolumesTransfersV355Test-1132847726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7ad8d77-42d0-4f45-b6bc-7cf1819406cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-860350217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=444fe417-6f12-41cc-8bec-670501f1c2bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3572de8b2dc4bfe829307395a4f139f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:11:35Z,use_quota=True,user_id='2cbc92809fff4a9691296cffa228edc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:35 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0aeb55b4-504f-4f49-87c9-8099f4ab2e3f tempest-VolumesTransfersV355Test-1132847726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (939e78bb-eab5-4189-a16b-8ce8e274bd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:35 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0aeb55b4-504f-4f49-87c9-8099f4ab2e3f tempest-VolumesTransfersV355Test-1132847726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (939e78bb-eab5-4189-a16b-8ce8e274bd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:35 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0aeb55b4-504f-4f49-87c9-8099f4ab2e3f tempest-VolumesTransfersV355Test-1132847726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe646767-e4b8-471c-b5c5-ca75e298b663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:35 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0aeb55b4-504f-4f49-87c9-8099f4ab2e3f tempest-VolumesTransfersV355Test-1132847726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe646767-e4b8-471c-b5c5-ca75e298b663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '444fe417-6f12-41cc-8bec-670501f1c2bf', 'volume_name': 'volume-444fe417-6f12-41cc-8bec-670501f1c2bf', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:35 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0aeb55b4-504f-4f49-87c9-8099f4ab2e3f tempest-VolumesTransfersV355Test-1132847726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bb68702-2f7a-4fc5-aa32-cf70ed326e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:35 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0aeb55b4-504f-4f49-87c9-8099f4ab2e3f tempest-VolumesTransfersV355Test-1132847726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bb68702-2f7a-4fc5-aa32-cf70ed326e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:35 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0aeb55b4-504f-4f49-87c9-8099f4ab2e3f tempest-VolumesTransfersV355Test-1132847726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2527f55-a492-4097-9dc2-21ef17fcf8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:35 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-0aeb55b4-504f-4f49-87c9-8099f4ab2e3f tempest-VolumesTransfersV355Test-1132847726 None] Volume 444fe417-6f12-41cc-8bec-670501f1c2bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-444fe417-6f12-41cc-8bec-670501f1c2bf', 'volume_size': 1}
Nov 06 17:11:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0aeb55b4-504f-4f49-87c9-8099f4ab2e3f tempest-VolumesTransfersV355Test-1132847726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:11:35 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-6d407761-fbbc-413e-9ee5-67fc16ee2238 tempest-AbsoluteLimitsTests-623259187 None] Lock "cinder-98fa3e03-5347-48b2-a7ca-f30175d7107e-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:11:35 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-6d407761-fbbc-413e-9ee5-67fc16ee2238 tempest-AbsoluteLimitsTests-623259187 None] Acquiring lock "cinder-quobyte-98fa3e03-5347-48b2-a7ca-f30175d7107e" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:11:35 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-6d407761-fbbc-413e-9ee5-67fc16ee2238 tempest-AbsoluteLimitsTests-623259187 None] Lock "cinder-quobyte-98fa3e03-5347-48b2-a7ca-f30175d7107e" acquired by "delete_volume" :: waited 0.029s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:11:35 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4314702-30b0-477a-a776-6182428b4966]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:11:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6d407761-fbbc-413e-9ee5-67fc16ee2238 tempest-AbsoluteLimitsTests-623259187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98fa3e03-5347-48b2-a7ca-f30175d7107e {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:35 devstack sudo[96068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98fa3e03-5347-48b2-a7ca-f30175d7107e
Nov 06 17:11:35 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:35 devstack sudo[96062]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5e635dd0-7ae4-47ff-a848-40b59fc9569a tempest-SnapshotMetadataTestJSON-183063638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382.5bb076fc-ff00-4bcb-8587-7f38cfc32db3 1G" returned: 0 in 0.755s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5e635dd0-7ae4-47ff-a848-40b59fc9569a tempest-SnapshotMetadataTestJSON-183063638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382.5bb076fc-ff00-4bcb-8587-7f38cfc32db3 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:35 devstack sudo[96075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382.5bb076fc-ff00-4bcb-8587-7f38cfc32db3
Nov 06 17:11:35 devstack sudo[96075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:36 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6d407761-fbbc-413e-9ee5-67fc16ee2238 tempest-AbsoluteLimitsTests-623259187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98fa3e03-5347-48b2-a7ca-f30175d7107e" returned: 0 in 0.603s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6d407761-fbbc-413e-9ee5-67fc16ee2238 tempest-AbsoluteLimitsTests-623259187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98fa3e03-5347-48b2-a7ca-f30175d7107e {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:36 devstack sudo[96082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98fa3e03-5347-48b2-a7ca-f30175d7107e
Nov 06 17:11:36 devstack sudo[96082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:36 devstack sudo[96075]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5e635dd0-7ae4-47ff-a848-40b59fc9569a tempest-SnapshotMetadataTestJSON-183063638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382.5bb076fc-ff00-4bcb-8587-7f38cfc32db3" returned: 0 in 0.552s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:36 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-5e635dd0-7ae4-47ff-a848-40b59fc9569a tempest-SnapshotMetadataTestJSON-183063638 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382.5bb076fc-ff00-4bcb-8587-7f38cfc32db3 is being set with open permissions: ugo+rw
Nov 06 17:11:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5e635dd0-7ae4-47ff-a848-40b59fc9569a tempest-SnapshotMetadataTestJSON-183063638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382.5bb076fc-ff00-4bcb-8587-7f38cfc32db3 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:36 devstack sudo[96087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382.5bb076fc-ff00-4bcb-8587-7f38cfc32db3
Nov 06 17:11:36 devstack sudo[96087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:36 devstack sudo[96082]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6d407761-fbbc-413e-9ee5-67fc16ee2238 tempest-AbsoluteLimitsTests-623259187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98fa3e03-5347-48b2-a7ca-f30175d7107e" returned: 0 in 0.377s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:36 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-6d407761-fbbc-413e-9ee5-67fc16ee2238 tempest-AbsoluteLimitsTests-623259187 None] Lock "cinder-quobyte-98fa3e03-5347-48b2-a7ca-f30175d7107e" released by "delete_volume" :: held 1.036s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:11:36 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-6d407761-fbbc-413e-9ee5-67fc16ee2238 tempest-AbsoluteLimitsTests-623259187 None] Created reservations ['8579d67f-0a2a-4197-a270-4b65a9765b2a', '584421c1-de38-4da0-927c-13e598bfb258', '1a97501f-1406-4dee-81bf-5049cbba9d59', '2d8057ca-48d7-42e1-9a6f-aa2a2927e23f'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:11:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6d407761-fbbc-413e-9ee5-67fc16ee2238 tempest-AbsoluteLimitsTests-623259187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:11:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6d407761-fbbc-413e-9ee5-67fc16ee2238 tempest-AbsoluteLimitsTests-623259187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:11:36 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-6d407761-fbbc-413e-9ee5-67fc16ee2238 tempest-AbsoluteLimitsTests-623259187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:11:36 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-6d407761-fbbc-413e-9ee5-67fc16ee2238 tempest-AbsoluteLimitsTests-623259187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:11:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6d407761-fbbc-413e-9ee5-67fc16ee2238 tempest-AbsoluteLimitsTests-623259187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:11:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6d407761-fbbc-413e-9ee5-67fc16ee2238 tempest-AbsoluteLimitsTests-623259187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:36 devstack sudo[96087]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5e635dd0-7ae4-47ff-a848-40b59fc9569a tempest-SnapshotMetadataTestJSON-183063638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382.5bb076fc-ff00-4bcb-8587-7f38cfc32db3" returned: 0 in 0.303s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:36 devstack sudo[96091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:11:36 devstack sudo[96091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5e635dd0-7ae4-47ff-a848-40b59fc9569a tempest-SnapshotMetadataTestJSON-183063638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:36 devstack sudo[96093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382.info
Nov 06 17:11:36 devstack sudo[96093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:37 devstack sudo[96091]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6d407761-fbbc-413e-9ee5-67fc16ee2238 tempest-AbsoluteLimitsTests-623259187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.276s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:37 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-6d407761-fbbc-413e-9ee5-67fc16ee2238 tempest-AbsoluteLimitsTests-623259187 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:11:37 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-6d407761-fbbc-413e-9ee5-67fc16ee2238 tempest-AbsoluteLimitsTests-623259187 None] Deleted volume successfully.
Nov 06 17:11:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-6d407761-fbbc-413e-9ee5-67fc16ee2238 tempest-AbsoluteLimitsTests-623259187 None] Lock "cinder-98fa3e03-5347-48b2-a7ca-f30175d7107e-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:11:37 devstack sudo[96093]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5e635dd0-7ae4-47ff-a848-40b59fc9569a tempest-SnapshotMetadataTestJSON-183063638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382.info" returned: 0 in 0.271s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:37 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-5e635dd0-7ae4-47ff-a848-40b59fc9569a tempest-SnapshotMetadataTestJSON-183063638 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382.info is being set with open permissions: ugo+rw
Nov 06 17:11:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5e635dd0-7ae4-47ff-a848-40b59fc9569a tempest-SnapshotMetadataTestJSON-183063638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:37 devstack sudo[96097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382.info
Nov 06 17:11:37 devstack sudo[96097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:37 devstack sudo[96097]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5e635dd0-7ae4-47ff-a848-40b59fc9569a tempest-SnapshotMetadataTestJSON-183063638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382.info" returned: 0 in 0.246s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5e635dd0-7ae4-47ff-a848-40b59fc9569a tempest-SnapshotMetadataTestJSON-183063638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.387s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:11:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0aeb55b4-504f-4f49-87c9-8099f4ab2e3f tempest-VolumesTransfersV355Test-1132847726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.895s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:11:37 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0aeb55b4-504f-4f49-87c9-8099f4ab2e3f tempest-VolumesTransfersV355Test-1132847726 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-860350217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=444fe417-6f12-41cc-8bec-670501f1c2bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3572de8b2dc4bfe829307395a4f139f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:11:35Z,use_quota=True,user_id='2cbc92809fff4a9691296cffa228edc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:11:37 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-0aeb55b4-504f-4f49-87c9-8099f4ab2e3f tempest-VolumesTransfersV355Test-1132847726 None] Creating volume 444fe417-6f12-41cc-8bec-670501f1c2bf {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:11:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0aeb55b4-504f-4f49-87c9-8099f4ab2e3f tempest-VolumesTransfersV355Test-1132847726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:11:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0aeb55b4-504f-4f49-87c9-8099f4ab2e3f tempest-VolumesTransfersV355Test-1132847726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:11:37 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0aeb55b4-504f-4f49-87c9-8099f4ab2e3f tempest-VolumesTransfersV355Test-1132847726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:11:37 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0aeb55b4-504f-4f49-87c9-8099f4ab2e3f tempest-VolumesTransfersV355Test-1132847726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:11:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0aeb55b4-504f-4f49-87c9-8099f4ab2e3f tempest-VolumesTransfersV355Test-1132847726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:11:37 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0aeb55b4-504f-4f49-87c9-8099f4ab2e3f tempest-VolumesTransfersV355Test-1132847726 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:11:37 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-0aeb55b4-504f-4f49-87c9-8099f4ab2e3f tempest-VolumesTransfersV355Test-1132847726 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:11:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0aeb55b4-504f-4f49-87c9-8099f4ab2e3f tempest-VolumesTransfersV355Test-1132847726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-444fe417-6f12-41cc-8bec-670501f1c2bf 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:37 devstack sudo[96100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-444fe417-6f12-41cc-8bec-670501f1c2bf 1073741824
Nov 06 17:11:37 devstack sudo[96100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:37 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-5e635dd0-7ae4-47ff-a848-40b59fc9569a tempest-SnapshotMetadataTestJSON-183063638 None] Create snapshot completed successfully
Nov 06 17:11:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-2648fe2d-49d1-4868-bb12-61e7c549a023 tempest-VolumesActionsTest-4139085 None] Acquiring lock "cinder-784376fe-59d9-4d8b-9498-8bd17847925b" by "attach_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:11:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-2648fe2d-49d1-4868-bb12-61e7c549a023 tempest-VolumesActionsTest-4139085 None] Lock "cinder-784376fe-59d9-4d8b-9498-8bd17847925b" acquired by "attach_volume" :: waited 0.032s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:11:37 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-2648fe2d-49d1-4868-bb12-61e7c549a023 tempest-VolumesActionsTest-4139085 None] Attaching volume 784376fe-59d9-4d8b-9498-8bd17847925b to instance 9d15defe-9c5c-4eed-b4df-9d0ed5d45409 at mountpoint /dev/vdb on host None.
Nov 06 17:11:37 devstack sudo[96100]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:37 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-2648fe2d-49d1-4868-bb12-61e7c549a023 tempest-VolumesActionsTest-4139085 None] Attach volume completed successfully.
Nov 06 17:11:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0aeb55b4-504f-4f49-87c9-8099f4ab2e3f tempest-VolumesTransfersV355Test-1132847726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-444fe417-6f12-41cc-8bec-670501f1c2bf 1073741824" returned: 0 in 0.659s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:38 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-2648fe2d-49d1-4868-bb12-61e7c549a023 tempest-VolumesActionsTest-4139085 None] Lock "cinder-784376fe-59d9-4d8b-9498-8bd17847925b" released by "attach_volume" :: held 0.147s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:11:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0aeb55b4-504f-4f49-87c9-8099f4ab2e3f tempest-VolumesTransfersV355Test-1132847726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-444fe417-6f12-41cc-8bec-670501f1c2bf {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:38 devstack sudo[96106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-444fe417-6f12-41cc-8bec-670501f1c2bf
Nov 06 17:11:38 devstack sudo[96106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:38 devstack sudo[96106]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0aeb55b4-504f-4f49-87c9-8099f4ab2e3f tempest-VolumesTransfersV355Test-1132847726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-444fe417-6f12-41cc-8bec-670501f1c2bf" returned: 0 in 0.366s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:38 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0aeb55b4-504f-4f49-87c9-8099f4ab2e3f tempest-VolumesTransfersV355Test-1132847726 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:11:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0aeb55b4-504f-4f49-87c9-8099f4ab2e3f tempest-VolumesTransfersV355Test-1132847726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:11:38 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0aeb55b4-504f-4f49-87c9-8099f4ab2e3f tempest-VolumesTransfersV355Test-1132847726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2527f55-a492-4097-9dc2-21ef17fcf8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-444fe417-6f12-41cc-8bec-670501f1c2bf', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:38 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0aeb55b4-504f-4f49-87c9-8099f4ab2e3f tempest-VolumesTransfersV355Test-1132847726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (664a2ddb-6669-4d89-99b0-3ccb40be6bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:38 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-0aeb55b4-504f-4f49-87c9-8099f4ab2e3f tempest-VolumesTransfersV355Test-1132847726 None] Volume volume-444fe417-6f12-41cc-8bec-670501f1c2bf (444fe417-6f12-41cc-8bec-670501f1c2bf): created successfully
Nov 06 17:11:38 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0aeb55b4-504f-4f49-87c9-8099f4ab2e3f tempest-VolumesTransfersV355Test-1132847726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (664a2ddb-6669-4d89-99b0-3ccb40be6bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:38 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0aeb55b4-504f-4f49-87c9-8099f4ab2e3f tempest-VolumesTransfersV355Test-1132847726 None] Flow 'volume_create_manager' (3efa1211-923a-44e2-a007-86991a832b6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:11:38 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-0aeb55b4-504f-4f49-87c9-8099f4ab2e3f tempest-VolumesTransfersV355Test-1132847726 None] Created volume successfully.
Nov 06 17:11:38 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-602a81a5-b9c7-4fe9-9055-f75aa40efa36 tempest-VolumesActionsTest-4139085 None] Acquiring lock "cinder-784376fe-59d9-4d8b-9498-8bd17847925b-detach_volume" by "detach_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:11:38 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-602a81a5-b9c7-4fe9-9055-f75aa40efa36 tempest-VolumesActionsTest-4139085 None] Lock "cinder-784376fe-59d9-4d8b-9498-8bd17847925b-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:11:38 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-602a81a5-b9c7-4fe9-9055-f75aa40efa36 tempest-VolumesActionsTest-4139085 None] Detaching volume 784376fe-59d9-4d8b-9498-8bd17847925b from instance 9d15defe-9c5c-4eed-b4df-9d0ed5d45409.
Nov 06 17:11:38 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-602a81a5-b9c7-4fe9-9055-f75aa40efa36 tempest-VolumesActionsTest-4139085 None] Detach volume completed successfully.
Nov 06 17:11:38 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-602a81a5-b9c7-4fe9-9055-f75aa40efa36 tempest-VolumesActionsTest-4139085 None] Lock "cinder-784376fe-59d9-4d8b-9498-8bd17847925b-detach_volume" released by "detach_volume" :: held 0.073s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:11:40 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1d7dcefb-4160-4344-85dd-168c14718d65 tempest-SnapshotMetadataTestJSON-183063638 None] Acquiring lock "cinder-5bb076fc-ff00-4bcb-8587-7f38cfc32db3-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:11:40 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1d7dcefb-4160-4344-85dd-168c14718d65 tempest-SnapshotMetadataTestJSON-183063638 None] Lock "cinder-5bb076fc-ff00-4bcb-8587-7f38cfc32db3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:11:40 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1d7dcefb-4160-4344-85dd-168c14718d65 tempest-SnapshotMetadataTestJSON-183063638 None] Acquiring lock "cinder-quobyte-e6877043-9a5b-4c65-bd28-bab6f1e7e382" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:11:40 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1d7dcefb-4160-4344-85dd-168c14718d65 tempest-SnapshotMetadataTestJSON-183063638 None] Lock "cinder-quobyte-e6877043-9a5b-4c65-bd28-bab6f1e7e382" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:11:40 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1d7dcefb-4160-4344-85dd-168c14718d65 tempest-SnapshotMetadataTestJSON-183063638 None] Acquiring lock "cinder-quobyte-5bb076fc-ff00-4bcb-8587-7f38cfc32db3" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:11:40 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1d7dcefb-4160-4344-85dd-168c14718d65 tempest-SnapshotMetadataTestJSON-183063638 None] Lock "cinder-quobyte-5bb076fc-ff00-4bcb-8587-7f38cfc32db3" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:11:40 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-1d7dcefb-4160-4344-85dd-168c14718d65 tempest-SnapshotMetadataTestJSON-183063638 None] Deleting offline snapshot 5bb076fc-ff00-4bcb-8587-7f38cfc32db3 of volume e6877043-9a5b-4c65-bd28-bab6f1e7e382 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:11:40 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-1d7dcefb-4160-4344-85dd-168c14718d65 tempest-SnapshotMetadataTestJSON-183063638 None] snapshot_file for this snap is: volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382.5bb076fc-ff00-4bcb-8587-7f38cfc32db3 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:11:40 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[854d6d4c-dd9c-47f4-a845-d4fd9d242944]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:11:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1d7dcefb-4160-4344-85dd-168c14718d65 tempest-SnapshotMetadataTestJSON-183063638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382.5bb076fc-ff00-4bcb-8587-7f38cfc32db3 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:40 devstack sudo[96141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382.5bb076fc-ff00-4bcb-8587-7f38cfc32db3
Nov 06 17:11:40 devstack sudo[96141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:40 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-22cf7306-e544-496f-b666-89cf162ecc6f tempest-VolumesTransfersV355Test-902951104 None] Transfer volume completed successfully.
Nov 06 17:11:41 devstack sudo[96141]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1d7dcefb-4160-4344-85dd-168c14718d65 tempest-SnapshotMetadataTestJSON-183063638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382.5bb076fc-ff00-4bcb-8587-7f38cfc32db3" returned: 0 in 0.616s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:41 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-1d7dcefb-4160-4344-85dd-168c14718d65 tempest-SnapshotMetadataTestJSON-183063638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:11:41 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26053c0-962f-4d1b-8e49-a0801688fc1f]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:11:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1d7dcefb-4160-4344-85dd-168c14718d65 tempest-SnapshotMetadataTestJSON-183063638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:41 devstack sudo[96148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382
Nov 06 17:11:41 devstack sudo[96148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:41 devstack sudo[96148]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:41 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-67a6e938-136f-44b1-8797-986c63491217 tempest-VolumesTransfersV355Test-1845452878 None] Acquiring lock "cinder-444fe417-6f12-41cc-8bec-670501f1c2bf-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:11:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1d7dcefb-4160-4344-85dd-168c14718d65 tempest-SnapshotMetadataTestJSON-183063638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382" returned: 0 in 0.553s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1d7dcefb-4160-4344-85dd-168c14718d65 tempest-SnapshotMetadataTestJSON-183063638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382.5bb076fc-ff00-4bcb-8587-7f38cfc32db3 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:41 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-67a6e938-136f-44b1-8797-986c63491217 tempest-VolumesTransfersV355Test-1845452878 None] Lock "cinder-444fe417-6f12-41cc-8bec-670501f1c2bf-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:11:41 devstack sudo[96155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382.5bb076fc-ff00-4bcb-8587-7f38cfc32db3
Nov 06 17:11:41 devstack sudo[96155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:41 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=109,cinder:UPDATE=122,cinder:INSERT=32,cinder:DELETE=13 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:11:41 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-67a6e938-136f-44b1-8797-986c63491217 tempest-VolumesTransfersV355Test-1845452878 None] Acquiring lock "cinder-quobyte-444fe417-6f12-41cc-8bec-670501f1c2bf" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:11:41 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-67a6e938-136f-44b1-8797-986c63491217 tempest-VolumesTransfersV355Test-1845452878 None] Lock "cinder-quobyte-444fe417-6f12-41cc-8bec-670501f1c2bf" acquired by "delete_volume" :: waited 0.022s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:11:41 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8eae17d-422a-423d-ab56-3ed40f7212f4]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:11:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-67a6e938-136f-44b1-8797-986c63491217 tempest-VolumesTransfersV355Test-1845452878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-444fe417-6f12-41cc-8bec-670501f1c2bf {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:42 devstack sudo[96157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-444fe417-6f12-41cc-8bec-670501f1c2bf
Nov 06 17:11:42 devstack sudo[96157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:42 devstack sudo[96155]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1d7dcefb-4160-4344-85dd-168c14718d65 tempest-SnapshotMetadataTestJSON-183063638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382.5bb076fc-ff00-4bcb-8587-7f38cfc32db3" returned: 0 in 0.572s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1d7dcefb-4160-4344-85dd-168c14718d65 tempest-SnapshotMetadataTestJSON-183063638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382.5bb076fc-ff00-4bcb-8587-7f38cfc32db3 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:42 devstack sudo[96164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382.5bb076fc-ff00-4bcb-8587-7f38cfc32db3
Nov 06 17:11:42 devstack sudo[96164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:42 devstack sudo[96157]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-67a6e938-136f-44b1-8797-986c63491217 tempest-VolumesTransfersV355Test-1845452878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-444fe417-6f12-41cc-8bec-670501f1c2bf" returned: 0 in 0.539s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-67a6e938-136f-44b1-8797-986c63491217 tempest-VolumesTransfersV355Test-1845452878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-444fe417-6f12-41cc-8bec-670501f1c2bf {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:42 devstack sudo[96183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-444fe417-6f12-41cc-8bec-670501f1c2bf
Nov 06 17:11:42 devstack sudo[96183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:42 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:11:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:11:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:11:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:11:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:11:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:11:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:42 devstack sudo[96206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:11:42 devstack sudo[96206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:42 devstack sudo[96164]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1d7dcefb-4160-4344-85dd-168c14718d65 tempest-SnapshotMetadataTestJSON-183063638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382.5bb076fc-ff00-4bcb-8587-7f38cfc32db3" returned: 0 in 0.384s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:42 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1d7dcefb-4160-4344-85dd-168c14718d65 tempest-SnapshotMetadataTestJSON-183063638 None] Lock "cinder-quobyte-5bb076fc-ff00-4bcb-8587-7f38cfc32db3" released by "_delete_snapshot" :: held 2.339s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:11:42 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1d7dcefb-4160-4344-85dd-168c14718d65 tempest-SnapshotMetadataTestJSON-183063638 None] Lock "cinder-quobyte-e6877043-9a5b-4c65-bd28-bab6f1e7e382" released by "delete_snapshot" :: held 2.385s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:11:42 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-1d7dcefb-4160-4344-85dd-168c14718d65 tempest-SnapshotMetadataTestJSON-183063638 None] Created reservations ['8d52730d-08dd-473b-8dcb-43efe3ab4d0d', 'a7e53cbb-c592-47d5-a62f-e6123f35986b', '5b8e8abc-ec67-48e3-a1df-e4320a3e0e4d', '3d358f64-2f73-4e74-850a-dc1f42035963'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:11:42 devstack sudo[96183]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-67a6e938-136f-44b1-8797-986c63491217 tempest-VolumesTransfersV355Test-1845452878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-444fe417-6f12-41cc-8bec-670501f1c2bf" returned: 0 in 0.583s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:42 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-67a6e938-136f-44b1-8797-986c63491217 tempest-VolumesTransfersV355Test-1845452878 None] Lock "cinder-quobyte-444fe417-6f12-41cc-8bec-670501f1c2bf" released by "delete_volume" :: held 1.211s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:11:43 devstack sudo[96206]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.520s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:43 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:11:43 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager._thread_info {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:11:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread count: 28 {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 17:11:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread info: [<_MainThread(MainThread, started 125183137599616)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125183027608256)>, <Thread(Thread-3 (stat_writer), started daemon 125183025243776)>, <Thread(Rabbit-heartbeat, started daemon 125183023512896)>, <Thread(Thread-5 (_runner), started daemon 125183023357120)>, <Thread(Thread-7 (_runner), started daemon 125183021306496)>, <Thread(fd_logger, started daemon 125183018711616)>, <Thread(privsep_reader, started daemon 125183017484224)>, <Thread(tpool_thread_0, started daemon 125183013742272)>, <Thread(tpool_thread_1, started daemon 125183005349568)>, <Thread(tpool_thread_2, started daemon 125182996956864)>, <Thread(tpool_thread_3, started daemon 125182988564160)>, <Thread(tpool_thread_4, started daemon 125182980171456)>, <Thread(tpool_thread_5, started daemon 125182971778752)>, <Thread(tpool_thread_6, started daemon 125182963386048)>, <Thread(tpool_thread_7, started daemon 125182954993344)>, <Thread(tpool_thread_8, started daemon 125182946600640)>, <Thread(tpool_thread_9, started daemon 125182938207936)>, <Thread(tpool_thread_10, started daemon 125182929815232)>, <Thread(tpool_thread_11, started daemon 125182921422528)>, <Thread(tpool_thread_12, started daemon 125182913013440)>, <Thread(tpool_thread_13, started daemon 125182904604352)>, <Thread(tpool_thread_14, started daemon 125182896195264)>, <Thread(tpool_thread_15, started daemon 125182887786176)>, <Thread(tpool_thread_16, started daemon 125182879377088)>, <Thread(tpool_thread_17, started daemon 125182870968000)>, <Thread(tpool_thread_18, started daemon 125182862558912)>, <Thread(tpool_thread_19, started daemon 125182854149824)>] {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 17:11:43 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-1d7dcefb-4160-4344-85dd-168c14718d65 tempest-SnapshotMetadataTestJSON-183063638 None] Delete snapshot completed successfully.
Nov 06 17:11:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1d7dcefb-4160-4344-85dd-168c14718d65 tempest-SnapshotMetadataTestJSON-183063638 None] Lock "cinder-5bb076fc-ff00-4bcb-8587-7f38cfc32db3-delete_snapshot" released by "delete_snapshot" :: held 2.863s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:11:43 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-67a6e938-136f-44b1-8797-986c63491217 tempest-VolumesTransfersV355Test-1845452878 None] Created reservations ['2f0cbdec-0554-4dda-89f6-ecc2530d8f78', '7122be98-c46e-4659-be3a-5b0503b99ed3', '29c9ce42-0f8f-472b-a363-2f33f32de44c', 'f27dd897-9bea-4578-83fd-5a4b41356b6b'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:11:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-67a6e938-136f-44b1-8797-986c63491217 tempest-VolumesTransfersV355Test-1845452878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:11:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-67a6e938-136f-44b1-8797-986c63491217 tempest-VolumesTransfersV355Test-1845452878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:11:43 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-67a6e938-136f-44b1-8797-986c63491217 tempest-VolumesTransfersV355Test-1845452878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:11:43 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-67a6e938-136f-44b1-8797-986c63491217 tempest-VolumesTransfersV355Test-1845452878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:11:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-67a6e938-136f-44b1-8797-986c63491217 tempest-VolumesTransfersV355Test-1845452878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:11:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-67a6e938-136f-44b1-8797-986c63491217 tempest-VolumesTransfersV355Test-1845452878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:43 devstack sudo[96212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:11:43 devstack sudo[96212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:43 devstack sudo[96212]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-67a6e938-136f-44b1-8797-986c63491217 tempest-VolumesTransfersV355Test-1845452878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.263s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:43 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-67a6e938-136f-44b1-8797-986c63491217 tempest-VolumesTransfersV355Test-1845452878 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:11:43 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-67a6e938-136f-44b1-8797-986c63491217 tempest-VolumesTransfersV355Test-1845452878 None] Deleted volume successfully.
Nov 06 17:11:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-94930be6-83c7-46ec-9051-f5c244c97e2b tempest-SnapshotMetadataTestJSON-183063638 None] Acquiring lock "cinder-e6877043-9a5b-4c65-bd28-bab6f1e7e382-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:11:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-67a6e938-136f-44b1-8797-986c63491217 tempest-VolumesTransfersV355Test-1845452878 None] Lock "cinder-444fe417-6f12-41cc-8bec-670501f1c2bf-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:11:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-94930be6-83c7-46ec-9051-f5c244c97e2b tempest-SnapshotMetadataTestJSON-183063638 None] Lock "cinder-e6877043-9a5b-4c65-bd28-bab6f1e7e382-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:11:43 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:UPDATE=171,cinder:SELECT=107,cinder:DELETE=12,cinder:INSERT=37 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:11:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-94930be6-83c7-46ec-9051-f5c244c97e2b tempest-SnapshotMetadataTestJSON-183063638 None] Acquiring lock "cinder-quobyte-e6877043-9a5b-4c65-bd28-bab6f1e7e382" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:11:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-94930be6-83c7-46ec-9051-f5c244c97e2b tempest-SnapshotMetadataTestJSON-183063638 None] Lock "cinder-quobyte-e6877043-9a5b-4c65-bd28-bab6f1e7e382" acquired by "delete_volume" :: waited 0.018s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:11:43 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[650384f8-f04a-46d6-92c6-514d0167de36]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:11:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-94930be6-83c7-46ec-9051-f5c244c97e2b tempest-SnapshotMetadataTestJSON-183063638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:43 devstack sudo[96215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382
Nov 06 17:11:43 devstack sudo[96215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:44 devstack sudo[96215]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-94930be6-83c7-46ec-9051-f5c244c97e2b tempest-SnapshotMetadataTestJSON-183063638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382" returned: 0 in 0.489s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-94930be6-83c7-46ec-9051-f5c244c97e2b tempest-SnapshotMetadataTestJSON-183063638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:44 devstack sudo[96221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382
Nov 06 17:11:44 devstack sudo[96221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:44 devstack sudo[96221]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-94930be6-83c7-46ec-9051-f5c244c97e2b tempest-SnapshotMetadataTestJSON-183063638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e6877043-9a5b-4c65-bd28-bab6f1e7e382" returned: 0 in 0.335s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:44 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-94930be6-83c7-46ec-9051-f5c244c97e2b tempest-SnapshotMetadataTestJSON-183063638 None] Lock "cinder-quobyte-e6877043-9a5b-4c65-bd28-bab6f1e7e382" released by "delete_volume" :: held 0.908s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:11:44 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b0677f2-1fae-4c05-8b38-16b9ff262fa6 tempest-VolumesTransfersV355Test-1132847726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:11:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6b0677f2-1fae-4c05-8b38-16b9ff262fa6 tempest-VolumesTransfersV355Test-1132847726 None] Flow 'volume_create_manager' (b01e269f-8855-4680-a0e8-45e8ac012151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:11:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6b0677f2-1fae-4c05-8b38-16b9ff262fa6 tempest-VolumesTransfersV355Test-1132847726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe505cb4-0dcc-4e25-b6bb-8d9c9f3e98d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:44 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-94930be6-83c7-46ec-9051-f5c244c97e2b tempest-SnapshotMetadataTestJSON-183063638 None] Created reservations ['123abcf0-7d40-462a-8d65-3f910ecf6bec', '6d436c05-a673-4851-a393-b30e37a3ad3d', 'f61f9bd1-d0f5-4461-a12a-2896602cc924', '1393a916-c161-4bdf-b6c4-b33554a8f66e'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:11:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6b0677f2-1fae-4c05-8b38-16b9ff262fa6 tempest-VolumesTransfersV355Test-1132847726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe505cb4-0dcc-4e25-b6bb-8d9c9f3e98d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1369854165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edb26a65-3a5b-4245-b8cf-287ad9dae6c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3572de8b2dc4bfe829307395a4f139f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:11:45Z,use_quota=True,user_id='2cbc92809fff4a9691296cffa228edc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6b0677f2-1fae-4c05-8b38-16b9ff262fa6 tempest-VolumesTransfersV355Test-1132847726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cd8bb72-4140-4b42-a887-40eb752e3f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6b0677f2-1fae-4c05-8b38-16b9ff262fa6 tempest-VolumesTransfersV355Test-1132847726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cd8bb72-4140-4b42-a887-40eb752e3f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6b0677f2-1fae-4c05-8b38-16b9ff262fa6 tempest-VolumesTransfersV355Test-1132847726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8727a391-09ca-4ce5-8d10-2652aec103d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6b0677f2-1fae-4c05-8b38-16b9ff262fa6 tempest-VolumesTransfersV355Test-1132847726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8727a391-09ca-4ce5-8d10-2652aec103d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edb26a65-3a5b-4245-b8cf-287ad9dae6c7', 'volume_name': 'volume-edb26a65-3a5b-4245-b8cf-287ad9dae6c7', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6b0677f2-1fae-4c05-8b38-16b9ff262fa6 tempest-VolumesTransfersV355Test-1132847726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56762559-12e8-4a19-80d4-bb869e177f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6b0677f2-1fae-4c05-8b38-16b9ff262fa6 tempest-VolumesTransfersV355Test-1132847726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56762559-12e8-4a19-80d4-bb869e177f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6b0677f2-1fae-4c05-8b38-16b9ff262fa6 tempest-VolumesTransfersV355Test-1132847726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e921533d-ff07-427a-988f-c771277014c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:44 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-6b0677f2-1fae-4c05-8b38-16b9ff262fa6 tempest-VolumesTransfersV355Test-1132847726 None] Volume edb26a65-3a5b-4245-b8cf-287ad9dae6c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edb26a65-3a5b-4245-b8cf-287ad9dae6c7', 'volume_size': 1}
Nov 06 17:11:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6b0677f2-1fae-4c05-8b38-16b9ff262fa6 tempest-VolumesTransfersV355Test-1132847726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:11:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6b0677f2-1fae-4c05-8b38-16b9ff262fa6 tempest-VolumesTransfersV355Test-1132847726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:11:44 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-6b0677f2-1fae-4c05-8b38-16b9ff262fa6 tempest-VolumesTransfersV355Test-1132847726 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1369854165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edb26a65-3a5b-4245-b8cf-287ad9dae6c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3572de8b2dc4bfe829307395a4f139f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:11:45Z,use_quota=True,user_id='2cbc92809fff4a9691296cffa228edc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:11:44 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-6b0677f2-1fae-4c05-8b38-16b9ff262fa6 tempest-VolumesTransfersV355Test-1132847726 None] Creating volume edb26a65-3a5b-4245-b8cf-287ad9dae6c7 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:11:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6b0677f2-1fae-4c05-8b38-16b9ff262fa6 tempest-VolumesTransfersV355Test-1132847726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:11:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6b0677f2-1fae-4c05-8b38-16b9ff262fa6 tempest-VolumesTransfersV355Test-1132847726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:11:44 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-6b0677f2-1fae-4c05-8b38-16b9ff262fa6 tempest-VolumesTransfersV355Test-1132847726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:11:44 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-6b0677f2-1fae-4c05-8b38-16b9ff262fa6 tempest-VolumesTransfersV355Test-1132847726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:11:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6b0677f2-1fae-4c05-8b38-16b9ff262fa6 tempest-VolumesTransfersV355Test-1132847726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:11:44 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-6b0677f2-1fae-4c05-8b38-16b9ff262fa6 tempest-VolumesTransfersV355Test-1132847726 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:11:44 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-6b0677f2-1fae-4c05-8b38-16b9ff262fa6 tempest-VolumesTransfersV355Test-1132847726 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:11:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6b0677f2-1fae-4c05-8b38-16b9ff262fa6 tempest-VolumesTransfersV355Test-1132847726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-edb26a65-3a5b-4245-b8cf-287ad9dae6c7 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:44 devstack sudo[96230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-edb26a65-3a5b-4245-b8cf-287ad9dae6c7 1073741824
Nov 06 17:11:44 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-94930be6-83c7-46ec-9051-f5c244c97e2b tempest-SnapshotMetadataTestJSON-183063638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:11:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-94930be6-83c7-46ec-9051-f5c244c97e2b tempest-SnapshotMetadataTestJSON-183063638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:11:44 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-94930be6-83c7-46ec-9051-f5c244c97e2b tempest-SnapshotMetadataTestJSON-183063638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:11:44 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-94930be6-83c7-46ec-9051-f5c244c97e2b tempest-SnapshotMetadataTestJSON-183063638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:11:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-94930be6-83c7-46ec-9051-f5c244c97e2b tempest-SnapshotMetadataTestJSON-183063638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:11:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-94930be6-83c7-46ec-9051-f5c244c97e2b tempest-SnapshotMetadataTestJSON-183063638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:44 devstack sudo[96232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:11:44 devstack sudo[96232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:45 devstack sudo[96232]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-94930be6-83c7-46ec-9051-f5c244c97e2b tempest-SnapshotMetadataTestJSON-183063638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.280s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:45 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-94930be6-83c7-46ec-9051-f5c244c97e2b tempest-SnapshotMetadataTestJSON-183063638 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:11:45 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-94930be6-83c7-46ec-9051-f5c244c97e2b tempest-SnapshotMetadataTestJSON-183063638 None] Deleted volume successfully.
Nov 06 17:11:45 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-94930be6-83c7-46ec-9051-f5c244c97e2b tempest-SnapshotMetadataTestJSON-183063638 None] Lock "cinder-e6877043-9a5b-4c65-bd28-bab6f1e7e382-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:11:45 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6b0677f2-1fae-4c05-8b38-16b9ff262fa6 tempest-VolumesTransfersV355Test-1132847726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-edb26a65-3a5b-4245-b8cf-287ad9dae6c7 1073741824" returned: 0 in 0.579s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6b0677f2-1fae-4c05-8b38-16b9ff262fa6 tempest-VolumesTransfersV355Test-1132847726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-edb26a65-3a5b-4245-b8cf-287ad9dae6c7 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:45 devstack sudo[96239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-edb26a65-3a5b-4245-b8cf-287ad9dae6c7
Nov 06 17:11:45 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b0d56f65-97f1-4b9a-b2f2-a02bf421cdd8 tempest-VolumesActionsTest-4139085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:11:45 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6b0677f2-1fae-4c05-8b38-16b9ff262fa6 tempest-VolumesTransfersV355Test-1132847726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-edb26a65-3a5b-4245-b8cf-287ad9dae6c7" returned: 0 in 0.271s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:45 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-6b0677f2-1fae-4c05-8b38-16b9ff262fa6 tempest-VolumesTransfersV355Test-1132847726 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:11:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6b0677f2-1fae-4c05-8b38-16b9ff262fa6 tempest-VolumesTransfersV355Test-1132847726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:11:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b0d56f65-97f1-4b9a-b2f2-a02bf421cdd8 tempest-VolumesActionsTest-4139085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.240s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:11:45 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6b0677f2-1fae-4c05-8b38-16b9ff262fa6 tempest-VolumesTransfersV355Test-1132847726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e921533d-ff07-427a-988f-c771277014c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edb26a65-3a5b-4245-b8cf-287ad9dae6c7', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:45 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6b0677f2-1fae-4c05-8b38-16b9ff262fa6 tempest-VolumesTransfersV355Test-1132847726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab7d5c1-626d-4644-b14c-3703c45fc61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:45 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fd0384-967d-4c2a-9b7b-67d08a3bd68f]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:11:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b0d56f65-97f1-4b9a-b2f2-a02bf421cdd8 tempest-VolumesActionsTest-4139085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-784376fe-59d9-4d8b-9498-8bd17847925b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:45 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-6b0677f2-1fae-4c05-8b38-16b9ff262fa6 tempest-VolumesTransfersV355Test-1132847726 None] Volume volume-edb26a65-3a5b-4245-b8cf-287ad9dae6c7 (edb26a65-3a5b-4245-b8cf-287ad9dae6c7): created successfully
Nov 06 17:11:45 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6b0677f2-1fae-4c05-8b38-16b9ff262fa6 tempest-VolumesTransfersV355Test-1132847726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab7d5c1-626d-4644-b14c-3703c45fc61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:45 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6b0677f2-1fae-4c05-8b38-16b9ff262fa6 tempest-VolumesTransfersV355Test-1132847726 None] Flow 'volume_create_manager' (b01e269f-8855-4680-a0e8-45e8ac012151) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:11:45 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-6b0677f2-1fae-4c05-8b38-16b9ff262fa6 tempest-VolumesTransfersV355Test-1132847726 None] Created volume successfully.
Nov 06 17:11:45 devstack sudo[96242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-784376fe-59d9-4d8b-9498-8bd17847925b
Nov 06 17:11:45 devstack sudo[96242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:45 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-224b2fd2-8448-43a2-8fd5-6bb41405ad30 tempest-VolumesCloneTest-467777112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:11:45 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-224b2fd2-8448-43a2-8fd5-6bb41405ad30 tempest-VolumesCloneTest-467777112 None] Flow 'volume_create_manager' (2093f374-11bb-4448-a80e-f44cdab0d0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:11:45 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-224b2fd2-8448-43a2-8fd5-6bb41405ad30 tempest-VolumesCloneTest-467777112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (117d4f65-0a20-4f85-86d3-505d8b04a3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:45 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-224b2fd2-8448-43a2-8fd5-6bb41405ad30 tempest-VolumesCloneTest-467777112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (117d4f65-0a20-4f85-86d3-505d8b04a3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1490731659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9727d184-b562-4e99-87ef-e83382ea4116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7afae8c48e6845da9c9b5a8be99de64a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:11:46Z,use_quota=True,user_id='6ab4b89e2f3f42acbedbc725ef716696',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:46 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-224b2fd2-8448-43a2-8fd5-6bb41405ad30 tempest-VolumesCloneTest-467777112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0310716-60e1-458b-837d-6a6d22d8ed28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:46 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-224b2fd2-8448-43a2-8fd5-6bb41405ad30 tempest-VolumesCloneTest-467777112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0310716-60e1-458b-837d-6a6d22d8ed28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:46 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-224b2fd2-8448-43a2-8fd5-6bb41405ad30 tempest-VolumesCloneTest-467777112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b793b8e9-599c-4ffa-98b9-a4cf64c2d557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:46 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-224b2fd2-8448-43a2-8fd5-6bb41405ad30 tempest-VolumesCloneTest-467777112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b793b8e9-599c-4ffa-98b9-a4cf64c2d557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9727d184-b562-4e99-87ef-e83382ea4116', 'volume_name': 'volume-9727d184-b562-4e99-87ef-e83382ea4116', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:46 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-224b2fd2-8448-43a2-8fd5-6bb41405ad30 tempest-VolumesCloneTest-467777112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa521c36-d0c0-4301-a8ab-1bc657da4214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:46 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-224b2fd2-8448-43a2-8fd5-6bb41405ad30 tempest-VolumesCloneTest-467777112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa521c36-d0c0-4301-a8ab-1bc657da4214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:46 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-224b2fd2-8448-43a2-8fd5-6bb41405ad30 tempest-VolumesCloneTest-467777112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf7cd205-dfff-4129-bf6c-59ff3636dcc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:46 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-224b2fd2-8448-43a2-8fd5-6bb41405ad30 tempest-VolumesCloneTest-467777112 None] Volume 9727d184-b562-4e99-87ef-e83382ea4116: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9727d184-b562-4e99-87ef-e83382ea4116', 'volume_size': 1}
Nov 06 17:11:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-224b2fd2-8448-43a2-8fd5-6bb41405ad30 tempest-VolumesCloneTest-467777112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:11:46 devstack sudo[96242]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b0d56f65-97f1-4b9a-b2f2-a02bf421cdd8 tempest-VolumesActionsTest-4139085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-784376fe-59d9-4d8b-9498-8bd17847925b" returned: 0 in 0.410s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:46 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[619dccaa-f3aa-4f4c-b69e-5eb07f0d61e9]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:11:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b0d56f65-97f1-4b9a-b2f2-a02bf421cdd8 tempest-VolumesActionsTest-4139085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-784376fe-59d9-4d8b-9498-8bd17847925b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:46 devstack sudo[96247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-784376fe-59d9-4d8b-9498-8bd17847925b
Nov 06 17:11:46 devstack sudo[96247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:46 devstack sudo[96247]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b0d56f65-97f1-4b9a-b2f2-a02bf421cdd8 tempest-VolumesActionsTest-4139085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-784376fe-59d9-4d8b-9498-8bd17847925b" returned: 0 in 0.385s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b0d56f65-97f1-4b9a-b2f2-a02bf421cdd8 tempest-VolumesActionsTest-4139085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-784376fe-59d9-4d8b-9498-8bd17847925b /opt/stack/data/cinder/conversion/784376fe-59d9-4d8b-9498-8bd17847925b.temp_image.e7d451e8-7d3e-44fa-8830-6270eb13f7bd6353oziv.img {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:46 devstack sudo[96252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-784376fe-59d9-4d8b-9498-8bd17847925b /opt/stack/data/cinder/conversion/784376fe-59d9-4d8b-9498-8bd17847925b.temp_image.e7d451e8-7d3e-44fa-8830-6270eb13f7bd6353oziv.img
Nov 06 17:11:46 devstack sudo[96252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:47 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d4404882-5c8e-4661-b969-40f8b4ac0593 tempest-VolumesTransfersV355Test-1845452878 None] Acquiring lock "cinder-edb26a65-3a5b-4245-b8cf-287ad9dae6c7-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:11:47 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d4404882-5c8e-4661-b969-40f8b4ac0593 tempest-VolumesTransfersV355Test-1845452878 None] Lock "cinder-edb26a65-3a5b-4245-b8cf-287ad9dae6c7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:11:47 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d4404882-5c8e-4661-b969-40f8b4ac0593 tempest-VolumesTransfersV355Test-1845452878 None] Acquiring lock "cinder-quobyte-edb26a65-3a5b-4245-b8cf-287ad9dae6c7" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:11:47 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d4404882-5c8e-4661-b969-40f8b4ac0593 tempest-VolumesTransfersV355Test-1845452878 None] Lock "cinder-quobyte-edb26a65-3a5b-4245-b8cf-287ad9dae6c7" acquired by "delete_volume" :: waited 0.024s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:11:47 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[33411933-2a46-416b-a25c-45de463b9662]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:11:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d4404882-5c8e-4661-b969-40f8b4ac0593 tempest-VolumesTransfersV355Test-1845452878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-edb26a65-3a5b-4245-b8cf-287ad9dae6c7 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:47 devstack sudo[96264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-edb26a65-3a5b-4245-b8cf-287ad9dae6c7
Nov 06 17:11:47 devstack sudo[96264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:47 devstack sudo[96264]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d4404882-5c8e-4661-b969-40f8b4ac0593 tempest-VolumesTransfersV355Test-1845452878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-edb26a65-3a5b-4245-b8cf-287ad9dae6c7" returned: 0 in 0.599s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d4404882-5c8e-4661-b969-40f8b4ac0593 tempest-VolumesTransfersV355Test-1845452878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-edb26a65-3a5b-4245-b8cf-287ad9dae6c7 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:47 devstack sudo[96269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-edb26a65-3a5b-4245-b8cf-287ad9dae6c7
Nov 06 17:11:48 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:48 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d4404882-5c8e-4661-b969-40f8b4ac0593 tempest-VolumesTransfersV355Test-1845452878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-edb26a65-3a5b-4245-b8cf-287ad9dae6c7" returned: 0 in 0.694s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:48 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d4404882-5c8e-4661-b969-40f8b4ac0593 tempest-VolumesTransfersV355Test-1845452878 None] Lock "cinder-quobyte-edb26a65-3a5b-4245-b8cf-287ad9dae6c7" released by "delete_volume" :: held 1.402s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:11:48 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-d4404882-5c8e-4661-b969-40f8b4ac0593 tempest-VolumesTransfersV355Test-1845452878 None] Created reservations ['8a26d798-4501-4715-8f69-367c27049904', '1f344db6-f9e5-4bba-8a2c-a4877c71d92c', '697c2b0b-2fd5-4b8a-9689-8842edf96ea3', '5f1789b5-3aea-4e9c-bd0f-dd261dc9d1bc'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:11:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d4404882-5c8e-4661-b969-40f8b4ac0593 tempest-VolumesTransfersV355Test-1845452878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:11:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d4404882-5c8e-4661-b969-40f8b4ac0593 tempest-VolumesTransfersV355Test-1845452878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:11:48 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d4404882-5c8e-4661-b969-40f8b4ac0593 tempest-VolumesTransfersV355Test-1845452878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:11:48 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d4404882-5c8e-4661-b969-40f8b4ac0593 tempest-VolumesTransfersV355Test-1845452878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:11:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d4404882-5c8e-4661-b969-40f8b4ac0593 tempest-VolumesTransfersV355Test-1845452878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:11:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d4404882-5c8e-4661-b969-40f8b4ac0593 tempest-VolumesTransfersV355Test-1845452878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:49 devstack sudo[96272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:11:49 devstack sudo[96272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:49 devstack sudo[96272]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d4404882-5c8e-4661-b969-40f8b4ac0593 tempest-VolumesTransfersV355Test-1845452878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.479s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:49 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-d4404882-5c8e-4661-b969-40f8b4ac0593 tempest-VolumesTransfersV355Test-1845452878 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:11:49 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-d4404882-5c8e-4661-b969-40f8b4ac0593 tempest-VolumesTransfersV355Test-1845452878 None] Deleted volume successfully.
Nov 06 17:11:49 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d4404882-5c8e-4661-b969-40f8b4ac0593 tempest-VolumesTransfersV355Test-1845452878 None] Lock "cinder-edb26a65-3a5b-4245-b8cf-287ad9dae6c7-delete_volume" released by "delete_volume" :: held 2.348s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:11:53 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e939e04-d2df-47ee-9443-217366020241 tempest-VolumesMetadataTest-887884246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:11:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5e939e04-d2df-47ee-9443-217366020241 tempest-VolumesMetadataTest-887884246 None] Flow 'volume_create_manager' (e2ff88f3-95c1-4d7d-be74-e089e4c93527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:11:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5e939e04-d2df-47ee-9443-217366020241 tempest-VolumesMetadataTest-887884246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (229d1d37-d9a8-427c-aebd-f15a4e5bed16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5e939e04-d2df-47ee-9443-217366020241 tempest-VolumesMetadataTest-887884246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (229d1d37-d9a8-427c-aebd-f15a4e5bed16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1462485315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c790960-6f64-464c-adf8-49bd819cf6fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='937fc64fa125499c8160549153a298fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:11:53Z,use_quota=True,user_id='9b597aea0e7c4a60980f61228be5013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5e939e04-d2df-47ee-9443-217366020241 tempest-VolumesMetadataTest-887884246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57075d28-25f9-4fe1-81ce-7bca2ab1b82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5e939e04-d2df-47ee-9443-217366020241 tempest-VolumesMetadataTest-887884246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57075d28-25f9-4fe1-81ce-7bca2ab1b82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5e939e04-d2df-47ee-9443-217366020241 tempest-VolumesMetadataTest-887884246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fc29c6e-a916-46fc-933b-8f3fb7db6ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5e939e04-d2df-47ee-9443-217366020241 tempest-VolumesMetadataTest-887884246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fc29c6e-a916-46fc-933b-8f3fb7db6ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c790960-6f64-464c-adf8-49bd819cf6fc', 'volume_name': 'volume-7c790960-6f64-464c-adf8-49bd819cf6fc', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5e939e04-d2df-47ee-9443-217366020241 tempest-VolumesMetadataTest-887884246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (612f9402-c4cf-413d-985a-3b4706a2c5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5e939e04-d2df-47ee-9443-217366020241 tempest-VolumesMetadataTest-887884246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (612f9402-c4cf-413d-985a-3b4706a2c5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5e939e04-d2df-47ee-9443-217366020241 tempest-VolumesMetadataTest-887884246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d83f2d34-8f4a-41f0-8f87-32fc20171ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:53 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-5e939e04-d2df-47ee-9443-217366020241 tempest-VolumesMetadataTest-887884246 None] Volume 7c790960-6f64-464c-adf8-49bd819cf6fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c790960-6f64-464c-adf8-49bd819cf6fc', 'volume_size': 1}
Nov 06 17:11:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5e939e04-d2df-47ee-9443-217366020241 tempest-VolumesMetadataTest-887884246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:11:54 devstack sudo[96252]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b0d56f65-97f1-4b9a-b2f2-a02bf421cdd8 tempest-VolumesActionsTest-4139085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-784376fe-59d9-4d8b-9498-8bd17847925b /opt/stack/data/cinder/conversion/784376fe-59d9-4d8b-9498-8bd17847925b.temp_image.e7d451e8-7d3e-44fa-8830-6270eb13f7bd6353oziv.img" returned: 0 in 7.948s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:54 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8ed801-1221-41d8-a0b3-106127896590]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:11:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b0d56f65-97f1-4b9a-b2f2-a02bf421cdd8 tempest-VolumesActionsTest-4139085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-784376fe-59d9-4d8b-9498-8bd17847925b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:54 devstack sudo[96277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-784376fe-59d9-4d8b-9498-8bd17847925b
Nov 06 17:11:54 devstack sudo[96277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:55 devstack sudo[96277]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b0d56f65-97f1-4b9a-b2f2-a02bf421cdd8 tempest-VolumesActionsTest-4139085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-784376fe-59d9-4d8b-9498-8bd17847925b" returned: 0 in 0.575s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:55 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-b0d56f65-97f1-4b9a-b2f2-a02bf421cdd8 tempest-VolumesActionsTest-4139085 None] Image conversion details: src /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-784376fe-59d9-4d8b-9498-8bd17847925b, size 1024.00 MB, duration 7.95 sec, destination /opt/stack/data/cinder/conversion/784376fe-59d9-4d8b-9498-8bd17847925b.temp_image.e7d451e8-7d3e-44fa-8830-6270eb13f7bd6353oziv.img {{(pid=86856) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 17:11:55 devstack cinder-volume[86856]: INFO cinder.image.image_utils [None req-b0d56f65-97f1-4b9a-b2f2-a02bf421cdd8 tempest-VolumesActionsTest-4139085 None] Converted 1024.00 MB image at 128.79 MB/s
Nov 06 17:11:55 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-b0d56f65-97f1-4b9a-b2f2-a02bf421cdd8 tempest-VolumesActionsTest-4139085 None] e7d451e8-7d3e-44fa-8830-6270eb13f7bd was raw, no need to convert to raw {{(pid=86856) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Nov 06 17:11:58 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:11:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Flow 'volume_create_manager' (9f68dba0-60d5-41d5-8b07-7d5afa65fe9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:11:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00d1b954-e659-47ee-adab-0813538e527c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00d1b954-e659-47ee-adab-0813538e527c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:11:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-236488667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1835cf04-555f-4653-a81d-bd135b6ae77b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e045179f313455c9ab197d3182c4b40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:11:59Z,use_quota=True,user_id='b9e6aef4296f459fb76c8f93390d4ad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a4de60c-1f06-4619-9875-d71e998794da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a4de60c-1f06-4619-9875-d71e998794da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1803a0aa-7bf5-4687-9458-22070ac23e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:58 devstack cinder-volume[86856]: DEBUG cinder.image.glance [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Creating Keystone auth plugin from conf {{(pid=86856) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 06 17:11:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1803a0aa-7bf5-4687-9458-22070ac23e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1835cf04-555f-4653-a81d-bd135b6ae77b', 'volume_name': 'volume-1835cf04-555f-4653-a81d-bd135b6ae77b', 'volume_size': 1, 'image_id': '420ae2ee-253a-40a6-ad62-b130f2314d4a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/420ae2ee-253a-40a6-ad62-b130f2314d4a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '805e2cf12fa14002ae5dfa994733f868', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '420ae2ee-253a-40a6-ad62-b130f2314d4a', 'created_at': datetime.datetime(2026, 11, 6, 15, 57, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 15, 57, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/420ae2ee-253a-40a6-ad62-b130f2314d4a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x71da66f89a90>}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2b3afa8-b69c-4071-8337-8715cced84df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2b3afa8-b69c-4071-8337-8715cced84df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:11:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6949e4e9-13d4-4536-a593-f3cd367784c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:11:58 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Volume 1835cf04-555f-4653-a81d-bd135b6ae77b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1835cf04-555f-4653-a81d-bd135b6ae77b', 'volume_size': 1, 'image_id': '420ae2ee-253a-40a6-ad62-b130f2314d4a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/420ae2ee-253a-40a6-ad62-b130f2314d4a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '805e2cf12fa14002ae5dfa994733f868', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '420ae2ee-253a-40a6-ad62-b130f2314d4a', 'created_at': datetime.datetime(2026, 11, 6, 15, 57, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 15, 57, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/420ae2ee-253a-40a6-ad62-b130f2314d4a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x71da66f89a90>}
Nov 06 17:11:58 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Trying to clone 1835cf04-555f-4653-a81d-bd135b6ae77b from image 420ae2ee-253a-40a6-ad62-b130f2314d4a at location (None, [{'url': 'file:///opt/stack/data/glance/images/420ae2ee-253a-40a6-ad62-b130f2314d4a', 'metadata': {}}]). {{(pid=86856) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 06 17:11:59 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_nzj5617edevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86856) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 06 17:11:59 devstack cinder-volume[86856]: INFO cinder.image.image_utils [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Image download 20.69 MB at 20.69 MB/s
Nov 06 17:11:59 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc83ec7-d172-4c41-a833-7c0bb356cfbb]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:11:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_nzj5617edevstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:59 devstack sudo[96285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_nzj5617edevstack@QuobyteHD
Nov 06 17:11:59 devstack sudo[96285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:11:59 devstack sudo[96285]: pam_unix(sudo:session): session closed for user root
Nov 06 17:11:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_nzj5617edevstack@QuobyteHD" returned: 0 in 0.335s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:11:59 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Temporary image 420ae2ee-253a-40a6-ad62-b130f2314d4a is fetched for user b9e6aef4296f459fb76c8f93390d4ad1. {{(pid=86856) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 06 17:11:59 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8f3af9-0b6d-49d6-b98b-069994f6ab70]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:11:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_nzj5617edevstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:11:59 devstack sudo[96290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_nzj5617edevstack@QuobyteHD
Nov 06 17:11:59 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:00 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_nzj5617edevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:12:09 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=17,cinder:INSERT=3,cinder:UPDATE=21,cinder:DELETE=2 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:12:09 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=27,cinder:INSERT=12,cinder:UPDATE=33,cinder:DELETE=2 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:12:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b0d56f65-97f1-4b9a-b2f2-a02bf421cdd8 tempest-VolumesActionsTest-4139085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.059s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:12:14 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b0d56f65-97f1-4b9a-b2f2-a02bf421cdd8 tempest-VolumesActionsTest-4139085 None] Uploaded volume to glance image-id: e7d451e8-7d3e-44fa-8830-6270eb13f7bd. {{(pid=86856) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 06 17:12:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-224b2fd2-8448-43a2-8fd5-6bb41405ad30 tempest-VolumesCloneTest-467777112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.739s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:12:14 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-224b2fd2-8448-43a2-8fd5-6bb41405ad30 tempest-VolumesCloneTest-467777112 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1490731659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9727d184-b562-4e99-87ef-e83382ea4116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7afae8c48e6845da9c9b5a8be99de64a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:11:46Z,use_quota=True,user_id='6ab4b89e2f3f42acbedbc725ef716696',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:12:14 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-224b2fd2-8448-43a2-8fd5-6bb41405ad30 tempest-VolumesCloneTest-467777112 None] Creating volume 9727d184-b562-4e99-87ef-e83382ea4116 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:12:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-224b2fd2-8448-43a2-8fd5-6bb41405ad30 tempest-VolumesCloneTest-467777112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:12:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-224b2fd2-8448-43a2-8fd5-6bb41405ad30 tempest-VolumesCloneTest-467777112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:12:14 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-224b2fd2-8448-43a2-8fd5-6bb41405ad30 tempest-VolumesCloneTest-467777112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:12:14 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-224b2fd2-8448-43a2-8fd5-6bb41405ad30 tempest-VolumesCloneTest-467777112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:12:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-224b2fd2-8448-43a2-8fd5-6bb41405ad30 tempest-VolumesCloneTest-467777112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:12:14 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-224b2fd2-8448-43a2-8fd5-6bb41405ad30 tempest-VolumesCloneTest-467777112 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:12:14 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-224b2fd2-8448-43a2-8fd5-6bb41405ad30 tempest-VolumesCloneTest-467777112 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:12:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-224b2fd2-8448-43a2-8fd5-6bb41405ad30 tempest-VolumesCloneTest-467777112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:14 devstack sudo[96298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116 1073741824
Nov 06 17:12:14 devstack sudo[96298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:14 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-b0d56f65-97f1-4b9a-b2f2-a02bf421cdd8 tempest-VolumesActionsTest-4139085 None] Copy volume to image completed successfully.
Nov 06 17:12:15 devstack sudo[96298]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-224b2fd2-8448-43a2-8fd5-6bb41405ad30 tempest-VolumesCloneTest-467777112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116 1073741824" returned: 0 in 0.440s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-224b2fd2-8448-43a2-8fd5-6bb41405ad30 tempest-VolumesCloneTest-467777112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:15 devstack sudo[96304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116
Nov 06 17:12:15 devstack sudo[96304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:15 devstack sudo[96304]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-224b2fd2-8448-43a2-8fd5-6bb41405ad30 tempest-VolumesCloneTest-467777112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116" returned: 0 in 0.249s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:15 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-224b2fd2-8448-43a2-8fd5-6bb41405ad30 tempest-VolumesCloneTest-467777112 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:12:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-224b2fd2-8448-43a2-8fd5-6bb41405ad30 tempest-VolumesCloneTest-467777112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:12:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5e939e04-d2df-47ee-9443-217366020241 tempest-VolumesMetadataTest-887884246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.326s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:12:15 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5e939e04-d2df-47ee-9443-217366020241 tempest-VolumesMetadataTest-887884246 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1462485315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c790960-6f64-464c-adf8-49bd819cf6fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='937fc64fa125499c8160549153a298fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:11:53Z,use_quota=True,user_id='9b597aea0e7c4a60980f61228be5013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:12:15 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-5e939e04-d2df-47ee-9443-217366020241 tempest-VolumesMetadataTest-887884246 None] Creating volume 7c790960-6f64-464c-adf8-49bd819cf6fc {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:12:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5e939e04-d2df-47ee-9443-217366020241 tempest-VolumesMetadataTest-887884246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:12:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5e939e04-d2df-47ee-9443-217366020241 tempest-VolumesMetadataTest-887884246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:12:15 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5e939e04-d2df-47ee-9443-217366020241 tempest-VolumesMetadataTest-887884246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:12:15 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5e939e04-d2df-47ee-9443-217366020241 tempest-VolumesMetadataTest-887884246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:12:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5e939e04-d2df-47ee-9443-217366020241 tempest-VolumesMetadataTest-887884246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:12:15 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5e939e04-d2df-47ee-9443-217366020241 tempest-VolumesMetadataTest-887884246 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:12:15 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-5e939e04-d2df-47ee-9443-217366020241 tempest-VolumesMetadataTest-887884246 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:12:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5e939e04-d2df-47ee-9443-217366020241 tempest-VolumesMetadataTest-887884246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7c790960-6f64-464c-adf8-49bd819cf6fc 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:15 devstack sudo[96307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7c790960-6f64-464c-adf8-49bd819cf6fc 1073741824
Nov 06 17:12:15 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-224b2fd2-8448-43a2-8fd5-6bb41405ad30 tempest-VolumesCloneTest-467777112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf7cd205-dfff-4129-bf6c-59ff3636dcc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9727d184-b562-4e99-87ef-e83382ea4116', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-224b2fd2-8448-43a2-8fd5-6bb41405ad30 tempest-VolumesCloneTest-467777112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca2b5a4-c23f-4414-82f9-ef7a95c0a7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:15 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-224b2fd2-8448-43a2-8fd5-6bb41405ad30 tempest-VolumesCloneTest-467777112 None] Volume volume-9727d184-b562-4e99-87ef-e83382ea4116 (9727d184-b562-4e99-87ef-e83382ea4116): created successfully
Nov 06 17:12:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-224b2fd2-8448-43a2-8fd5-6bb41405ad30 tempest-VolumesCloneTest-467777112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca2b5a4-c23f-4414-82f9-ef7a95c0a7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-224b2fd2-8448-43a2-8fd5-6bb41405ad30 tempest-VolumesCloneTest-467777112 None] Flow 'volume_create_manager' (2093f374-11bb-4448-a80e-f44cdab0d0b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:12:15 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-224b2fd2-8448-43a2-8fd5-6bb41405ad30 tempest-VolumesCloneTest-467777112 None] Created volume successfully.
Nov 06 17:12:15 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5e939e04-d2df-47ee-9443-217366020241 tempest-VolumesMetadataTest-887884246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7c790960-6f64-464c-adf8-49bd819cf6fc 1073741824" returned: 0 in 0.443s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5e939e04-d2df-47ee-9443-217366020241 tempest-VolumesMetadataTest-887884246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7c790960-6f64-464c-adf8-49bd819cf6fc {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:16 devstack sudo[96313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7c790960-6f64-464c-adf8-49bd819cf6fc
Nov 06 17:12:16 devstack sudo[96313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:16 devstack sudo[96313]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5e939e04-d2df-47ee-9443-217366020241 tempest-VolumesMetadataTest-887884246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7c790960-6f64-464c-adf8-49bd819cf6fc" returned: 0 in 0.268s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:16 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5e939e04-d2df-47ee-9443-217366020241 tempest-VolumesMetadataTest-887884246 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:12:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5e939e04-d2df-47ee-9443-217366020241 tempest-VolumesMetadataTest-887884246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:12:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.104s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:12:16 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:11:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-236488667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1835cf04-555f-4653-a81d-bd135b6ae77b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e045179f313455c9ab197d3182c4b40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:11:59Z,use_quota=True,user_id='b9e6aef4296f459fb76c8f93390d4ad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:12:16 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Creating volume 1835cf04-555f-4653-a81d-bd135b6ae77b {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:12:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:12:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:12:16 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:12:16 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:12:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:12:16 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:12:16 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:12:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1835cf04-555f-4653-a81d-bd135b6ae77b 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5e939e04-d2df-47ee-9443-217366020241 tempest-VolumesMetadataTest-887884246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d83f2d34-8f4a-41f0-8f87-32fc20171ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c790960-6f64-464c-adf8-49bd819cf6fc', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5e939e04-d2df-47ee-9443-217366020241 tempest-VolumesMetadataTest-887884246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06f53949-b28f-4e6a-bbc3-158db2b94815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:16 devstack sudo[96316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1835cf04-555f-4653-a81d-bd135b6ae77b 1073741824
Nov 06 17:12:16 devstack sudo[96316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:16 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-5e939e04-d2df-47ee-9443-217366020241 tempest-VolumesMetadataTest-887884246 None] Volume volume-7c790960-6f64-464c-adf8-49bd819cf6fc (7c790960-6f64-464c-adf8-49bd819cf6fc): created successfully
Nov 06 17:12:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5e939e04-d2df-47ee-9443-217366020241 tempest-VolumesMetadataTest-887884246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06f53949-b28f-4e6a-bbc3-158db2b94815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5e939e04-d2df-47ee-9443-217366020241 tempest-VolumesMetadataTest-887884246 None] Flow 'volume_create_manager' (e2ff88f3-95c1-4d7d-be74-e089e4c93527) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:12:16 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-5e939e04-d2df-47ee-9443-217366020241 tempest-VolumesMetadataTest-887884246 None] Created volume successfully.
Nov 06 17:12:16 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:12:16 devstack sudo[96316]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1835cf04-555f-4653-a81d-bd135b6ae77b 1073741824" returned: 0 in 0.587s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Flow 'volume_create_manager' (1f5fdacd-da2c-4ba7-a89d-0684fd486795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:12:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19d06da2-4643-4381-9950-1b7e87e61145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2eaa7869-a104-486c-8c29-7e5af83efc72 tempest-VolumesActionsTest-4139085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:12:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19d06da2-4643-4381-9950-1b7e87e61145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1113145298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57a3b81f-13f1-458f-ac29-3cc9bb3997ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7afae8c48e6845da9c9b5a8be99de64a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:12:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=9727d184-b562-4e99-87ef-e83382ea4116,status='creating',terminated_at=None,updated_at=2026-11-06T16:12:17Z,use_quota=True,user_id='6ab4b89e2f3f42acbedbc725ef716696',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7d6b95f-6c83-4ec1-882b-f3db0afea44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7d6b95f-6c83-4ec1-882b-f3db0afea44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (320deead-6b4a-4e1a-9efd-8c9b53a98e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (320deead-6b4a-4e1a-9efd-8c9b53a98e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '57a3b81f-13f1-458f-ac29-3cc9bb3997ea', 'volume_name': 'volume-57a3b81f-13f1-458f-ac29-3cc9bb3997ea', 'volume_size': 2, 'source_volid': '9727d184-b562-4e99-87ef-e83382ea4116', 'source_volstatus': 'available'}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82708ebd-3161-4261-af5c-b37144598ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82708ebd-3161-4261-af5c-b37144598ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcece2d7-d28c-4dac-8269-e427c0225a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:17 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Volume 57a3b81f-13f1-458f-ac29-3cc9bb3997ea: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-57a3b81f-13f1-458f-ac29-3cc9bb3997ea', 'volume_size': 2, 'source_volid': '9727d184-b562-4e99-87ef-e83382ea4116', 'source_volstatus': 'available'}
Nov 06 17:12:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1835cf04-555f-4653-a81d-bd135b6ae77b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:12:17 devstack sudo[96322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1835cf04-555f-4653-a81d-bd135b6ae77b
Nov 06 17:12:17 devstack sudo[96322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:17 devstack sudo[96322]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1835cf04-555f-4653-a81d-bd135b6ae77b" returned: 0 in 0.245s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:17 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:12:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:12:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2eaa7869-a104-486c-8c29-7e5af83efc72 tempest-VolumesActionsTest-4139085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.327s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:12:17 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[149c0ec2-999e-492d-b6ff-bf34c53d6c1e]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:12:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2eaa7869-a104-486c-8c29-7e5af83efc72 tempest-VolumesActionsTest-4139085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-784376fe-59d9-4d8b-9498-8bd17847925b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:17 devstack cinder-volume[86856]: DEBUG cinder.volume.volume_utils [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Attempting download of 420ae2ee-253a-40a6-ad62-b130f2314d4a ((None, [{'url': 'file:///opt/stack/data/glance/images/420ae2ee-253a-40a6-ad62-b130f2314d4a', 'metadata': {}}])) to volume 1835cf04-555f-4653-a81d-bd135b6ae77b. {{(pid=86856) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 06 17:12:17 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c0f1c3-7ea8-4a1f-b031-183dee52bf86]: (4, 'raw') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:12:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_420ae2ee-253a-40a6-ad62-b130f2314d4a_88j9rx7n {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:17 devstack sudo[96325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-784376fe-59d9-4d8b-9498-8bd17847925b
Nov 06 17:12:17 devstack sudo[96325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:17 devstack sudo[96326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_420ae2ee-253a-40a6-ad62-b130f2314d4a_88j9rx7n
Nov 06 17:12:17 devstack sudo[96326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:17 devstack sudo[96326]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_420ae2ee-253a-40a6-ad62-b130f2314d4a_88j9rx7n" returned: 0 in 0.338s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_420ae2ee-253a-40a6-ad62-b130f2314d4a_88j9rx7n {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:17 devstack sudo[96325]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2eaa7869-a104-486c-8c29-7e5af83efc72 tempest-VolumesActionsTest-4139085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-784376fe-59d9-4d8b-9498-8bd17847925b" returned: 0 in 0.433s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:17 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5822269-db6f-4e09-abba-a3b32682a114]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:12:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2eaa7869-a104-486c-8c29-7e5af83efc72 tempest-VolumesActionsTest-4139085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-784376fe-59d9-4d8b-9498-8bd17847925b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:17 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7c7cfe62-4a57-4cb5-9cc5-ccfc14e0e985 tempest-VolumesMetadataTest-887884246 None] Acquiring lock "cinder-7c790960-6f64-464c-adf8-49bd819cf6fc-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:12:17 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7c7cfe62-4a57-4cb5-9cc5-ccfc14e0e985 tempest-VolumesMetadataTest-887884246 None] Lock "cinder-7c790960-6f64-464c-adf8-49bd819cf6fc-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:12:17 devstack sudo[96334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_420ae2ee-253a-40a6-ad62-b130f2314d4a_88j9rx7n
Nov 06 17:12:17 devstack sudo[96334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:17 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7c7cfe62-4a57-4cb5-9cc5-ccfc14e0e985 tempest-VolumesMetadataTest-887884246 None] Acquiring lock "cinder-quobyte-7c790960-6f64-464c-adf8-49bd819cf6fc" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:12:17 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7c7cfe62-4a57-4cb5-9cc5-ccfc14e0e985 tempest-VolumesMetadataTest-887884246 None] Lock "cinder-quobyte-7c790960-6f64-464c-adf8-49bd819cf6fc" acquired by "delete_volume" :: waited 0.023s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:12:17 devstack sudo[96335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-784376fe-59d9-4d8b-9498-8bd17847925b
Nov 06 17:12:17 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:17 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[f673237d-deaf-4d1f-a5b6-4736daf1b62d]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:12:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7c7cfe62-4a57-4cb5-9cc5-ccfc14e0e985 tempest-VolumesMetadataTest-887884246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7c790960-6f64-464c-adf8-49bd819cf6fc {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:18 devstack sudo[96338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7c790960-6f64-464c-adf8-49bd819cf6fc
Nov 06 17:12:18 devstack sudo[96338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:18 devstack sudo[96334]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_420ae2ee-253a-40a6-ad62-b130f2314d4a_88j9rx7n" returned: 1 in 0.413s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_420ae2ee-253a-40a6-ad62-b130f2314d4a_88j9rx7n' failed. Not Retrying. {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 17:12:18 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ece92c3-512b-4735-8163-a61eda306c40]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:12:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_nzj5617edevstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:18 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2eaa7869-a104-486c-8c29-7e5af83efc72 tempest-VolumesActionsTest-4139085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-784376fe-59d9-4d8b-9498-8bd17847925b" returned: 0 in 0.448s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2eaa7869-a104-486c-8c29-7e5af83efc72 tempest-VolumesActionsTest-4139085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-784376fe-59d9-4d8b-9498-8bd17847925b /opt/stack/data/cinder/conversion/784376fe-59d9-4d8b-9498-8bd17847925b.temp_image.81e38ff0-6d7d-4a82-a2ff-fd1126059e58pm94o1vv.img {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:18 devstack sudo[96346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-784376fe-59d9-4d8b-9498-8bd17847925b /opt/stack/data/cinder/conversion/784376fe-59d9-4d8b-9498-8bd17847925b.temp_image.81e38ff0-6d7d-4a82-a2ff-fd1126059e58pm94o1vv.img
Nov 06 17:12:18 devstack sudo[96346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:18 devstack sudo[96344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_nzj5617edevstack@QuobyteHD
Nov 06 17:12:18 devstack sudo[96344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:18 devstack sudo[96338]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7c7cfe62-4a57-4cb5-9cc5-ccfc14e0e985 tempest-VolumesMetadataTest-887884246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7c790960-6f64-464c-adf8-49bd819cf6fc" returned: 0 in 0.366s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7c7cfe62-4a57-4cb5-9cc5-ccfc14e0e985 tempest-VolumesMetadataTest-887884246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7c790960-6f64-464c-adf8-49bd819cf6fc {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:18 devstack sudo[96352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7c790960-6f64-464c-adf8-49bd819cf6fc
Nov 06 17:12:18 devstack sudo[96352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:18 devstack sudo[96344]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_nzj5617edevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:18 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] 420ae2ee-253a-40a6-ad62-b130f2314d4a was qcow2, converting to qcow2 {{(pid=86856) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 06 17:12:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_nzj5617edevstack@QuobyteHD /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1835cf04-555f-4653-a81d-bd135b6ae77b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:18 devstack sudo[96364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_nzj5617edevstack@QuobyteHD /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1835cf04-555f-4653-a81d-bd135b6ae77b
Nov 06 17:12:18 devstack sudo[96364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:18 devstack sudo[96352]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7c7cfe62-4a57-4cb5-9cc5-ccfc14e0e985 tempest-VolumesMetadataTest-887884246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7c790960-6f64-464c-adf8-49bd819cf6fc" returned: 0 in 0.289s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:18 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7c7cfe62-4a57-4cb5-9cc5-ccfc14e0e985 tempest-VolumesMetadataTest-887884246 None] Lock "cinder-quobyte-7c790960-6f64-464c-adf8-49bd819cf6fc" released by "delete_volume" :: held 0.712s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:12:18 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-7c7cfe62-4a57-4cb5-9cc5-ccfc14e0e985 tempest-VolumesMetadataTest-887884246 None] Created reservations ['6a9ebb01-f546-4e19-9edd-eeef0d3928f6', 'bd6583b5-3b0a-4216-bb37-fd877ff266f9', '681aaf6b-0e8a-4a86-8b04-b8fb656915d1', 'c25e1235-4feb-4c06-8e57-5395c0e8ad56'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:12:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7c7cfe62-4a57-4cb5-9cc5-ccfc14e0e985 tempest-VolumesMetadataTest-887884246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:12:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7c7cfe62-4a57-4cb5-9cc5-ccfc14e0e985 tempest-VolumesMetadataTest-887884246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:12:18 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7c7cfe62-4a57-4cb5-9cc5-ccfc14e0e985 tempest-VolumesMetadataTest-887884246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:12:18 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7c7cfe62-4a57-4cb5-9cc5-ccfc14e0e985 tempest-VolumesMetadataTest-887884246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:12:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7c7cfe62-4a57-4cb5-9cc5-ccfc14e0e985 tempest-VolumesMetadataTest-887884246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:12:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7c7cfe62-4a57-4cb5-9cc5-ccfc14e0e985 tempest-VolumesMetadataTest-887884246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:18 devstack sudo[96373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:12:18 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:19 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7c7cfe62-4a57-4cb5-9cc5-ccfc14e0e985 tempest-VolumesMetadataTest-887884246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.568s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:19 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-7c7cfe62-4a57-4cb5-9cc5-ccfc14e0e985 tempest-VolumesMetadataTest-887884246 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:12:19 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-7c7cfe62-4a57-4cb5-9cc5-ccfc14e0e985 tempest-VolumesMetadataTest-887884246 None] Deleted volume successfully.
Nov 06 17:12:19 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7c7cfe62-4a57-4cb5-9cc5-ccfc14e0e985 tempest-VolumesMetadataTest-887884246 None] Lock "cinder-7c790960-6f64-464c-adf8-49bd819cf6fc-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:12:24 devstack sudo[96364]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_nzj5617edevstack@QuobyteHD /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1835cf04-555f-4653-a81d-bd135b6ae77b" returned: 0 in 5.608s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:24 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_nzj5617edevstack@QuobyteHD, size 112.00 MB, duration 5.61 sec, destination /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1835cf04-555f-4653-a81d-bd135b6ae77b {{(pid=86856) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 17:12:24 devstack cinder-volume[86856]: INFO cinder.image.image_utils [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Converted 112.00 MB image at 19.96 MB/s
Nov 06 17:12:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1835cf04-555f-4653-a81d-bd135b6ae77b 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:24 devstack sudo[96383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1835cf04-555f-4653-a81d-bd135b6ae77b 1G
Nov 06 17:12:24 devstack sudo[96383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:24 devstack sudo[96383]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1835cf04-555f-4653-a81d-bd135b6ae77b 1G" returned: 0 in 0.634s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:24 devstack cinder-volume[86856]: DEBUG cinder.volume.volume_utils [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Downloaded image 420ae2ee-253a-40a6-ad62-b130f2314d4a ((None, [{'url': 'file:///opt/stack/data/glance/images/420ae2ee-253a-40a6-ad62-b130f2314d4a', 'metadata': {}}])) to volume 1835cf04-555f-4653-a81d-bd135b6ae77b successfully. {{(pid=86856) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 06 17:12:24 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Temporary image 420ae2ee-253a-40a6-ad62-b130f2314d4a for user b9e6aef4296f459fb76c8f93390d4ad1 is deleted. {{(pid=86856) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 06 17:12:24 devstack cinder-volume[86856]: DEBUG cinder.volume.volume_utils [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Marking volume 1835cf04-555f-4653-a81d-bd135b6ae77b as bootable. {{(pid=86856) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 06 17:12:24 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Copying metadata from image 420ae2ee-253a-40a6-ad62-b130f2314d4a to 1835cf04-555f-4653-a81d-bd135b6ae77b. {{(pid=86856) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 06 17:12:24 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Creating volume glance metadata for volume 1835cf04-555f-4653-a81d-bd135b6ae77b backed by image 420ae2ee-253a-40a6-ad62-b130f2314d4a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '420ae2ee-253a-40a6-ad62-b130f2314d4a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86856) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 06 17:12:24 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6949e4e9-13d4-4536-a593-f3cd367784c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1835cf04-555f-4653-a81d-bd135b6ae77b', 'volume_size': 1, 'image_id': '420ae2ee-253a-40a6-ad62-b130f2314d4a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/420ae2ee-253a-40a6-ad62-b130f2314d4a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '805e2cf12fa14002ae5dfa994733f868', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '420ae2ee-253a-40a6-ad62-b130f2314d4a', 'created_at': datetime.datetime(2026, 11, 6, 15, 57, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 15, 57, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/420ae2ee-253a-40a6-ad62-b130f2314d4a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x71da66f89a90>}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:24 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b1c3dd2-837d-424b-b72c-ab494ff4b9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:24 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Volume volume-1835cf04-555f-4653-a81d-bd135b6ae77b (1835cf04-555f-4653-a81d-bd135b6ae77b): created successfully
Nov 06 17:12:24 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b1c3dd2-837d-424b-b72c-ab494ff4b9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:24 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Flow 'volume_create_manager' (9f68dba0-60d5-41d5-8b07-7d5afa65fe9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:12:24 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-4b630187-37e0-4997-b13b-7fa5afc5c245 tempest-VolumesExtendTest-859689844 None] Created volume successfully.
Nov 06 17:12:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f98782b6-8c3a-4acb-ac7c-bdf767db81d4 tempest-VolumesExtendTest-859689844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:12:26 devstack sudo[96346]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2eaa7869-a104-486c-8c29-7e5af83efc72 tempest-VolumesActionsTest-4139085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-784376fe-59d9-4d8b-9498-8bd17847925b /opt/stack/data/cinder/conversion/784376fe-59d9-4d8b-9498-8bd17847925b.temp_image.81e38ff0-6d7d-4a82-a2ff-fd1126059e58pm94o1vv.img" returned: 0 in 8.092s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:26 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ffb135-c138-4a4d-a69c-8a2ff6c34ba5]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:12:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2eaa7869-a104-486c-8c29-7e5af83efc72 tempest-VolumesActionsTest-4139085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-784376fe-59d9-4d8b-9498-8bd17847925b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:26 devstack sudo[96388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-784376fe-59d9-4d8b-9498-8bd17847925b
Nov 06 17:12:26 devstack sudo[96388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:26 devstack sudo[96388]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2eaa7869-a104-486c-8c29-7e5af83efc72 tempest-VolumesActionsTest-4139085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-784376fe-59d9-4d8b-9498-8bd17847925b" returned: 0 in 0.545s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:26 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-2eaa7869-a104-486c-8c29-7e5af83efc72 tempest-VolumesActionsTest-4139085 None] Image conversion details: src /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-784376fe-59d9-4d8b-9498-8bd17847925b, size 1024.00 MB, duration 8.09 sec, destination /opt/stack/data/cinder/conversion/784376fe-59d9-4d8b-9498-8bd17847925b.temp_image.81e38ff0-6d7d-4a82-a2ff-fd1126059e58pm94o1vv.img {{(pid=86856) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 17:12:26 devstack cinder-volume[86856]: INFO cinder.image.image_utils [None req-2eaa7869-a104-486c-8c29-7e5af83efc72 tempest-VolumesActionsTest-4139085 None] Converted 1024.00 MB image at 126.53 MB/s
Nov 06 17:12:26 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-2eaa7869-a104-486c-8c29-7e5af83efc72 tempest-VolumesActionsTest-4139085 None] 81e38ff0-6d7d-4a82-a2ff-fd1126059e58 was raw, converting to qcow2 {{(pid=86856) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}}
Nov 06 17:12:26 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[621e031d-18a7-41c3-b9e7-0c8604530b95]: (4, 'raw') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:12:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2eaa7869-a104-486c-8c29-7e5af83efc72 tempest-VolumesActionsTest-4139085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/784376fe-59d9-4d8b-9498-8bd17847925b.temp_image.81e38ff0-6d7d-4a82-a2ff-fd1126059e58pm94o1vv.img {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:26 devstack sudo[96393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/784376fe-59d9-4d8b-9498-8bd17847925b.temp_image.81e38ff0-6d7d-4a82-a2ff-fd1126059e58pm94o1vv.img
Nov 06 17:12:26 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:27 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2eaa7869-a104-486c-8c29-7e5af83efc72 tempest-VolumesActionsTest-4139085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/784376fe-59d9-4d8b-9498-8bd17847925b.temp_image.81e38ff0-6d7d-4a82-a2ff-fd1126059e58pm94o1vv.img" returned: 0 in 0.348s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2eaa7869-a104-486c-8c29-7e5af83efc72 tempest-VolumesActionsTest-4139085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/784376fe-59d9-4d8b-9498-8bd17847925b.temp_image.81e38ff0-6d7d-4a82-a2ff-fd1126059e58pm94o1vv.img {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:27 devstack sudo[96398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/784376fe-59d9-4d8b-9498-8bd17847925b.temp_image.81e38ff0-6d7d-4a82-a2ff-fd1126059e58pm94o1vv.img
Nov 06 17:12:27 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:27 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-22aad61b-7197-4008-aa94-58a62b21e736 tempest-VolumesTransfersTest-1301078058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:12:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-22aad61b-7197-4008-aa94-58a62b21e736 tempest-VolumesTransfersTest-1301078058 None] Flow 'volume_create_manager' (b6924eb5-a8fb-46c4-ae13-233581c402ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:12:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-22aad61b-7197-4008-aa94-58a62b21e736 tempest-VolumesTransfersTest-1301078058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9431729d-e9ec-4787-bf84-d89fc1ce12ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-22aad61b-7197-4008-aa94-58a62b21e736 tempest-VolumesTransfersTest-1301078058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9431729d-e9ec-4787-bf84-d89fc1ce12ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1819098167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45c93ed8-7b13-4330-8687-1de0b9224767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd1220f07d1b4d23abbfb691d713d945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:12:27Z,use_quota=True,user_id='fd6d8c8bc0fa4d04a77b51d32776c69b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-22aad61b-7197-4008-aa94-58a62b21e736 tempest-VolumesTransfersTest-1301078058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (107e986c-b84c-41be-baad-6135e6fe388f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-22aad61b-7197-4008-aa94-58a62b21e736 tempest-VolumesTransfersTest-1301078058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (107e986c-b84c-41be-baad-6135e6fe388f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-22aad61b-7197-4008-aa94-58a62b21e736 tempest-VolumesTransfersTest-1301078058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e330e619-6c92-4197-9553-940c75858360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-22aad61b-7197-4008-aa94-58a62b21e736 tempest-VolumesTransfersTest-1301078058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e330e619-6c92-4197-9553-940c75858360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45c93ed8-7b13-4330-8687-1de0b9224767', 'volume_name': 'volume-45c93ed8-7b13-4330-8687-1de0b9224767', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-22aad61b-7197-4008-aa94-58a62b21e736 tempest-VolumesTransfersTest-1301078058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b17700d-3750-4d64-8106-a6d74cdc45ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-22aad61b-7197-4008-aa94-58a62b21e736 tempest-VolumesTransfersTest-1301078058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b17700d-3750-4d64-8106-a6d74cdc45ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-22aad61b-7197-4008-aa94-58a62b21e736 tempest-VolumesTransfersTest-1301078058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7cbb485-5976-436c-8721-a17fe0c00804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:27 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-22aad61b-7197-4008-aa94-58a62b21e736 tempest-VolumesTransfersTest-1301078058 None] Volume 45c93ed8-7b13-4330-8687-1de0b9224767: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45c93ed8-7b13-4330-8687-1de0b9224767', 'volume_size': 1}
Nov 06 17:12:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-22aad61b-7197-4008-aa94-58a62b21e736 tempest-VolumesTransfersTest-1301078058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:12:27 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2eaa7869-a104-486c-8c29-7e5af83efc72 tempest-VolumesActionsTest-4139085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/784376fe-59d9-4d8b-9498-8bd17847925b.temp_image.81e38ff0-6d7d-4a82-a2ff-fd1126059e58pm94o1vv.img" returned: 1 in 0.337s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2eaa7869-a104-486c-8c29-7e5af83efc72 tempest-VolumesActionsTest-4139085 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/784376fe-59d9-4d8b-9498-8bd17847925b.temp_image.81e38ff0-6d7d-4a82-a2ff-fd1126059e58pm94o1vv.img' failed. Not Retrying. {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 17:12:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2eaa7869-a104-486c-8c29-7e5af83efc72 tempest-VolumesActionsTest-4139085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/784376fe-59d9-4d8b-9498-8bd17847925b.temp_image.81e38ff0-6d7d-4a82-a2ff-fd1126059e58pm94o1vv.img /opt/stack/data/cinder/conversion/vol_upload_trqq0ry0 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:27 devstack sudo[96403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/784376fe-59d9-4d8b-9498-8bd17847925b.temp_image.81e38ff0-6d7d-4a82-a2ff-fd1126059e58pm94o1vv.img /opt/stack/data/cinder/conversion/vol_upload_trqq0ry0
Nov 06 17:12:27 devstack sudo[96403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:27 devstack sudo[96403]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2eaa7869-a104-486c-8c29-7e5af83efc72 tempest-VolumesActionsTest-4139085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/784376fe-59d9-4d8b-9498-8bd17847925b.temp_image.81e38ff0-6d7d-4a82-a2ff-fd1126059e58pm94o1vv.img /opt/stack/data/cinder/conversion/vol_upload_trqq0ry0" returned: 0 in 0.252s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:27 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-2eaa7869-a104-486c-8c29-7e5af83efc72 tempest-VolumesActionsTest-4139085 None] Image conversion details: src /opt/stack/data/cinder/conversion/784376fe-59d9-4d8b-9498-8bd17847925b.temp_image.81e38ff0-6d7d-4a82-a2ff-fd1126059e58pm94o1vv.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_trqq0ry0 {{(pid=86856) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 17:12:27 devstack cinder-volume[86856]: INFO cinder.image.image_utils [None req-2eaa7869-a104-486c-8c29-7e5af83efc72 tempest-VolumesActionsTest-4139085 None] Converted 1024.00 MB image at 1024.00 MB/s
Nov 06 17:12:27 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8048de-1365-4479-a690-b3436fe5e165]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:12:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2eaa7869-a104-486c-8c29-7e5af83efc72 tempest-VolumesActionsTest-4139085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_trqq0ry0 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:27 devstack sudo[96408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_trqq0ry0
Nov 06 17:12:27 devstack sudo[96408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:28 devstack sudo[96408]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2eaa7869-a104-486c-8c29-7e5af83efc72 tempest-VolumesActionsTest-4139085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_trqq0ry0" returned: 0 in 0.329s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2eaa7869-a104-486c-8c29-7e5af83efc72 tempest-VolumesActionsTest-4139085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.535s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:12:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-2eaa7869-a104-486c-8c29-7e5af83efc72 tempest-VolumesActionsTest-4139085 None] Uploaded volume to glance image-id: 81e38ff0-6d7d-4a82-a2ff-fd1126059e58. {{(pid=86856) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 06 17:12:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 12.777s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:12:29 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Cloning volume 9727d184-b562-4e99-87ef-e83382ea4116 to volume 57a3b81f-13f1-458f-ac29-3cc9bb3997ea
Nov 06 17:12:29 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-2eaa7869-a104-486c-8c29-7e5af83efc72 tempest-VolumesActionsTest-4139085 None] Copy volume to image completed successfully.
Nov 06 17:12:29 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Creating offline snapshot c8c4aa87-df11-42c7-86d8-e050f57a7d59 of volume 9727d184-b562-4e99-87ef-e83382ea4116 {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:12:29 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c7c7c0-d78f-49a2-9d18-36c3b8f0436b]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:12:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:29 devstack sudo[96415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116
Nov 06 17:12:29 devstack sudo[96415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:30 devstack sudo[96415]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116" returned: 0 in 0.351s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116.c8c4aa87-df11-42c7-86d8-e050f57a7d59 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:30 devstack sudo[96420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116.c8c4aa87-df11-42c7-86d8-e050f57a7d59 1G
Nov 06 17:12:30 devstack sudo[96420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:30 devstack sudo[96420]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116.c8c4aa87-df11-42c7-86d8-e050f57a7d59 1G" returned: 0 in 0.421s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9727d184-b562-4e99-87ef-e83382ea4116 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116.c8c4aa87-df11-42c7-86d8-e050f57a7d59 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:30 devstack sudo[96425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9727d184-b562-4e99-87ef-e83382ea4116 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116.c8c4aa87-df11-42c7-86d8-e050f57a7d59
Nov 06 17:12:30 devstack sudo[96425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:30 devstack sudo[96425]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9727d184-b562-4e99-87ef-e83382ea4116 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116.c8c4aa87-df11-42c7-86d8-e050f57a7d59" returned: 0 in 0.277s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:30 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116.c8c4aa87-df11-42c7-86d8-e050f57a7d59 is being set with open permissions: ugo+rw
Nov 06 17:12:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116.c8c4aa87-df11-42c7-86d8-e050f57a7d59 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:30 devstack sudo[96431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116.c8c4aa87-df11-42c7-86d8-e050f57a7d59
Nov 06 17:12:30 devstack sudo[96431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:31 devstack sudo[96431]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116.c8c4aa87-df11-42c7-86d8-e050f57a7d59" returned: 0 in 0.249s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:31 devstack sudo[96435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116.info
Nov 06 17:12:31 devstack sudo[96435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:31 devstack sudo[96435]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116.info" returned: 0 in 0.259s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:31 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116.info is being set with open permissions: ugo+rw
Nov 06 17:12:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:31 devstack sudo[96438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116.info
Nov 06 17:12:31 devstack sudo[96438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:31 devstack sudo[96438]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116.info" returned: 0 in 0.262s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:31 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Acquiring lock "cinder-quobyte-57a3b81f-13f1-458f-ac29-3cc9bb3997ea" by "_copy_volume_from_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:12:31 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Lock "cinder-quobyte-57a3b81f-13f1-458f-ac29-3cc9bb3997ea" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:12:31 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] snapshot: c8c4aa87-df11-42c7-86d8-e050f57a7d59, volume: 57a3b81f-13f1-458f-ac29-3cc9bb3997ea,  {{(pid=86856) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 06 17:12:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:12:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:12:31 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:12:31 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:12:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:12:31 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ef10ca-fb2f-4086-8e0b-24c6e6715ce1]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:12:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116.c8c4aa87-df11-42c7-86d8-e050f57a7d59 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:32 devstack sudo[96441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116.c8c4aa87-df11-42c7-86d8-e050f57a7d59
Nov 06 17:12:32 devstack sudo[96441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:32 devstack sudo[96441]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116.c8c4aa87-df11-42c7-86d8-e050f57a7d59" returned: 0 in 0.380s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:32 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9727d184-b562-4e99-87ef-e83382ea4116(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:12:32 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[15813814-44a7-4df1-9a7f-9f4ec57db42e]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:12:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:32 devstack sudo[96446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116
Nov 06 17:12:32 devstack sudo[96446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:32 devstack sudo[96446]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116" returned: 0 in 0.374s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:32 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116 {{(pid=86856) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 06 17:12:32 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Creating direct copy from snapshot {{(pid=86856) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 06 17:12:32 devstack cinder-volume[86856]: DEBUG cinder.utils [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Path /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-57a3b81f-13f1-458f-ac29-3cc9bb3997ea not found in is_blk_device check {{(pid=86856) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 06 17:12:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-57a3b81f-13f1-458f-ac29-3cc9bb3997ea {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:32 devstack sudo[96451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-57a3b81f-13f1-458f-ac29-3cc9bb3997ea
Nov 06 17:12:32 devstack sudo[96451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:35 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5f50857b-cc6d-4b48-97b2-6d95ae70521c tempest-VolumesActionsTest-4139085 None] Acquiring lock "cinder-784376fe-59d9-4d8b-9498-8bd17847925b-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:12:35 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5f50857b-cc6d-4b48-97b2-6d95ae70521c tempest-VolumesActionsTest-4139085 None] Lock "cinder-784376fe-59d9-4d8b-9498-8bd17847925b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:12:35 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5f50857b-cc6d-4b48-97b2-6d95ae70521c tempest-VolumesActionsTest-4139085 None] Acquiring lock "cinder-quobyte-784376fe-59d9-4d8b-9498-8bd17847925b" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:12:35 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5f50857b-cc6d-4b48-97b2-6d95ae70521c tempest-VolumesActionsTest-4139085 None] Lock "cinder-quobyte-784376fe-59d9-4d8b-9498-8bd17847925b" acquired by "delete_volume" :: waited 0.030s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:12:35 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[b275b41c-b802-46e6-98b9-94e0f361e3ea]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:12:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5f50857b-cc6d-4b48-97b2-6d95ae70521c tempest-VolumesActionsTest-4139085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-784376fe-59d9-4d8b-9498-8bd17847925b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:35 devstack sudo[96464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-784376fe-59d9-4d8b-9498-8bd17847925b
Nov 06 17:12:35 devstack sudo[96464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:36 devstack sudo[96464]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5f50857b-cc6d-4b48-97b2-6d95ae70521c tempest-VolumesActionsTest-4139085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-784376fe-59d9-4d8b-9498-8bd17847925b" returned: 0 in 0.593s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5f50857b-cc6d-4b48-97b2-6d95ae70521c tempest-VolumesActionsTest-4139085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-784376fe-59d9-4d8b-9498-8bd17847925b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:36 devstack sudo[96469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-784376fe-59d9-4d8b-9498-8bd17847925b
Nov 06 17:12:36 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:36 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5f50857b-cc6d-4b48-97b2-6d95ae70521c tempest-VolumesActionsTest-4139085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-784376fe-59d9-4d8b-9498-8bd17847925b" returned: 0 in 0.327s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:36 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5f50857b-cc6d-4b48-97b2-6d95ae70521c tempest-VolumesActionsTest-4139085 None] Lock "cinder-quobyte-784376fe-59d9-4d8b-9498-8bd17847925b" released by "delete_volume" :: held 0.994s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:12:36 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-5f50857b-cc6d-4b48-97b2-6d95ae70521c tempest-VolumesActionsTest-4139085 None] Created reservations ['8bee30f5-4944-4f93-a001-7186137ed434', 'ed6c2a0e-9eb7-475c-993d-3683b1a8afa4', '81f2b915-e577-4833-b5a0-bb3e8e052a4b', '80916532-3c9b-4b6c-a2e6-a1fddae8f7bb'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:12:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5f50857b-cc6d-4b48-97b2-6d95ae70521c tempest-VolumesActionsTest-4139085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:12:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5f50857b-cc6d-4b48-97b2-6d95ae70521c tempest-VolumesActionsTest-4139085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:12:36 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5f50857b-cc6d-4b48-97b2-6d95ae70521c tempest-VolumesActionsTest-4139085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:12:36 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5f50857b-cc6d-4b48-97b2-6d95ae70521c tempest-VolumesActionsTest-4139085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:12:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5f50857b-cc6d-4b48-97b2-6d95ae70521c tempest-VolumesActionsTest-4139085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:12:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5f50857b-cc6d-4b48-97b2-6d95ae70521c tempest-VolumesActionsTest-4139085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:36 devstack sudo[96472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:12:36 devstack sudo[96472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:37 devstack sudo[96472]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5f50857b-cc6d-4b48-97b2-6d95ae70521c tempest-VolumesActionsTest-4139085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.314s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:37 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-5f50857b-cc6d-4b48-97b2-6d95ae70521c tempest-VolumesActionsTest-4139085 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:12:37 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-5f50857b-cc6d-4b48-97b2-6d95ae70521c tempest-VolumesActionsTest-4139085 None] Deleted volume successfully.
Nov 06 17:12:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5f50857b-cc6d-4b48-97b2-6d95ae70521c tempest-VolumesActionsTest-4139085 None] Lock "cinder-784376fe-59d9-4d8b-9498-8bd17847925b-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:12:39 devstack sudo[96451]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-57a3b81f-13f1-458f-ac29-3cc9bb3997ea" returned: 0 in 6.507s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:39 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Image conversion details: src /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116, size 1024.00 MB, duration 6.51 sec, destination /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-57a3b81f-13f1-458f-ac29-3cc9bb3997ea {{(pid=86856) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 17:12:39 devstack cinder-volume[86856]: INFO cinder.image.image_utils [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Converted 1024.00 MB image at 157.34 MB/s
Nov 06 17:12:39 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-57a3b81f-13f1-458f-ac29-3cc9bb3997ea is being set with open permissions: ugo+rw
Nov 06 17:12:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-57a3b81f-13f1-458f-ac29-3cc9bb3997ea {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:39 devstack sudo[96475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-57a3b81f-13f1-458f-ac29-3cc9bb3997ea
Nov 06 17:12:39 devstack sudo[96475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:39 devstack sudo[96475]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-57a3b81f-13f1-458f-ac29-3cc9bb3997ea" returned: 0 in 0.270s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Lock "cinder-quobyte-57a3b81f-13f1-458f-ac29-3cc9bb3997ea" released by "_copy_volume_from_snapshot" :: held 7.605s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:12:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Acquiring lock "cinder-quobyte-c8c4aa87-df11-42c7-86d8-e050f57a7d59" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:12:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Lock "cinder-quobyte-c8c4aa87-df11-42c7-86d8-e050f57a7d59" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:12:39 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Deleting offline snapshot c8c4aa87-df11-42c7-86d8-e050f57a7d59 of volume 9727d184-b562-4e99-87ef-e83382ea4116 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:12:39 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] snapshot_file for this snap is: volume-9727d184-b562-4e99-87ef-e83382ea4116.c8c4aa87-df11-42c7-86d8-e050f57a7d59 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:12:39 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[4227cc45-ef12-4eec-a0a2-198d7622af5a]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:12:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116.c8c4aa87-df11-42c7-86d8-e050f57a7d59 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:39 devstack sudo[96478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116.c8c4aa87-df11-42c7-86d8-e050f57a7d59
Nov 06 17:12:39 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:39 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116.c8c4aa87-df11-42c7-86d8-e050f57a7d59" returned: 0 in 0.395s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:39 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9727d184-b562-4e99-87ef-e83382ea4116(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:12:40 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5441cd0-87b2-4c69-a548-7de42dd04d66]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:12:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:40 devstack sudo[96485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116
Nov 06 17:12:40 devstack sudo[96485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:40 devstack sudo[96485]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116" returned: 0 in 0.637s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116.c8c4aa87-df11-42c7-86d8-e050f57a7d59 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:40 devstack sudo[96491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116.c8c4aa87-df11-42c7-86d8-e050f57a7d59
Nov 06 17:12:40 devstack sudo[96491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:41 devstack sudo[96491]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116.c8c4aa87-df11-42c7-86d8-e050f57a7d59" returned: 0 in 0.356s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116.c8c4aa87-df11-42c7-86d8-e050f57a7d59 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:41 devstack sudo[96496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116.c8c4aa87-df11-42c7-86d8-e050f57a7d59
Nov 06 17:12:41 devstack sudo[96496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:41 devstack sudo[96496]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116.c8c4aa87-df11-42c7-86d8-e050f57a7d59" returned: 0 in 0.285s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:41 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Lock "cinder-quobyte-c8c4aa87-df11-42c7-86d8-e050f57a7d59" released by "_delete_snapshot" :: held 1.797s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:12:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.582s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:12:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f98782b6-8c3a-4acb-ac7c-bdf767db81d4 tempest-VolumesExtendTest-859689844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 15.371s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:12:41 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcece2d7-d28c-4dac-8269-e427c0225a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57a3b81f-13f1-458f-ac29-3cc9bb3997ea', 'volume_size': 2, 'source_volid': '9727d184-b562-4e99-87ef-e83382ea4116', 'source_volstatus': 'available'}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:41 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e6f5e8-bf97-4e90-b80e-d8436a347b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:41 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[d148d65c-7489-49d2-b3a1-d3b858361348]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:12:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f98782b6-8c3a-4acb-ac7c-bdf767db81d4 tempest-VolumesExtendTest-859689844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1835cf04-555f-4653-a81d-bd135b6ae77b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:41 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Volume volume-57a3b81f-13f1-458f-ac29-3cc9bb3997ea (57a3b81f-13f1-458f-ac29-3cc9bb3997ea): created successfully
Nov 06 17:12:41 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e6f5e8-bf97-4e90-b80e-d8436a347b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:41 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Flow 'volume_create_manager' (1f5fdacd-da2c-4ba7-a89d-0684fd486795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:12:41 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-b11a43dc-c869-418b-a83a-d8c5a846de92 tempest-VolumesCloneTest-467777112 None] Created volume successfully.
Nov 06 17:12:41 devstack sudo[96500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1835cf04-555f-4653-a81d-bd135b6ae77b
Nov 06 17:12:41 devstack sudo[96500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:41 devstack sudo[96500]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f98782b6-8c3a-4acb-ac7c-bdf767db81d4 tempest-VolumesExtendTest-859689844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1835cf04-555f-4653-a81d-bd135b6ae77b" returned: 0 in 0.369s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f98782b6-8c3a-4acb-ac7c-bdf767db81d4 tempest-VolumesExtendTest-859689844 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1835cf04-555f-4653-a81d-bd135b6ae77b 2G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f98782b6-8c3a-4acb-ac7c-bdf767db81d4 tempest-VolumesExtendTest-859689844 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1835cf04-555f-4653-a81d-bd135b6ae77b 2G" returned: 0 in 0.092s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f98782b6-8c3a-4acb-ac7c-bdf767db81d4 tempest-VolumesExtendTest-859689844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.495s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:12:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-22aad61b-7197-4008-aa94-58a62b21e736 tempest-VolumesTransfersTest-1301078058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.413s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:12:41 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-22aad61b-7197-4008-aa94-58a62b21e736 tempest-VolumesTransfersTest-1301078058 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1819098167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45c93ed8-7b13-4330-8687-1de0b9224767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd1220f07d1b4d23abbfb691d713d945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:12:27Z,use_quota=True,user_id='fd6d8c8bc0fa4d04a77b51d32776c69b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:12:41 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-22aad61b-7197-4008-aa94-58a62b21e736 tempest-VolumesTransfersTest-1301078058 None] Creating volume 45c93ed8-7b13-4330-8687-1de0b9224767 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:12:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-22aad61b-7197-4008-aa94-58a62b21e736 tempest-VolumesTransfersTest-1301078058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:12:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-22aad61b-7197-4008-aa94-58a62b21e736 tempest-VolumesTransfersTest-1301078058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:12:41 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-22aad61b-7197-4008-aa94-58a62b21e736 tempest-VolumesTransfersTest-1301078058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:12:41 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-22aad61b-7197-4008-aa94-58a62b21e736 tempest-VolumesTransfersTest-1301078058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:12:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-22aad61b-7197-4008-aa94-58a62b21e736 tempest-VolumesTransfersTest-1301078058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:12:41 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-22aad61b-7197-4008-aa94-58a62b21e736 tempest-VolumesTransfersTest-1301078058 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:12:41 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-22aad61b-7197-4008-aa94-58a62b21e736 tempest-VolumesTransfersTest-1301078058 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:12:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-22aad61b-7197-4008-aa94-58a62b21e736 tempest-VolumesTransfersTest-1301078058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-45c93ed8-7b13-4330-8687-1de0b9224767 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:41 devstack sudo[96508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-45c93ed8-7b13-4330-8687-1de0b9224767 1073741824
Nov 06 17:12:41 devstack sudo[96508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:41 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-f98782b6-8c3a-4acb-ac7c-bdf767db81d4 tempest-VolumesExtendTest-859689844 None] Extend volume completed successfully.
Nov 06 17:12:42 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:12:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:12:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:12:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:12:42 devstack sudo[96508]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:12:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:12:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-22aad61b-7197-4008-aa94-58a62b21e736 tempest-VolumesTransfersTest-1301078058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-45c93ed8-7b13-4330-8687-1de0b9224767 1073741824" returned: 0 in 0.635s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:42 devstack sudo[96514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:12:42 devstack sudo[96514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-22aad61b-7197-4008-aa94-58a62b21e736 tempest-VolumesTransfersTest-1301078058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-45c93ed8-7b13-4330-8687-1de0b9224767 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:42 devstack sudo[96516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-45c93ed8-7b13-4330-8687-1de0b9224767
Nov 06 17:12:42 devstack sudo[96516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:42 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-3e95b971-39ce-4205-940b-e18def3ede98 tempest-VolumesCloneTest-467777112 None] Acquiring lock "cinder-57a3b81f-13f1-458f-ac29-3cc9bb3997ea-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:12:42 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-3e95b971-39ce-4205-940b-e18def3ede98 tempest-VolumesCloneTest-467777112 None] Lock "cinder-57a3b81f-13f1-458f-ac29-3cc9bb3997ea-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:12:42 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-3e95b971-39ce-4205-940b-e18def3ede98 tempest-VolumesCloneTest-467777112 None] Acquiring lock "cinder-quobyte-57a3b81f-13f1-458f-ac29-3cc9bb3997ea" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:12:42 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-3e95b971-39ce-4205-940b-e18def3ede98 tempest-VolumesCloneTest-467777112 None] Lock "cinder-quobyte-57a3b81f-13f1-458f-ac29-3cc9bb3997ea" acquired by "delete_volume" :: waited 0.020s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:12:42 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab71b51-2ed8-4c1e-b832-f0b0bad69321]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:12:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3e95b971-39ce-4205-940b-e18def3ede98 tempest-VolumesCloneTest-467777112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-57a3b81f-13f1-458f-ac29-3cc9bb3997ea {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:42 devstack sudo[96514]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.409s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:42 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:12:42 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager._thread_info {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:12:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread count: 28 {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 17:12:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread info: [<_MainThread(MainThread, started 125183137599616)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125183027608256)>, <Thread(Thread-3 (stat_writer), started daemon 125183025243776)>, <Thread(Rabbit-heartbeat, started daemon 125183023512896)>, <Thread(Thread-5 (_runner), started daemon 125183023357120)>, <Thread(Thread-7 (_runner), started daemon 125183021306496)>, <Thread(fd_logger, started daemon 125183018711616)>, <Thread(privsep_reader, started daemon 125183017484224)>, <Thread(tpool_thread_0, started daemon 125183013742272)>, <Thread(tpool_thread_1, started daemon 125183005349568)>, <Thread(tpool_thread_2, started daemon 125182996956864)>, <Thread(tpool_thread_3, started daemon 125182988564160)>, <Thread(tpool_thread_4, started daemon 125182980171456)>, <Thread(tpool_thread_5, started daemon 125182971778752)>, <Thread(tpool_thread_6, started daemon 125182963386048)>, <Thread(tpool_thread_7, started daemon 125182954993344)>, <Thread(tpool_thread_8, started daemon 125182946600640)>, <Thread(tpool_thread_9, started daemon 125182938207936)>, <Thread(tpool_thread_10, started daemon 125182929815232)>, <Thread(tpool_thread_11, started daemon 125182921422528)>, <Thread(tpool_thread_12, started daemon 125182913013440)>, <Thread(tpool_thread_13, started daemon 125182904604352)>, <Thread(tpool_thread_14, started daemon 125182896195264)>, <Thread(tpool_thread_15, started daemon 125182887786176)>, <Thread(tpool_thread_16, started daemon 125182879377088)>, <Thread(tpool_thread_17, started daemon 125182870968000)>, <Thread(tpool_thread_18, started daemon 125182862558912)>, <Thread(tpool_thread_19, started daemon 125182854149824)>] {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 17:12:42 devstack sudo[96516]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-22aad61b-7197-4008-aa94-58a62b21e736 tempest-VolumesTransfersTest-1301078058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-45c93ed8-7b13-4330-8687-1de0b9224767" returned: 0 in 0.376s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-22aad61b-7197-4008-aa94-58a62b21e736 tempest-VolumesTransfersTest-1301078058 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:12:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-22aad61b-7197-4008-aa94-58a62b21e736 tempest-VolumesTransfersTest-1301078058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:12:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-22aad61b-7197-4008-aa94-58a62b21e736 tempest-VolumesTransfersTest-1301078058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7cbb485-5976-436c-8721-a17fe0c00804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45c93ed8-7b13-4330-8687-1de0b9224767', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-22aad61b-7197-4008-aa94-58a62b21e736 tempest-VolumesTransfersTest-1301078058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (385c8567-ff74-421f-a642-8e79c09ac91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:43 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-22aad61b-7197-4008-aa94-58a62b21e736 tempest-VolumesTransfersTest-1301078058 None] Volume volume-45c93ed8-7b13-4330-8687-1de0b9224767 (45c93ed8-7b13-4330-8687-1de0b9224767): created successfully
Nov 06 17:12:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-22aad61b-7197-4008-aa94-58a62b21e736 tempest-VolumesTransfersTest-1301078058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (385c8567-ff74-421f-a642-8e79c09ac91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-22aad61b-7197-4008-aa94-58a62b21e736 tempest-VolumesTransfersTest-1301078058 None] Flow 'volume_create_manager' (b6924eb5-a8fb-46c4-ae13-233581c402ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:12:43 devstack sudo[96519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-57a3b81f-13f1-458f-ac29-3cc9bb3997ea
Nov 06 17:12:43 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-22aad61b-7197-4008-aa94-58a62b21e736 tempest-VolumesTransfersTest-1301078058 None] Created volume successfully.
Nov 06 17:12:43 devstack sudo[96519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d0ae1265-ce05-43c5-9048-c9849a8b6cca tempest-VolumesExtendTest-859689844 None] Acquiring lock "cinder-1835cf04-555f-4653-a81d-bd135b6ae77b-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:12:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d0ae1265-ce05-43c5-9048-c9849a8b6cca tempest-VolumesExtendTest-859689844 None] Lock "cinder-1835cf04-555f-4653-a81d-bd135b6ae77b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:12:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d0ae1265-ce05-43c5-9048-c9849a8b6cca tempest-VolumesExtendTest-859689844 None] Acquiring lock "cinder-quobyte-1835cf04-555f-4653-a81d-bd135b6ae77b" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:12:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d0ae1265-ce05-43c5-9048-c9849a8b6cca tempest-VolumesExtendTest-859689844 None] Lock "cinder-quobyte-1835cf04-555f-4653-a81d-bd135b6ae77b" acquired by "delete_volume" :: waited 0.021s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:12:43 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd498e1-b28e-4eb4-99a3-b9c109bd625c]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:12:43 devstack sudo[96519]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d0ae1265-ce05-43c5-9048-c9849a8b6cca tempest-VolumesExtendTest-859689844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1835cf04-555f-4653-a81d-bd135b6ae77b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3e95b971-39ce-4205-940b-e18def3ede98 tempest-VolumesCloneTest-467777112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-57a3b81f-13f1-458f-ac29-3cc9bb3997ea" returned: 0 in 0.501s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3e95b971-39ce-4205-940b-e18def3ede98 tempest-VolumesCloneTest-467777112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-57a3b81f-13f1-458f-ac29-3cc9bb3997ea {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:43 devstack sudo[96540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-57a3b81f-13f1-458f-ac29-3cc9bb3997ea
Nov 06 17:12:43 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:43 devstack sudo[96539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1835cf04-555f-4653-a81d-bd135b6ae77b
Nov 06 17:12:43 devstack sudo[96539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:43 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3e95b971-39ce-4205-940b-e18def3ede98 tempest-VolumesCloneTest-467777112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-57a3b81f-13f1-458f-ac29-3cc9bb3997ea" returned: 0 in 0.390s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-3e95b971-39ce-4205-940b-e18def3ede98 tempest-VolumesCloneTest-467777112 None] Lock "cinder-quobyte-57a3b81f-13f1-458f-ac29-3cc9bb3997ea" released by "delete_volume" :: held 0.978s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:12:43 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-3e95b971-39ce-4205-940b-e18def3ede98 tempest-VolumesCloneTest-467777112 None] Created reservations ['ec6f5df1-af04-4816-a5fa-500e702a3b8e', '597af6a7-305b-4ba7-af46-d9e9590cd4ed', '60f1ed42-37c6-474e-98c2-78b5f27062a1', '3afecdb1-7f10-4525-9043-f13b348d213d'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:12:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3e95b971-39ce-4205-940b-e18def3ede98 tempest-VolumesCloneTest-467777112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:12:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3e95b971-39ce-4205-940b-e18def3ede98 tempest-VolumesCloneTest-467777112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:12:43 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3e95b971-39ce-4205-940b-e18def3ede98 tempest-VolumesCloneTest-467777112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:12:43 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3e95b971-39ce-4205-940b-e18def3ede98 tempest-VolumesCloneTest-467777112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:12:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3e95b971-39ce-4205-940b-e18def3ede98 tempest-VolumesCloneTest-467777112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:12:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3e95b971-39ce-4205-940b-e18def3ede98 tempest-VolumesCloneTest-467777112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:43 devstack sudo[96539]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d0ae1265-ce05-43c5-9048-c9849a8b6cca tempest-VolumesExtendTest-859689844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1835cf04-555f-4653-a81d-bd135b6ae77b" returned: 0 in 0.662s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d0ae1265-ce05-43c5-9048-c9849a8b6cca tempest-VolumesExtendTest-859689844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1835cf04-555f-4653-a81d-bd135b6ae77b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:44 devstack sudo[96570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:12:44 devstack sudo[96570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:44 devstack sudo[96571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1835cf04-555f-4653-a81d-bd135b6ae77b
Nov 06 17:12:44 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:44 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d0ae1265-ce05-43c5-9048-c9849a8b6cca tempest-VolumesExtendTest-859689844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1835cf04-555f-4653-a81d-bd135b6ae77b" returned: 0 in 0.289s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:44 devstack sudo[96570]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3e95b971-39ce-4205-940b-e18def3ede98 tempest-VolumesCloneTest-467777112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.324s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:44 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-3e95b971-39ce-4205-940b-e18def3ede98 tempest-VolumesCloneTest-467777112 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:12:44 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d0ae1265-ce05-43c5-9048-c9849a8b6cca tempest-VolumesExtendTest-859689844 None] Lock "cinder-quobyte-1835cf04-555f-4653-a81d-bd135b6ae77b" released by "delete_volume" :: held 1.023s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:12:44 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-3e95b971-39ce-4205-940b-e18def3ede98 tempest-VolumesCloneTest-467777112 None] Deleted volume successfully.
Nov 06 17:12:44 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-3e95b971-39ce-4205-940b-e18def3ede98 tempest-VolumesCloneTest-467777112 None] Lock "cinder-57a3b81f-13f1-458f-ac29-3cc9bb3997ea-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:12:44 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-d0ae1265-ce05-43c5-9048-c9849a8b6cca tempest-VolumesExtendTest-859689844 None] Created reservations ['95705b05-19b1-49f3-aaa7-ca271441e47b', 'b4f59e37-af3c-49dc-ab70-ad0c19bbf2c4', '0c076534-9744-42b7-93b2-2069ce4649de', '833ddbcc-87c0-4e50-9127-8bcbae4791f2'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:12:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d0ae1265-ce05-43c5-9048-c9849a8b6cca tempest-VolumesExtendTest-859689844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:12:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d0ae1265-ce05-43c5-9048-c9849a8b6cca tempest-VolumesExtendTest-859689844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:12:44 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d0ae1265-ce05-43c5-9048-c9849a8b6cca tempest-VolumesExtendTest-859689844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:12:44 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d0ae1265-ce05-43c5-9048-c9849a8b6cca tempest-VolumesExtendTest-859689844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:12:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d0ae1265-ce05-43c5-9048-c9849a8b6cca tempest-VolumesExtendTest-859689844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:12:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d0ae1265-ce05-43c5-9048-c9849a8b6cca tempest-VolumesExtendTest-859689844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:44 devstack sudo[96576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:12:44 devstack sudo[96576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:44 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-62e79d2a-3502-4881-a73e-c7b45b8d0131 tempest-VolumesTransfersTest-1421552432 None] Transfer volume completed successfully.
Nov 06 17:12:44 devstack sudo[96576]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d0ae1265-ce05-43c5-9048-c9849a8b6cca tempest-VolumesExtendTest-859689844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.278s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:44 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-d0ae1265-ce05-43c5-9048-c9849a8b6cca tempest-VolumesExtendTest-859689844 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:12:44 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-d0ae1265-ce05-43c5-9048-c9849a8b6cca tempest-VolumesExtendTest-859689844 None] Deleted volume successfully.
Nov 06 17:12:44 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d0ae1265-ce05-43c5-9048-c9849a8b6cca tempest-VolumesExtendTest-859689844 None] Lock "cinder-1835cf04-555f-4653-a81d-bd135b6ae77b-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:12:45 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bbd5e576-7a8a-4b34-bc13-f6759c4ac540 tempest-VolumesCloneTest-467777112 None] Acquiring lock "cinder-9727d184-b562-4e99-87ef-e83382ea4116-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:12:45 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bbd5e576-7a8a-4b34-bc13-f6759c4ac540 tempest-VolumesCloneTest-467777112 None] Lock "cinder-9727d184-b562-4e99-87ef-e83382ea4116-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:12:45 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bbd5e576-7a8a-4b34-bc13-f6759c4ac540 tempest-VolumesCloneTest-467777112 None] Acquiring lock "cinder-quobyte-9727d184-b562-4e99-87ef-e83382ea4116" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:12:45 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bbd5e576-7a8a-4b34-bc13-f6759c4ac540 tempest-VolumesCloneTest-467777112 None] Lock "cinder-quobyte-9727d184-b562-4e99-87ef-e83382ea4116" acquired by "delete_volume" :: waited 0.018s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:12:45 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[9000350d-b7a1-441b-b7c8-f519b4af8934]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:12:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bbd5e576-7a8a-4b34-bc13-f6759c4ac540 tempest-VolumesCloneTest-467777112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:45 devstack sudo[96585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116
Nov 06 17:12:45 devstack sudo[96585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:45 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d1bb1784-a05e-470a-885b-796ffd1a7a63 tempest-VolumesTransfersTest-447481758 None] Acquiring lock "cinder-45c93ed8-7b13-4330-8687-1de0b9224767-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:12:45 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d1bb1784-a05e-470a-885b-796ffd1a7a63 tempest-VolumesTransfersTest-447481758 None] Lock "cinder-45c93ed8-7b13-4330-8687-1de0b9224767-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:12:45 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d1bb1784-a05e-470a-885b-796ffd1a7a63 tempest-VolumesTransfersTest-447481758 None] Acquiring lock "cinder-quobyte-45c93ed8-7b13-4330-8687-1de0b9224767" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:12:45 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d1bb1784-a05e-470a-885b-796ffd1a7a63 tempest-VolumesTransfersTest-447481758 None] Lock "cinder-quobyte-45c93ed8-7b13-4330-8687-1de0b9224767" acquired by "delete_volume" :: waited 0.021s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:12:45 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5afd57-9d0b-47ab-ace0-af1956566f74]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:12:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d1bb1784-a05e-470a-885b-796ffd1a7a63 tempest-VolumesTransfersTest-447481758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-45c93ed8-7b13-4330-8687-1de0b9224767 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:45 devstack sudo[96585]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bbd5e576-7a8a-4b34-bc13-f6759c4ac540 tempest-VolumesCloneTest-467777112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116" returned: 0 in 0.523s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bbd5e576-7a8a-4b34-bc13-f6759c4ac540 tempest-VolumesCloneTest-467777112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:45 devstack sudo[96589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-45c93ed8-7b13-4330-8687-1de0b9224767
Nov 06 17:12:45 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:45 devstack sudo[96591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116
Nov 06 17:12:45 devstack sudo[96591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5fa829e-9861-4fee-aef8-5dff67250a1d tempest-VolumesExtendTest-859689844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c5fa829e-9861-4fee-aef8-5dff67250a1d tempest-VolumesExtendTest-859689844 None] Flow 'volume_create_manager' (bf722597-afcf-404e-875f-43474b2c2a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c5fa829e-9861-4fee-aef8-5dff67250a1d tempest-VolumesExtendTest-859689844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1880637-99da-4fc6-9d82-72ebb08b4486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:46 devstack sudo[96591]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:46 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bbd5e576-7a8a-4b34-bc13-f6759c4ac540 tempest-VolumesCloneTest-467777112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9727d184-b562-4e99-87ef-e83382ea4116" returned: 0 in 0.359s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d1bb1784-a05e-470a-885b-796ffd1a7a63 tempest-VolumesTransfersTest-447481758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-45c93ed8-7b13-4330-8687-1de0b9224767" returned: 0 in 0.493s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d1bb1784-a05e-470a-885b-796ffd1a7a63 tempest-VolumesTransfersTest-447481758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-45c93ed8-7b13-4330-8687-1de0b9224767 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bbd5e576-7a8a-4b34-bc13-f6759c4ac540 tempest-VolumesCloneTest-467777112 None] Lock "cinder-quobyte-9727d184-b562-4e99-87ef-e83382ea4116" released by "delete_volume" :: held 0.968s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c5fa829e-9861-4fee-aef8-5dff67250a1d tempest-VolumesExtendTest-859689844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1880637-99da-4fc6-9d82-72ebb08b4486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-355991261',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df3de772-142e-4354-97ec-352bab50372a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e045179f313455c9ab197d3182c4b40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:12:46Z,use_quota=True,user_id='b9e6aef4296f459fb76c8f93390d4ad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:46 devstack sudo[96598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-45c93ed8-7b13-4330-8687-1de0b9224767
Nov 06 17:12:46 devstack sudo[96598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c5fa829e-9861-4fee-aef8-5dff67250a1d tempest-VolumesExtendTest-859689844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7484a005-829f-482e-ac3e-a5873c047178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c5fa829e-9861-4fee-aef8-5dff67250a1d tempest-VolumesExtendTest-859689844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7484a005-829f-482e-ac3e-a5873c047178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c5fa829e-9861-4fee-aef8-5dff67250a1d tempest-VolumesExtendTest-859689844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (862c92ab-0016-4034-b9ce-869545d9399b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c5fa829e-9861-4fee-aef8-5dff67250a1d tempest-VolumesExtendTest-859689844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (862c92ab-0016-4034-b9ce-869545d9399b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df3de772-142e-4354-97ec-352bab50372a', 'volume_name': 'volume-df3de772-142e-4354-97ec-352bab50372a', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c5fa829e-9861-4fee-aef8-5dff67250a1d tempest-VolumesExtendTest-859689844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95dc11e3-0cd7-4f85-a2dc-8ae505f68fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c5fa829e-9861-4fee-aef8-5dff67250a1d tempest-VolumesExtendTest-859689844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95dc11e3-0cd7-4f85-a2dc-8ae505f68fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c5fa829e-9861-4fee-aef8-5dff67250a1d tempest-VolumesExtendTest-859689844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (917f776d-6a91-45d5-90e6-3157e289ca6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:46 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-c5fa829e-9861-4fee-aef8-5dff67250a1d tempest-VolumesExtendTest-859689844 None] Volume df3de772-142e-4354-97ec-352bab50372a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df3de772-142e-4354-97ec-352bab50372a', 'volume_size': 1}
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c5fa829e-9861-4fee-aef8-5dff67250a1d tempest-VolumesExtendTest-859689844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c5fa829e-9861-4fee-aef8-5dff67250a1d tempest-VolumesExtendTest-859689844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c5fa829e-9861-4fee-aef8-5dff67250a1d tempest-VolumesExtendTest-859689844 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-355991261',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df3de772-142e-4354-97ec-352bab50372a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e045179f313455c9ab197d3182c4b40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:12:46Z,use_quota=True,user_id='b9e6aef4296f459fb76c8f93390d4ad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-c5fa829e-9861-4fee-aef8-5dff67250a1d tempest-VolumesExtendTest-859689844 None] Creating volume df3de772-142e-4354-97ec-352bab50372a {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c5fa829e-9861-4fee-aef8-5dff67250a1d tempest-VolumesExtendTest-859689844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c5fa829e-9861-4fee-aef8-5dff67250a1d tempest-VolumesExtendTest-859689844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c5fa829e-9861-4fee-aef8-5dff67250a1d tempest-VolumesExtendTest-859689844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c5fa829e-9861-4fee-aef8-5dff67250a1d tempest-VolumesExtendTest-859689844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c5fa829e-9861-4fee-aef8-5dff67250a1d tempest-VolumesExtendTest-859689844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c5fa829e-9861-4fee-aef8-5dff67250a1d tempest-VolumesExtendTest-859689844 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:12:46 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-c5fa829e-9861-4fee-aef8-5dff67250a1d tempest-VolumesExtendTest-859689844 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c5fa829e-9861-4fee-aef8-5dff67250a1d tempest-VolumesExtendTest-859689844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:46 devstack sudo[96600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a 1073741824
Nov 06 17:12:46 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-bbd5e576-7a8a-4b34-bc13-f6759c4ac540 tempest-VolumesCloneTest-467777112 None] Created reservations ['757ea12a-935f-4efd-8981-8ac55c07a726', '2967d86f-c731-42e9-950c-fbf06f9f692c', '3c990cab-a991-4a36-90f6-975da3c84c94', '8d352851-9e1f-427b-98bd-105cf992f70e'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bbd5e576-7a8a-4b34-bc13-f6759c4ac540 tempest-VolumesCloneTest-467777112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bbd5e576-7a8a-4b34-bc13-f6759c4ac540 tempest-VolumesCloneTest-467777112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bbd5e576-7a8a-4b34-bc13-f6759c4ac540 tempest-VolumesCloneTest-467777112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bbd5e576-7a8a-4b34-bc13-f6759c4ac540 tempest-VolumesCloneTest-467777112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bbd5e576-7a8a-4b34-bc13-f6759c4ac540 tempest-VolumesCloneTest-467777112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bbd5e576-7a8a-4b34-bc13-f6759c4ac540 tempest-VolumesCloneTest-467777112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:46 devstack sudo[96603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:12:46 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:46 devstack sudo[96598]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d1bb1784-a05e-470a-885b-796ffd1a7a63 tempest-VolumesTransfersTest-447481758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-45c93ed8-7b13-4330-8687-1de0b9224767" returned: 0 in 0.291s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d1bb1784-a05e-470a-885b-796ffd1a7a63 tempest-VolumesTransfersTest-447481758 None] Lock "cinder-quobyte-45c93ed8-7b13-4330-8687-1de0b9224767" released by "delete_volume" :: held 0.868s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-d1bb1784-a05e-470a-885b-796ffd1a7a63 tempest-VolumesTransfersTest-447481758 None] Created reservations ['8088dae7-f673-4c32-abec-edf918061397', '71c430fc-d848-4d2a-8f74-8beeeb0bd46a', '96eb2723-c862-4e21-a472-deebc8e4e639', '9168ed49-831d-43d1-b52c-307007631fa0'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d1bb1784-a05e-470a-885b-796ffd1a7a63 tempest-VolumesTransfersTest-447481758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d1bb1784-a05e-470a-885b-796ffd1a7a63 tempest-VolumesTransfersTest-447481758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d1bb1784-a05e-470a-885b-796ffd1a7a63 tempest-VolumesTransfersTest-447481758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d1bb1784-a05e-470a-885b-796ffd1a7a63 tempest-VolumesTransfersTest-447481758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d1bb1784-a05e-470a-885b-796ffd1a7a63 tempest-VolumesTransfersTest-447481758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d1bb1784-a05e-470a-885b-796ffd1a7a63 tempest-VolumesTransfersTest-447481758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:46 devstack sudo[96608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:12:46 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:46 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bbd5e576-7a8a-4b34-bc13-f6759c4ac540 tempest-VolumesCloneTest-467777112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.353s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-bbd5e576-7a8a-4b34-bc13-f6759c4ac540 tempest-VolumesCloneTest-467777112 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:12:46 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-bbd5e576-7a8a-4b34-bc13-f6759c4ac540 tempest-VolumesCloneTest-467777112 None] Deleted volume successfully.
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bbd5e576-7a8a-4b34-bc13-f6759c4ac540 tempest-VolumesCloneTest-467777112 None] Lock "cinder-9727d184-b562-4e99-87ef-e83382ea4116-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:12:46 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c5fa829e-9861-4fee-aef8-5dff67250a1d tempest-VolumesExtendTest-859689844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a 1073741824" returned: 0 in 0.603s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c5fa829e-9861-4fee-aef8-5dff67250a1d tempest-VolumesExtendTest-859689844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:46 devstack sudo[96612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a
Nov 06 17:12:46 devstack sudo[96612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:46 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d1bb1784-a05e-470a-885b-796ffd1a7a63 tempest-VolumesTransfersTest-447481758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.373s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:47 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-d1bb1784-a05e-470a-885b-796ffd1a7a63 tempest-VolumesTransfersTest-447481758 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:12:47 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-d1bb1784-a05e-470a-885b-796ffd1a7a63 tempest-VolumesTransfersTest-447481758 None] Deleted volume successfully.
Nov 06 17:12:47 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d1bb1784-a05e-470a-885b-796ffd1a7a63 tempest-VolumesTransfersTest-447481758 None] Lock "cinder-45c93ed8-7b13-4330-8687-1de0b9224767-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:12:47 devstack sudo[96612]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c5fa829e-9861-4fee-aef8-5dff67250a1d tempest-VolumesExtendTest-859689844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a" returned: 0 in 0.328s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c5fa829e-9861-4fee-aef8-5dff67250a1d tempest-VolumesExtendTest-859689844 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:12:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c5fa829e-9861-4fee-aef8-5dff67250a1d tempest-VolumesExtendTest-859689844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:12:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c5fa829e-9861-4fee-aef8-5dff67250a1d tempest-VolumesExtendTest-859689844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (917f776d-6a91-45d5-90e6-3157e289ca6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df3de772-142e-4354-97ec-352bab50372a', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c5fa829e-9861-4fee-aef8-5dff67250a1d tempest-VolumesExtendTest-859689844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0765b70-1c60-42da-b9eb-05eb67e24495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:47 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-c5fa829e-9861-4fee-aef8-5dff67250a1d tempest-VolumesExtendTest-859689844 None] Volume volume-df3de772-142e-4354-97ec-352bab50372a (df3de772-142e-4354-97ec-352bab50372a): created successfully
Nov 06 17:12:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c5fa829e-9861-4fee-aef8-5dff67250a1d tempest-VolumesExtendTest-859689844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0765b70-1c60-42da-b9eb-05eb67e24495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c5fa829e-9861-4fee-aef8-5dff67250a1d tempest-VolumesExtendTest-859689844 None] Flow 'volume_create_manager' (bf722597-afcf-404e-875f-43474b2c2a4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:12:47 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-c5fa829e-9861-4fee-aef8-5dff67250a1d tempest-VolumesExtendTest-859689844 None] Created volume successfully.
Nov 06 17:12:47 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fec3979-4725-4d7f-92b4-787eb5418ece tempest-VolumesTransfersTest-1301078058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:12:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0fec3979-4725-4d7f-92b4-787eb5418ece tempest-VolumesTransfersTest-1301078058 None] Flow 'volume_create_manager' (3f592e9a-75a3-4c3f-bdc3-7ebf0b0596d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:12:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0fec3979-4725-4d7f-92b4-787eb5418ece tempest-VolumesTransfersTest-1301078058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6219015c-3e14-44f7-a36e-2c5aa37bc638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0fec3979-4725-4d7f-92b4-787eb5418ece tempest-VolumesTransfersTest-1301078058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6219015c-3e14-44f7-a36e-2c5aa37bc638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-205594162',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0ae144d-9c91-48fb-8d7f-384e91a7bcab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd1220f07d1b4d23abbfb691d713d945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:12:47Z,use_quota=True,user_id='fd6d8c8bc0fa4d04a77b51d32776c69b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0fec3979-4725-4d7f-92b4-787eb5418ece tempest-VolumesTransfersTest-1301078058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38011c91-3da5-4714-a82a-6c79998a7864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0fec3979-4725-4d7f-92b4-787eb5418ece tempest-VolumesTransfersTest-1301078058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38011c91-3da5-4714-a82a-6c79998a7864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0fec3979-4725-4d7f-92b4-787eb5418ece tempest-VolumesTransfersTest-1301078058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef0b2e74-cc14-4ba4-ad28-60122d966a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0fec3979-4725-4d7f-92b4-787eb5418ece tempest-VolumesTransfersTest-1301078058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef0b2e74-cc14-4ba4-ad28-60122d966a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0ae144d-9c91-48fb-8d7f-384e91a7bcab', 'volume_name': 'volume-a0ae144d-9c91-48fb-8d7f-384e91a7bcab', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0fec3979-4725-4d7f-92b4-787eb5418ece tempest-VolumesTransfersTest-1301078058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acda2937-4578-46d6-9291-1f1fe4737eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0fec3979-4725-4d7f-92b4-787eb5418ece tempest-VolumesTransfersTest-1301078058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acda2937-4578-46d6-9291-1f1fe4737eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0fec3979-4725-4d7f-92b4-787eb5418ece tempest-VolumesTransfersTest-1301078058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81dc6824-90d7-46fd-9003-d1b659f96bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:47 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-0fec3979-4725-4d7f-92b4-787eb5418ece tempest-VolumesTransfersTest-1301078058 None] Volume a0ae144d-9c91-48fb-8d7f-384e91a7bcab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0ae144d-9c91-48fb-8d7f-384e91a7bcab', 'volume_size': 1}
Nov 06 17:12:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0fec3979-4725-4d7f-92b4-787eb5418ece tempest-VolumesTransfersTest-1301078058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:12:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0fec3979-4725-4d7f-92b4-787eb5418ece tempest-VolumesTransfersTest-1301078058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:12:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0fec3979-4725-4d7f-92b4-787eb5418ece tempest-VolumesTransfersTest-1301078058 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-205594162',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0ae144d-9c91-48fb-8d7f-384e91a7bcab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd1220f07d1b4d23abbfb691d713d945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:12:47Z,use_quota=True,user_id='fd6d8c8bc0fa4d04a77b51d32776c69b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:12:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-0fec3979-4725-4d7f-92b4-787eb5418ece tempest-VolumesTransfersTest-1301078058 None] Creating volume a0ae144d-9c91-48fb-8d7f-384e91a7bcab {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:12:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0fec3979-4725-4d7f-92b4-787eb5418ece tempest-VolumesTransfersTest-1301078058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:12:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0fec3979-4725-4d7f-92b4-787eb5418ece tempest-VolumesTransfersTest-1301078058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:12:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0fec3979-4725-4d7f-92b4-787eb5418ece tempest-VolumesTransfersTest-1301078058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:12:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0fec3979-4725-4d7f-92b4-787eb5418ece tempest-VolumesTransfersTest-1301078058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:12:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0fec3979-4725-4d7f-92b4-787eb5418ece tempest-VolumesTransfersTest-1301078058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:12:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0fec3979-4725-4d7f-92b4-787eb5418ece tempest-VolumesTransfersTest-1301078058 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:12:47 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-0fec3979-4725-4d7f-92b4-787eb5418ece tempest-VolumesTransfersTest-1301078058 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:12:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0fec3979-4725-4d7f-92b4-787eb5418ece tempest-VolumesTransfersTest-1301078058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a0ae144d-9c91-48fb-8d7f-384e91a7bcab 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:47 devstack sudo[96616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a0ae144d-9c91-48fb-8d7f-384e91a7bcab 1073741824
Nov 06 17:12:47 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:48 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0fec3979-4725-4d7f-92b4-787eb5418ece tempest-VolumesTransfersTest-1301078058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a0ae144d-9c91-48fb-8d7f-384e91a7bcab 1073741824" returned: 0 in 0.508s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0fec3979-4725-4d7f-92b4-787eb5418ece tempest-VolumesTransfersTest-1301078058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a0ae144d-9c91-48fb-8d7f-384e91a7bcab {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:48 devstack sudo[96622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a0ae144d-9c91-48fb-8d7f-384e91a7bcab
Nov 06 17:12:48 devstack sudo[96622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-085bb7f0-91f3-4e72-8818-bda1cdbe83c6 tempest-VolumesExtendTest-859689844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:12:48 devstack sudo[96622]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0fec3979-4725-4d7f-92b4-787eb5418ece tempest-VolumesTransfersTest-1301078058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a0ae144d-9c91-48fb-8d7f-384e91a7bcab" returned: 0 in 0.356s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:48 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0fec3979-4725-4d7f-92b4-787eb5418ece tempest-VolumesTransfersTest-1301078058 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:12:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0fec3979-4725-4d7f-92b4-787eb5418ece tempest-VolumesTransfersTest-1301078058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:12:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-085bb7f0-91f3-4e72-8818-bda1cdbe83c6 tempest-VolumesExtendTest-859689844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.034s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:12:48 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0fec3979-4725-4d7f-92b4-787eb5418ece tempest-VolumesTransfersTest-1301078058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81dc6824-90d7-46fd-9003-d1b659f96bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0ae144d-9c91-48fb-8d7f-384e91a7bcab', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:48 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0fec3979-4725-4d7f-92b4-787eb5418ece tempest-VolumesTransfersTest-1301078058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e089923-a593-4957-9b40-06f5409e914c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:48 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-085bb7f0-91f3-4e72-8818-bda1cdbe83c6 tempest-VolumesExtendTest-859689844 None] Creating offline snapshot add9a974-ce49-49e5-a954-eea03dda19e6 of volume df3de772-142e-4354-97ec-352bab50372a {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:12:48 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-0fec3979-4725-4d7f-92b4-787eb5418ece tempest-VolumesTransfersTest-1301078058 None] Volume volume-a0ae144d-9c91-48fb-8d7f-384e91a7bcab (a0ae144d-9c91-48fb-8d7f-384e91a7bcab): created successfully
Nov 06 17:12:48 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0fec3979-4725-4d7f-92b4-787eb5418ece tempest-VolumesTransfersTest-1301078058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e089923-a593-4957-9b40-06f5409e914c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:48 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0fec3979-4725-4d7f-92b4-787eb5418ece tempest-VolumesTransfersTest-1301078058 None] Flow 'volume_create_manager' (3f592e9a-75a3-4c3f-bdc3-7ebf0b0596d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:12:48 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[331c16de-e469-471c-b4f8-f4a0e3f7de08]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:12:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-085bb7f0-91f3-4e72-8818-bda1cdbe83c6 tempest-VolumesExtendTest-859689844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:48 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-0fec3979-4725-4d7f-92b4-787eb5418ece tempest-VolumesTransfersTest-1301078058 None] Created volume successfully.
Nov 06 17:12:48 devstack sudo[96625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a
Nov 06 17:12:48 devstack sudo[96625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:49 devstack sudo[96625]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-085bb7f0-91f3-4e72-8818-bda1cdbe83c6 tempest-VolumesExtendTest-859689844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a" returned: 0 in 0.453s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-085bb7f0-91f3-4e72-8818-bda1cdbe83c6 tempest-VolumesExtendTest-859689844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a.add9a974-ce49-49e5-a954-eea03dda19e6 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:49 devstack sudo[96630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a.add9a974-ce49-49e5-a954-eea03dda19e6 1G
Nov 06 17:12:49 devstack sudo[96630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:49 devstack sudo[96630]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-085bb7f0-91f3-4e72-8818-bda1cdbe83c6 tempest-VolumesExtendTest-859689844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a.add9a974-ce49-49e5-a954-eea03dda19e6 1G" returned: 0 in 0.567s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-085bb7f0-91f3-4e72-8818-bda1cdbe83c6 tempest-VolumesExtendTest-859689844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df3de772-142e-4354-97ec-352bab50372a -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a.add9a974-ce49-49e5-a954-eea03dda19e6 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:49 devstack sudo[96636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df3de772-142e-4354-97ec-352bab50372a -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a.add9a974-ce49-49e5-a954-eea03dda19e6
Nov 06 17:12:49 devstack sudo[96636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:49 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7272c79c-47a2-4838-be6a-d97423d5fe08 tempest-VolumesTransfersTest-447481758 None] Acquiring lock "cinder-a0ae144d-9c91-48fb-8d7f-384e91a7bcab-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:12:49 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7272c79c-47a2-4838-be6a-d97423d5fe08 tempest-VolumesTransfersTest-447481758 None] Lock "cinder-a0ae144d-9c91-48fb-8d7f-384e91a7bcab-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:12:49 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7272c79c-47a2-4838-be6a-d97423d5fe08 tempest-VolumesTransfersTest-447481758 None] Acquiring lock "cinder-quobyte-a0ae144d-9c91-48fb-8d7f-384e91a7bcab" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:12:49 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7272c79c-47a2-4838-be6a-d97423d5fe08 tempest-VolumesTransfersTest-447481758 None] Lock "cinder-quobyte-a0ae144d-9c91-48fb-8d7f-384e91a7bcab" acquired by "delete_volume" :: waited 0.024s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:12:49 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a29c55-8589-4473-9e8e-a8d8b2352afc]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:12:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7272c79c-47a2-4838-be6a-d97423d5fe08 tempest-VolumesTransfersTest-447481758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a0ae144d-9c91-48fb-8d7f-384e91a7bcab {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:50 devstack sudo[96636]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-085bb7f0-91f3-4e72-8818-bda1cdbe83c6 tempest-VolumesExtendTest-859689844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df3de772-142e-4354-97ec-352bab50372a -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a.add9a974-ce49-49e5-a954-eea03dda19e6" returned: 0 in 0.430s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:50 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-085bb7f0-91f3-4e72-8818-bda1cdbe83c6 tempest-VolumesExtendTest-859689844 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a.add9a974-ce49-49e5-a954-eea03dda19e6 is being set with open permissions: ugo+rw
Nov 06 17:12:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-085bb7f0-91f3-4e72-8818-bda1cdbe83c6 tempest-VolumesExtendTest-859689844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a.add9a974-ce49-49e5-a954-eea03dda19e6 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:50 devstack sudo[96642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a.add9a974-ce49-49e5-a954-eea03dda19e6
Nov 06 17:12:50 devstack sudo[96642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:50 devstack sudo[96641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a0ae144d-9c91-48fb-8d7f-384e91a7bcab
Nov 06 17:12:50 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:50 devstack sudo[96642]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-085bb7f0-91f3-4e72-8818-bda1cdbe83c6 tempest-VolumesExtendTest-859689844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a.add9a974-ce49-49e5-a954-eea03dda19e6" returned: 0 in 0.326s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-085bb7f0-91f3-4e72-8818-bda1cdbe83c6 tempest-VolumesExtendTest-859689844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:50 devstack sudo[96648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a.info
Nov 06 17:12:50 devstack sudo[96648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:50 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7272c79c-47a2-4838-be6a-d97423d5fe08 tempest-VolumesTransfersTest-447481758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a0ae144d-9c91-48fb-8d7f-384e91a7bcab" returned: 0 in 0.505s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7272c79c-47a2-4838-be6a-d97423d5fe08 tempest-VolumesTransfersTest-447481758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a0ae144d-9c91-48fb-8d7f-384e91a7bcab {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:50 devstack sudo[96651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a0ae144d-9c91-48fb-8d7f-384e91a7bcab
Nov 06 17:12:50 devstack sudo[96651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:50 devstack sudo[96648]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-085bb7f0-91f3-4e72-8818-bda1cdbe83c6 tempest-VolumesExtendTest-859689844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a.info" returned: 0 in 0.313s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:50 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-085bb7f0-91f3-4e72-8818-bda1cdbe83c6 tempest-VolumesExtendTest-859689844 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a.info is being set with open permissions: ugo+rw
Nov 06 17:12:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-085bb7f0-91f3-4e72-8818-bda1cdbe83c6 tempest-VolumesExtendTest-859689844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:50 devstack sudo[96654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a.info
Nov 06 17:12:50 devstack sudo[96654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:50 devstack sudo[96651]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7272c79c-47a2-4838-be6a-d97423d5fe08 tempest-VolumesTransfersTest-447481758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a0ae144d-9c91-48fb-8d7f-384e91a7bcab" returned: 0 in 0.270s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:50 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7272c79c-47a2-4838-be6a-d97423d5fe08 tempest-VolumesTransfersTest-447481758 None] Lock "cinder-quobyte-a0ae144d-9c91-48fb-8d7f-384e91a7bcab" released by "delete_volume" :: held 0.838s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:12:50 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-7272c79c-47a2-4838-be6a-d97423d5fe08 tempest-VolumesTransfersTest-447481758 None] Created reservations ['40b94dcb-bf02-40d0-8c0c-bb412b847922', '00b85705-a8af-418e-8b30-82ceb9ec6c8c', '0c2c270f-1cde-4c00-9ba9-629345b6b680', 'f6d6f3f1-8aad-4b1f-b5d2-aa835da873f7'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:12:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7272c79c-47a2-4838-be6a-d97423d5fe08 tempest-VolumesTransfersTest-447481758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:12:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7272c79c-47a2-4838-be6a-d97423d5fe08 tempest-VolumesTransfersTest-447481758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:12:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7272c79c-47a2-4838-be6a-d97423d5fe08 tempest-VolumesTransfersTest-447481758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:12:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7272c79c-47a2-4838-be6a-d97423d5fe08 tempest-VolumesTransfersTest-447481758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:12:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7272c79c-47a2-4838-be6a-d97423d5fe08 tempest-VolumesTransfersTest-447481758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:12:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7272c79c-47a2-4838-be6a-d97423d5fe08 tempest-VolumesTransfersTest-447481758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:51 devstack sudo[96658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:12:51 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:51 devstack sudo[96654]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-085bb7f0-91f3-4e72-8818-bda1cdbe83c6 tempest-VolumesExtendTest-859689844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a.info" returned: 0 in 0.348s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-085bb7f0-91f3-4e72-8818-bda1cdbe83c6 tempest-VolumesExtendTest-859689844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.629s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:12:51 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-085bb7f0-91f3-4e72-8818-bda1cdbe83c6 tempest-VolumesExtendTest-859689844 None] Create snapshot completed successfully
Nov 06 17:12:51 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7272c79c-47a2-4838-be6a-d97423d5fe08 tempest-VolumesTransfersTest-447481758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.291s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:51 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-7272c79c-47a2-4838-be6a-d97423d5fe08 tempest-VolumesTransfersTest-447481758 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:12:51 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-7272c79c-47a2-4838-be6a-d97423d5fe08 tempest-VolumesTransfersTest-447481758 None] Deleted volume successfully.
Nov 06 17:12:51 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7272c79c-47a2-4838-be6a-d97423d5fe08 tempest-VolumesTransfersTest-447481758 None] Lock "cinder-a0ae144d-9c91-48fb-8d7f-384e91a7bcab-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0fb31438-4ec4-41fd-9519-49fcd0963315 tempest-VolumesExtendTest-859689844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0fb31438-4ec4-41fd-9519-49fcd0963315 tempest-VolumesExtendTest-859689844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[043c890d-f6c4-4b95-a538-2f239557ee57]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0fb31438-4ec4-41fd-9519-49fcd0963315 tempest-VolumesExtendTest-859689844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea241fc6-af6e-4cbe-9437-7c29737ce0f2 tempest-VolumesNegativeTest-1737180247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ea241fc6-af6e-4cbe-9437-7c29737ce0f2 tempest-VolumesNegativeTest-1737180247 None] Flow 'volume_create_manager' (ee2c8141-62d8-4dd9-bc05-40b1bedb5aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ea241fc6-af6e-4cbe-9437-7c29737ce0f2 tempest-VolumesNegativeTest-1737180247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ced6a467-34df-4e4b-822e-71ae79e1d961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ea241fc6-af6e-4cbe-9437-7c29737ce0f2 tempest-VolumesNegativeTest-1737180247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ced6a467-34df-4e4b-822e-71ae79e1d961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1643843637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dbb8a78-91ad-4056-afb6-db76b6e3b482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0753b3100a4544e9a263841eb24eb108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:12:52Z,use_quota=True,user_id='b5725fb6e5864ce3bbcc6d5b0cf3c106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ea241fc6-af6e-4cbe-9437-7c29737ce0f2 tempest-VolumesNegativeTest-1737180247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ce16ede-e439-4a0b-a644-f1c0660793e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ea241fc6-af6e-4cbe-9437-7c29737ce0f2 tempest-VolumesNegativeTest-1737180247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ce16ede-e439-4a0b-a644-f1c0660793e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:52 devstack sudo[96663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ea241fc6-af6e-4cbe-9437-7c29737ce0f2 tempest-VolumesNegativeTest-1737180247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90a80b55-24bf-4b24-91b9-05e4081b9568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:52 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ea241fc6-af6e-4cbe-9437-7c29737ce0f2 tempest-VolumesNegativeTest-1737180247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90a80b55-24bf-4b24-91b9-05e4081b9568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dbb8a78-91ad-4056-afb6-db76b6e3b482', 'volume_name': 'volume-0dbb8a78-91ad-4056-afb6-db76b6e3b482', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ea241fc6-af6e-4cbe-9437-7c29737ce0f2 tempest-VolumesNegativeTest-1737180247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (829a7941-cd37-4d13-9c60-da3755c04ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ea241fc6-af6e-4cbe-9437-7c29737ce0f2 tempest-VolumesNegativeTest-1737180247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (829a7941-cd37-4d13-9c60-da3755c04ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ea241fc6-af6e-4cbe-9437-7c29737ce0f2 tempest-VolumesNegativeTest-1737180247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ecf040-ced0-4386-aabf-1fb99ca90adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:52 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-ea241fc6-af6e-4cbe-9437-7c29737ce0f2 tempest-VolumesNegativeTest-1737180247 None] Volume 0dbb8a78-91ad-4056-afb6-db76b6e3b482: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dbb8a78-91ad-4056-afb6-db76b6e3b482', 'volume_size': 1}
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ea241fc6-af6e-4cbe-9437-7c29737ce0f2 tempest-VolumesNegativeTest-1737180247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-719eb44d-5e73-4c84-a6cb-0d7cd43c6aa8 tempest-VolumesListTestJSON-1125216116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-719eb44d-5e73-4c84-a6cb-0d7cd43c6aa8 tempest-VolumesListTestJSON-1125216116 None] Flow 'volume_create_manager' (0cf47674-a5ee-492d-a3e5-4296758476b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-719eb44d-5e73-4c84-a6cb-0d7cd43c6aa8 tempest-VolumesListTestJSON-1125216116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35214fc3-d541-490e-bb90-a1e73695c512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-719eb44d-5e73-4c84-a6cb-0d7cd43c6aa8 tempest-VolumesListTestJSON-1125216116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35214fc3-d541-490e-bb90-a1e73695c512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-989661108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114fb0ab-6527-4b47-ae27-00b81a92be59,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a00713010b4f45dcbb85eb39a2e3e0f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:12:52Z,use_quota=True,user_id='8ded52f9c34841999396b3de31aef56d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:52 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-719eb44d-5e73-4c84-a6cb-0d7cd43c6aa8 tempest-VolumesListTestJSON-1125216116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce99bb3d-7f6a-421e-8c2b-a3169219651c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-719eb44d-5e73-4c84-a6cb-0d7cd43c6aa8 tempest-VolumesListTestJSON-1125216116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce99bb3d-7f6a-421e-8c2b-a3169219651c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-719eb44d-5e73-4c84-a6cb-0d7cd43c6aa8 tempest-VolumesListTestJSON-1125216116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e14cba16-18f3-4a35-9870-0914e1d550e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-719eb44d-5e73-4c84-a6cb-0d7cd43c6aa8 tempest-VolumesListTestJSON-1125216116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e14cba16-18f3-4a35-9870-0914e1d550e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '114fb0ab-6527-4b47-ae27-00b81a92be59', 'volume_name': 'volume-114fb0ab-6527-4b47-ae27-00b81a92be59', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-719eb44d-5e73-4c84-a6cb-0d7cd43c6aa8 tempest-VolumesListTestJSON-1125216116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b157984-5c6d-4c7e-8bb8-fa2aba75a33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-719eb44d-5e73-4c84-a6cb-0d7cd43c6aa8 tempest-VolumesListTestJSON-1125216116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b157984-5c6d-4c7e-8bb8-fa2aba75a33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-719eb44d-5e73-4c84-a6cb-0d7cd43c6aa8 tempest-VolumesListTestJSON-1125216116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54eb70fb-14a8-4dcb-be65-753dbb206059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:52 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-719eb44d-5e73-4c84-a6cb-0d7cd43c6aa8 tempest-VolumesListTestJSON-1125216116 None] Volume 114fb0ab-6527-4b47-ae27-00b81a92be59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-114fb0ab-6527-4b47-ae27-00b81a92be59', 'volume_size': 1}
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-719eb44d-5e73-4c84-a6cb-0d7cd43c6aa8 tempest-VolumesListTestJSON-1125216116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0fb31438-4ec4-41fd-9519-49fcd0963315 tempest-VolumesExtendTest-859689844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a" returned: 0 in 0.557s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0fb31438-4ec4-41fd-9519-49fcd0963315 tempest-VolumesExtendTest-859689844 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a.add9a974-ce49-49e5-a954-eea03dda19e6 2G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0fb31438-4ec4-41fd-9519-49fcd0963315 tempest-VolumesExtendTest-859689844 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a.add9a974-ce49-49e5-a954-eea03dda19e6 2G" returned: 0 in 0.140s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0fb31438-4ec4-41fd-9519-49fcd0963315 tempest-VolumesExtendTest-859689844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.741s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ea241fc6-af6e-4cbe-9437-7c29737ce0f2 tempest-VolumesNegativeTest-1737180247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.540s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ea241fc6-af6e-4cbe-9437-7c29737ce0f2 tempest-VolumesNegativeTest-1737180247 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1643843637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dbb8a78-91ad-4056-afb6-db76b6e3b482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0753b3100a4544e9a263841eb24eb108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:12:52Z,use_quota=True,user_id='b5725fb6e5864ce3bbcc6d5b0cf3c106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-ea241fc6-af6e-4cbe-9437-7c29737ce0f2 tempest-VolumesNegativeTest-1737180247 None] Creating volume 0dbb8a78-91ad-4056-afb6-db76b6e3b482 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ea241fc6-af6e-4cbe-9437-7c29737ce0f2 tempest-VolumesNegativeTest-1737180247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ea241fc6-af6e-4cbe-9437-7c29737ce0f2 tempest-VolumesNegativeTest-1737180247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ea241fc6-af6e-4cbe-9437-7c29737ce0f2 tempest-VolumesNegativeTest-1737180247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ea241fc6-af6e-4cbe-9437-7c29737ce0f2 tempest-VolumesNegativeTest-1737180247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ea241fc6-af6e-4cbe-9437-7c29737ce0f2 tempest-VolumesNegativeTest-1737180247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ea241fc6-af6e-4cbe-9437-7c29737ce0f2 tempest-VolumesNegativeTest-1737180247 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:12:52 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-ea241fc6-af6e-4cbe-9437-7c29737ce0f2 tempest-VolumesNegativeTest-1737180247 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:12:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ea241fc6-af6e-4cbe-9437-7c29737ce0f2 tempest-VolumesNegativeTest-1737180247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0dbb8a78-91ad-4056-afb6-db76b6e3b482 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:52 devstack sudo[96672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0dbb8a78-91ad-4056-afb6-db76b6e3b482 1073741824
Nov 06 17:12:52 devstack sudo[96672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:52 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-0fb31438-4ec4-41fd-9519-49fcd0963315 tempest-VolumesExtendTest-859689844 None] Extend volume completed successfully.
Nov 06 17:12:53 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-078c594f-8fd0-40e2-8c05-a12f9813e19c tempest-VolumesExtendTest-859689844 None] Acquiring lock "cinder-add9a974-ce49-49e5-a954-eea03dda19e6-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:12:53 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-078c594f-8fd0-40e2-8c05-a12f9813e19c tempest-VolumesExtendTest-859689844 None] Lock "cinder-add9a974-ce49-49e5-a954-eea03dda19e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:12:53 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-078c594f-8fd0-40e2-8c05-a12f9813e19c tempest-VolumesExtendTest-859689844 None] Acquiring lock "cinder-quobyte-df3de772-142e-4354-97ec-352bab50372a" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:12:53 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-078c594f-8fd0-40e2-8c05-a12f9813e19c tempest-VolumesExtendTest-859689844 None] Lock "cinder-quobyte-df3de772-142e-4354-97ec-352bab50372a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:12:53 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-078c594f-8fd0-40e2-8c05-a12f9813e19c tempest-VolumesExtendTest-859689844 None] Acquiring lock "cinder-quobyte-add9a974-ce49-49e5-a954-eea03dda19e6" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:12:53 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-078c594f-8fd0-40e2-8c05-a12f9813e19c tempest-VolumesExtendTest-859689844 None] Lock "cinder-quobyte-add9a974-ce49-49e5-a954-eea03dda19e6" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:12:53 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-078c594f-8fd0-40e2-8c05-a12f9813e19c tempest-VolumesExtendTest-859689844 None] Deleting offline snapshot add9a974-ce49-49e5-a954-eea03dda19e6 of volume df3de772-142e-4354-97ec-352bab50372a {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:12:53 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-078c594f-8fd0-40e2-8c05-a12f9813e19c tempest-VolumesExtendTest-859689844 None] snapshot_file for this snap is: volume-df3de772-142e-4354-97ec-352bab50372a.add9a974-ce49-49e5-a954-eea03dda19e6 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:12:53 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1866374-b1d2-49c6-b1c5-a0b7f87412ea]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:12:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-078c594f-8fd0-40e2-8c05-a12f9813e19c tempest-VolumesExtendTest-859689844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a.add9a974-ce49-49e5-a954-eea03dda19e6 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:53 devstack sudo[96672]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ea241fc6-af6e-4cbe-9437-7c29737ce0f2 tempest-VolumesNegativeTest-1737180247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0dbb8a78-91ad-4056-afb6-db76b6e3b482 1073741824" returned: 0 in 0.567s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ea241fc6-af6e-4cbe-9437-7c29737ce0f2 tempest-VolumesNegativeTest-1737180247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0dbb8a78-91ad-4056-afb6-db76b6e3b482 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:53 devstack sudo[96678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0dbb8a78-91ad-4056-afb6-db76b6e3b482
Nov 06 17:12:53 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:53 devstack sudo[96677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a.add9a974-ce49-49e5-a954-eea03dda19e6
Nov 06 17:12:53 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:53 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ea241fc6-af6e-4cbe-9437-7c29737ce0f2 tempest-VolumesNegativeTest-1737180247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0dbb8a78-91ad-4056-afb6-db76b6e3b482" returned: 0 in 0.296s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:53 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ea241fc6-af6e-4cbe-9437-7c29737ce0f2 tempest-VolumesNegativeTest-1737180247 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:12:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ea241fc6-af6e-4cbe-9437-7c29737ce0f2 tempest-VolumesNegativeTest-1737180247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:12:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-719eb44d-5e73-4c84-a6cb-0d7cd43c6aa8 tempest-VolumesListTestJSON-1125216116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.091s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:12:53 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-719eb44d-5e73-4c84-a6cb-0d7cd43c6aa8 tempest-VolumesListTestJSON-1125216116 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-989661108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114fb0ab-6527-4b47-ae27-00b81a92be59,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a00713010b4f45dcbb85eb39a2e3e0f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:12:52Z,use_quota=True,user_id='8ded52f9c34841999396b3de31aef56d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:12:53 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-719eb44d-5e73-4c84-a6cb-0d7cd43c6aa8 tempest-VolumesListTestJSON-1125216116 None] Creating volume 114fb0ab-6527-4b47-ae27-00b81a92be59 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:12:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-719eb44d-5e73-4c84-a6cb-0d7cd43c6aa8 tempest-VolumesListTestJSON-1125216116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:12:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-719eb44d-5e73-4c84-a6cb-0d7cd43c6aa8 tempest-VolumesListTestJSON-1125216116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:12:53 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-719eb44d-5e73-4c84-a6cb-0d7cd43c6aa8 tempest-VolumesListTestJSON-1125216116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:12:53 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-719eb44d-5e73-4c84-a6cb-0d7cd43c6aa8 tempest-VolumesListTestJSON-1125216116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:12:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-719eb44d-5e73-4c84-a6cb-0d7cd43c6aa8 tempest-VolumesListTestJSON-1125216116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:12:53 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-719eb44d-5e73-4c84-a6cb-0d7cd43c6aa8 tempest-VolumesListTestJSON-1125216116 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:12:53 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-719eb44d-5e73-4c84-a6cb-0d7cd43c6aa8 tempest-VolumesListTestJSON-1125216116 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:12:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-719eb44d-5e73-4c84-a6cb-0d7cd43c6aa8 tempest-VolumesListTestJSON-1125216116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-114fb0ab-6527-4b47-ae27-00b81a92be59 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:53 devstack sudo[96684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-114fb0ab-6527-4b47-ae27-00b81a92be59 1073741824
Nov 06 17:12:53 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ea241fc6-af6e-4cbe-9437-7c29737ce0f2 tempest-VolumesNegativeTest-1737180247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ecf040-ced0-4386-aabf-1fb99ca90adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dbb8a78-91ad-4056-afb6-db76b6e3b482', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ea241fc6-af6e-4cbe-9437-7c29737ce0f2 tempest-VolumesNegativeTest-1737180247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1f05230-710f-466c-97ff-148f0617df33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:53 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-ea241fc6-af6e-4cbe-9437-7c29737ce0f2 tempest-VolumesNegativeTest-1737180247 None] Volume volume-0dbb8a78-91ad-4056-afb6-db76b6e3b482 (0dbb8a78-91ad-4056-afb6-db76b6e3b482): created successfully
Nov 06 17:12:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ea241fc6-af6e-4cbe-9437-7c29737ce0f2 tempest-VolumesNegativeTest-1737180247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1f05230-710f-466c-97ff-148f0617df33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ea241fc6-af6e-4cbe-9437-7c29737ce0f2 tempest-VolumesNegativeTest-1737180247 None] Flow 'volume_create_manager' (ee2c8141-62d8-4dd9-bc05-40b1bedb5aec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:12:53 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-078c594f-8fd0-40e2-8c05-a12f9813e19c tempest-VolumesExtendTest-859689844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a.add9a974-ce49-49e5-a954-eea03dda19e6" returned: 0 in 0.470s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:53 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-078c594f-8fd0-40e2-8c05-a12f9813e19c tempest-VolumesExtendTest-859689844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df3de772-142e-4354-97ec-352bab50372a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:12:53 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-ea241fc6-af6e-4cbe-9437-7c29737ce0f2 tempest-VolumesNegativeTest-1737180247 None] Created volume successfully.
Nov 06 17:12:53 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[2940588d-0e79-4c7d-b12f-2a82dc3ba286]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:12:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-078c594f-8fd0-40e2-8c05-a12f9813e19c tempest-VolumesExtendTest-859689844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:53 devstack sudo[96687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a
Nov 06 17:12:53 devstack sudo[96687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:54 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-719eb44d-5e73-4c84-a6cb-0d7cd43c6aa8 tempest-VolumesListTestJSON-1125216116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-114fb0ab-6527-4b47-ae27-00b81a92be59 1073741824" returned: 0 in 0.598s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:54 devstack sudo[96687]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-078c594f-8fd0-40e2-8c05-a12f9813e19c tempest-VolumesExtendTest-859689844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a" returned: 0 in 0.487s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-078c594f-8fd0-40e2-8c05-a12f9813e19c tempest-VolumesExtendTest-859689844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a.add9a974-ce49-49e5-a954-eea03dda19e6 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:54 devstack sudo[96696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a.add9a974-ce49-49e5-a954-eea03dda19e6
Nov 06 17:12:54 devstack sudo[96696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-719eb44d-5e73-4c84-a6cb-0d7cd43c6aa8 tempest-VolumesListTestJSON-1125216116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-114fb0ab-6527-4b47-ae27-00b81a92be59 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:54 devstack sudo[96698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-114fb0ab-6527-4b47-ae27-00b81a92be59
Nov 06 17:12:54 devstack sudo[96698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:54 devstack sudo[96698]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-719eb44d-5e73-4c84-a6cb-0d7cd43c6aa8 tempest-VolumesListTestJSON-1125216116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-114fb0ab-6527-4b47-ae27-00b81a92be59" returned: 0 in 0.332s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-719eb44d-5e73-4c84-a6cb-0d7cd43c6aa8 tempest-VolumesListTestJSON-1125216116 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:12:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-719eb44d-5e73-4c84-a6cb-0d7cd43c6aa8 tempest-VolumesListTestJSON-1125216116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:12:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-719eb44d-5e73-4c84-a6cb-0d7cd43c6aa8 tempest-VolumesListTestJSON-1125216116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54eb70fb-14a8-4dcb-be65-753dbb206059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-114fb0ab-6527-4b47-ae27-00b81a92be59', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-719eb44d-5e73-4c84-a6cb-0d7cd43c6aa8 tempest-VolumesListTestJSON-1125216116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b626aa6-1d45-4e74-ada0-69691cfb7e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:54 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-719eb44d-5e73-4c84-a6cb-0d7cd43c6aa8 tempest-VolumesListTestJSON-1125216116 None] Volume volume-114fb0ab-6527-4b47-ae27-00b81a92be59 (114fb0ab-6527-4b47-ae27-00b81a92be59): created successfully
Nov 06 17:12:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-719eb44d-5e73-4c84-a6cb-0d7cd43c6aa8 tempest-VolumesListTestJSON-1125216116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b626aa6-1d45-4e74-ada0-69691cfb7e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-719eb44d-5e73-4c84-a6cb-0d7cd43c6aa8 tempest-VolumesListTestJSON-1125216116 None] Flow 'volume_create_manager' (0cf47674-a5ee-492d-a3e5-4296758476b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:12:54 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-719eb44d-5e73-4c84-a6cb-0d7cd43c6aa8 tempest-VolumesListTestJSON-1125216116 None] Created volume successfully.
Nov 06 17:12:54 devstack sudo[96696]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-078c594f-8fd0-40e2-8c05-a12f9813e19c tempest-VolumesExtendTest-859689844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a.add9a974-ce49-49e5-a954-eea03dda19e6" returned: 0 in 0.515s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-078c594f-8fd0-40e2-8c05-a12f9813e19c tempest-VolumesExtendTest-859689844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a.add9a974-ce49-49e5-a954-eea03dda19e6 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:54 devstack sudo[96705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a.add9a974-ce49-49e5-a954-eea03dda19e6
Nov 06 17:12:54 devstack sudo[96705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:55 devstack sudo[96705]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-078c594f-8fd0-40e2-8c05-a12f9813e19c tempest-VolumesExtendTest-859689844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a.add9a974-ce49-49e5-a954-eea03dda19e6" returned: 0 in 0.316s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:55 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-078c594f-8fd0-40e2-8c05-a12f9813e19c tempest-VolumesExtendTest-859689844 None] Lock "cinder-quobyte-add9a974-ce49-49e5-a954-eea03dda19e6" released by "_delete_snapshot" :: held 1.937s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:12:55 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-078c594f-8fd0-40e2-8c05-a12f9813e19c tempest-VolumesExtendTest-859689844 None] Lock "cinder-quobyte-df3de772-142e-4354-97ec-352bab50372a" released by "delete_snapshot" :: held 1.972s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:12:55 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-078c594f-8fd0-40e2-8c05-a12f9813e19c tempest-VolumesExtendTest-859689844 None] Created reservations ['8952a06d-ba50-48ae-b2b9-15fcf1ec1768', 'ccf20bb1-32bc-413c-a7b3-43a54b4b29d6', '175a7e0d-8f2d-4ff7-9162-fef2ca4b1592', 'c5ea1437-8b39-4369-8c49-b24807d19665'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:12:55 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-078c594f-8fd0-40e2-8c05-a12f9813e19c tempest-VolumesExtendTest-859689844 None] Delete snapshot completed successfully.
Nov 06 17:12:55 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-078c594f-8fd0-40e2-8c05-a12f9813e19c tempest-VolumesExtendTest-859689844 None] Lock "cinder-add9a974-ce49-49e5-a954-eea03dda19e6-delete_snapshot" released by "delete_snapshot" :: held 2.207s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:12:56 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea941909-2082-40fc-92e0-50c102c8bb8f tempest-VolumesListTestJSON-1125216116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:12:56 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ea941909-2082-40fc-92e0-50c102c8bb8f tempest-VolumesListTestJSON-1125216116 None] Flow 'volume_create_manager' (6534bb10-dd95-4583-bbf9-ae2b98fab4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:12:56 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ea941909-2082-40fc-92e0-50c102c8bb8f tempest-VolumesListTestJSON-1125216116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b48b688a-8557-4906-8f2a-9cbe9cc5f546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:56 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ea941909-2082-40fc-92e0-50c102c8bb8f tempest-VolumesListTestJSON-1125216116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b48b688a-8557-4906-8f2a-9cbe9cc5f546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1427399182',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a088a258-7b93-413e-ac5a-5664f643d1d9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a00713010b4f45dcbb85eb39a2e3e0f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:12:56Z,use_quota=True,user_id='8ded52f9c34841999396b3de31aef56d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:56 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ea941909-2082-40fc-92e0-50c102c8bb8f tempest-VolumesListTestJSON-1125216116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (361965b5-fd87-4a92-8cc9-e65183a336b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:56 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ea941909-2082-40fc-92e0-50c102c8bb8f tempest-VolumesListTestJSON-1125216116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (361965b5-fd87-4a92-8cc9-e65183a336b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:56 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ea941909-2082-40fc-92e0-50c102c8bb8f tempest-VolumesListTestJSON-1125216116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7b6c2dd-e0e0-4c44-ad8b-463cfa3adc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:56 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ea941909-2082-40fc-92e0-50c102c8bb8f tempest-VolumesListTestJSON-1125216116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7b6c2dd-e0e0-4c44-ad8b-463cfa3adc34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a088a258-7b93-413e-ac5a-5664f643d1d9', 'volume_name': 'volume-a088a258-7b93-413e-ac5a-5664f643d1d9', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:56 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ea941909-2082-40fc-92e0-50c102c8bb8f tempest-VolumesListTestJSON-1125216116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (566c3d28-8808-4da3-86bb-a7f4bc2f40c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:56 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ea941909-2082-40fc-92e0-50c102c8bb8f tempest-VolumesListTestJSON-1125216116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (566c3d28-8808-4da3-86bb-a7f4bc2f40c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:56 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ea941909-2082-40fc-92e0-50c102c8bb8f tempest-VolumesListTestJSON-1125216116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fd82f76-08df-4f7a-99ff-06cb05cb5ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:56 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-ea941909-2082-40fc-92e0-50c102c8bb8f tempest-VolumesListTestJSON-1125216116 None] Volume a088a258-7b93-413e-ac5a-5664f643d1d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a088a258-7b93-413e-ac5a-5664f643d1d9', 'volume_size': 1}
Nov 06 17:12:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ea941909-2082-40fc-92e0-50c102c8bb8f tempest-VolumesListTestJSON-1125216116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:12:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ea941909-2082-40fc-92e0-50c102c8bb8f tempest-VolumesListTestJSON-1125216116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:12:56 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ea941909-2082-40fc-92e0-50c102c8bb8f tempest-VolumesListTestJSON-1125216116 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1427399182',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a088a258-7b93-413e-ac5a-5664f643d1d9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a00713010b4f45dcbb85eb39a2e3e0f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:12:56Z,use_quota=True,user_id='8ded52f9c34841999396b3de31aef56d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:12:56 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-ea941909-2082-40fc-92e0-50c102c8bb8f tempest-VolumesListTestJSON-1125216116 None] Creating volume a088a258-7b93-413e-ac5a-5664f643d1d9 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:12:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ea941909-2082-40fc-92e0-50c102c8bb8f tempest-VolumesListTestJSON-1125216116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:12:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ea941909-2082-40fc-92e0-50c102c8bb8f tempest-VolumesListTestJSON-1125216116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:12:56 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ea941909-2082-40fc-92e0-50c102c8bb8f tempest-VolumesListTestJSON-1125216116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:12:56 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ea941909-2082-40fc-92e0-50c102c8bb8f tempest-VolumesListTestJSON-1125216116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:12:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ea941909-2082-40fc-92e0-50c102c8bb8f tempest-VolumesListTestJSON-1125216116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:12:56 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ea941909-2082-40fc-92e0-50c102c8bb8f tempest-VolumesListTestJSON-1125216116 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:12:56 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-ea941909-2082-40fc-92e0-50c102c8bb8f tempest-VolumesListTestJSON-1125216116 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:12:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ea941909-2082-40fc-92e0-50c102c8bb8f tempest-VolumesListTestJSON-1125216116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a088a258-7b93-413e-ac5a-5664f643d1d9 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:56 devstack sudo[96712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a088a258-7b93-413e-ac5a-5664f643d1d9 1073741824
Nov 06 17:12:56 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:56 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-009f2b8e-4f71-4bcb-88d3-ab088893905b tempest-VolumesExtendTest-859689844 None] Acquiring lock "cinder-df3de772-142e-4354-97ec-352bab50372a-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:12:56 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-009f2b8e-4f71-4bcb-88d3-ab088893905b tempest-VolumesExtendTest-859689844 None] Lock "cinder-df3de772-142e-4354-97ec-352bab50372a-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:12:56 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-009f2b8e-4f71-4bcb-88d3-ab088893905b tempest-VolumesExtendTest-859689844 None] Acquiring lock "cinder-quobyte-df3de772-142e-4354-97ec-352bab50372a" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:12:56 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-009f2b8e-4f71-4bcb-88d3-ab088893905b tempest-VolumesExtendTest-859689844 None] Lock "cinder-quobyte-df3de772-142e-4354-97ec-352bab50372a" acquired by "delete_volume" :: waited 0.026s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:12:56 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f46abf-d993-4b26-8626-71255aa31b13]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:12:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-009f2b8e-4f71-4bcb-88d3-ab088893905b tempest-VolumesExtendTest-859689844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:57 devstack sudo[96716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a
Nov 06 17:12:57 devstack sudo[96716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:57 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ea941909-2082-40fc-92e0-50c102c8bb8f tempest-VolumesListTestJSON-1125216116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a088a258-7b93-413e-ac5a-5664f643d1d9 1073741824" returned: 0 in 0.720s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ea941909-2082-40fc-92e0-50c102c8bb8f tempest-VolumesListTestJSON-1125216116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a088a258-7b93-413e-ac5a-5664f643d1d9 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:57 devstack sudo[96723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a088a258-7b93-413e-ac5a-5664f643d1d9
Nov 06 17:12:57 devstack sudo[96723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:57 devstack sudo[96716]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-009f2b8e-4f71-4bcb-88d3-ab088893905b tempest-VolumesExtendTest-859689844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a" returned: 0 in 0.657s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-009f2b8e-4f71-4bcb-88d3-ab088893905b tempest-VolumesExtendTest-859689844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:57 devstack sudo[96730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a
Nov 06 17:12:57 devstack sudo[96730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:57 devstack sudo[96723]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ea941909-2082-40fc-92e0-50c102c8bb8f tempest-VolumesListTestJSON-1125216116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a088a258-7b93-413e-ac5a-5664f643d1d9" returned: 0 in 0.345s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:57 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ea941909-2082-40fc-92e0-50c102c8bb8f tempest-VolumesListTestJSON-1125216116 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:12:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ea941909-2082-40fc-92e0-50c102c8bb8f tempest-VolumesListTestJSON-1125216116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:12:57 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ea941909-2082-40fc-92e0-50c102c8bb8f tempest-VolumesListTestJSON-1125216116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fd82f76-08df-4f7a-99ff-06cb05cb5ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a088a258-7b93-413e-ac5a-5664f643d1d9', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:57 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ea941909-2082-40fc-92e0-50c102c8bb8f tempest-VolumesListTestJSON-1125216116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23fc4b41-ee01-42aa-bb86-3cd11e389818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:57 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-ea941909-2082-40fc-92e0-50c102c8bb8f tempest-VolumesListTestJSON-1125216116 None] Volume volume-a088a258-7b93-413e-ac5a-5664f643d1d9 (a088a258-7b93-413e-ac5a-5664f643d1d9): created successfully
Nov 06 17:12:57 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ea941909-2082-40fc-92e0-50c102c8bb8f tempest-VolumesListTestJSON-1125216116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23fc4b41-ee01-42aa-bb86-3cd11e389818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:57 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ea941909-2082-40fc-92e0-50c102c8bb8f tempest-VolumesListTestJSON-1125216116 None] Flow 'volume_create_manager' (6534bb10-dd95-4583-bbf9-ae2b98fab4c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:12:57 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-ea941909-2082-40fc-92e0-50c102c8bb8f tempest-VolumesListTestJSON-1125216116 None] Created volume successfully.
Nov 06 17:12:57 devstack sudo[96730]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-009f2b8e-4f71-4bcb-88d3-ab088893905b tempest-VolumesExtendTest-859689844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-df3de772-142e-4354-97ec-352bab50372a" returned: 0 in 0.404s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:57 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-009f2b8e-4f71-4bcb-88d3-ab088893905b tempest-VolumesExtendTest-859689844 None] Lock "cinder-quobyte-df3de772-142e-4354-97ec-352bab50372a" released by "delete_volume" :: held 1.196s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:12:58 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-009f2b8e-4f71-4bcb-88d3-ab088893905b tempest-VolumesExtendTest-859689844 None] Created reservations ['8a75624f-a77d-433c-9f08-d2abebc5be18', '14b6776b-dfe2-4ad6-a1bc-97dc986fca7a', '5280a540-cb6a-49a2-bfd5-520535b6e4f0', 'f26527ec-e104-4bf7-9967-6aae86a227af'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:12:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-009f2b8e-4f71-4bcb-88d3-ab088893905b tempest-VolumesExtendTest-859689844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:12:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-009f2b8e-4f71-4bcb-88d3-ab088893905b tempest-VolumesExtendTest-859689844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:12:58 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-009f2b8e-4f71-4bcb-88d3-ab088893905b tempest-VolumesExtendTest-859689844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:12:58 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-009f2b8e-4f71-4bcb-88d3-ab088893905b tempest-VolumesExtendTest-859689844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:12:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-009f2b8e-4f71-4bcb-88d3-ab088893905b tempest-VolumesExtendTest-859689844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:12:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-009f2b8e-4f71-4bcb-88d3-ab088893905b tempest-VolumesExtendTest-859689844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:58 devstack sudo[96748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:12:58 devstack sudo[96748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:58 devstack sudo[96748]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-009f2b8e-4f71-4bcb-88d3-ab088893905b tempest-VolumesExtendTest-859689844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.328s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:58 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-009f2b8e-4f71-4bcb-88d3-ab088893905b tempest-VolumesExtendTest-859689844 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:12:58 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-009f2b8e-4f71-4bcb-88d3-ab088893905b tempest-VolumesExtendTest-859689844 None] Deleted volume successfully.
Nov 06 17:12:58 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-009f2b8e-4f71-4bcb-88d3-ab088893905b tempest-VolumesExtendTest-859689844 None] Lock "cinder-df3de772-142e-4354-97ec-352bab50372a-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:12:59 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0ddb471-afcb-4c3c-9d5e-8c94e5ea0223 tempest-VolumesListTestJSON-1125216116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:12:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e0ddb471-afcb-4c3c-9d5e-8c94e5ea0223 tempest-VolumesListTestJSON-1125216116 None] Flow 'volume_create_manager' (e75e3994-4f99-4b5b-a81b-6b94ef871e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:12:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e0ddb471-afcb-4c3c-9d5e-8c94e5ea0223 tempest-VolumesListTestJSON-1125216116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5209e5f8-497f-40ca-8753-d879e958ded2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e0ddb471-afcb-4c3c-9d5e-8c94e5ea0223 tempest-VolumesListTestJSON-1125216116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5209e5f8-497f-40ca-8753-d879e958ded2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-579547985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1924e3ae-56a8-4b3e-bb39-d3b0a649b593,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a00713010b4f45dcbb85eb39a2e3e0f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:12:59Z,use_quota=True,user_id='8ded52f9c34841999396b3de31aef56d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e0ddb471-afcb-4c3c-9d5e-8c94e5ea0223 tempest-VolumesListTestJSON-1125216116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc09be2a-4103-4117-a79f-efdd518a36d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e0ddb471-afcb-4c3c-9d5e-8c94e5ea0223 tempest-VolumesListTestJSON-1125216116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc09be2a-4103-4117-a79f-efdd518a36d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e0ddb471-afcb-4c3c-9d5e-8c94e5ea0223 tempest-VolumesListTestJSON-1125216116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (638011ec-dbda-4cb1-a320-f50c8fd07600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e0ddb471-afcb-4c3c-9d5e-8c94e5ea0223 tempest-VolumesListTestJSON-1125216116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (638011ec-dbda-4cb1-a320-f50c8fd07600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1924e3ae-56a8-4b3e-bb39-d3b0a649b593', 'volume_name': 'volume-1924e3ae-56a8-4b3e-bb39-d3b0a649b593', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e0ddb471-afcb-4c3c-9d5e-8c94e5ea0223 tempest-VolumesListTestJSON-1125216116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d929cd0-df6b-4510-a0b6-9afbf2ffadbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e0ddb471-afcb-4c3c-9d5e-8c94e5ea0223 tempest-VolumesListTestJSON-1125216116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d929cd0-df6b-4510-a0b6-9afbf2ffadbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:12:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e0ddb471-afcb-4c3c-9d5e-8c94e5ea0223 tempest-VolumesListTestJSON-1125216116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31a239f9-f405-4c46-9fea-b52b81882b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:12:59 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-e0ddb471-afcb-4c3c-9d5e-8c94e5ea0223 tempest-VolumesListTestJSON-1125216116 None] Volume 1924e3ae-56a8-4b3e-bb39-d3b0a649b593: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1924e3ae-56a8-4b3e-bb39-d3b0a649b593', 'volume_size': 1}
Nov 06 17:12:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e0ddb471-afcb-4c3c-9d5e-8c94e5ea0223 tempest-VolumesListTestJSON-1125216116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:12:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e0ddb471-afcb-4c3c-9d5e-8c94e5ea0223 tempest-VolumesListTestJSON-1125216116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:12:59 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e0ddb471-afcb-4c3c-9d5e-8c94e5ea0223 tempest-VolumesListTestJSON-1125216116 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-579547985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1924e3ae-56a8-4b3e-bb39-d3b0a649b593,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a00713010b4f45dcbb85eb39a2e3e0f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:12:59Z,use_quota=True,user_id='8ded52f9c34841999396b3de31aef56d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:12:59 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-e0ddb471-afcb-4c3c-9d5e-8c94e5ea0223 tempest-VolumesListTestJSON-1125216116 None] Creating volume 1924e3ae-56a8-4b3e-bb39-d3b0a649b593 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:12:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e0ddb471-afcb-4c3c-9d5e-8c94e5ea0223 tempest-VolumesListTestJSON-1125216116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:12:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e0ddb471-afcb-4c3c-9d5e-8c94e5ea0223 tempest-VolumesListTestJSON-1125216116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:12:59 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e0ddb471-afcb-4c3c-9d5e-8c94e5ea0223 tempest-VolumesListTestJSON-1125216116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:12:59 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e0ddb471-afcb-4c3c-9d5e-8c94e5ea0223 tempest-VolumesListTestJSON-1125216116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:12:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e0ddb471-afcb-4c3c-9d5e-8c94e5ea0223 tempest-VolumesListTestJSON-1125216116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:12:59 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e0ddb471-afcb-4c3c-9d5e-8c94e5ea0223 tempest-VolumesListTestJSON-1125216116 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:12:59 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-e0ddb471-afcb-4c3c-9d5e-8c94e5ea0223 tempest-VolumesListTestJSON-1125216116 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:12:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e0ddb471-afcb-4c3c-9d5e-8c94e5ea0223 tempest-VolumesListTestJSON-1125216116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1924e3ae-56a8-4b3e-bb39-d3b0a649b593 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:59 devstack sudo[96751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1924e3ae-56a8-4b3e-bb39-d3b0a649b593 1073741824
Nov 06 17:12:59 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:12:59 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root
Nov 06 17:12:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e0ddb471-afcb-4c3c-9d5e-8c94e5ea0223 tempest-VolumesListTestJSON-1125216116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1924e3ae-56a8-4b3e-bb39-d3b0a649b593 1073741824" returned: 0 in 0.581s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:12:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e0ddb471-afcb-4c3c-9d5e-8c94e5ea0223 tempest-VolumesListTestJSON-1125216116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1924e3ae-56a8-4b3e-bb39-d3b0a649b593 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:12:59 devstack sudo[96757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1924e3ae-56a8-4b3e-bb39-d3b0a649b593
Nov 06 17:12:59 devstack sudo[96757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:00 devstack sudo[96757]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e0ddb471-afcb-4c3c-9d5e-8c94e5ea0223 tempest-VolumesListTestJSON-1125216116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1924e3ae-56a8-4b3e-bb39-d3b0a649b593" returned: 0 in 0.335s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:00 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e0ddb471-afcb-4c3c-9d5e-8c94e5ea0223 tempest-VolumesListTestJSON-1125216116 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:13:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e0ddb471-afcb-4c3c-9d5e-8c94e5ea0223 tempest-VolumesListTestJSON-1125216116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:00 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e0ddb471-afcb-4c3c-9d5e-8c94e5ea0223 tempest-VolumesListTestJSON-1125216116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31a239f9-f405-4c46-9fea-b52b81882b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1924e3ae-56a8-4b3e-bb39-d3b0a649b593', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:00 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e0ddb471-afcb-4c3c-9d5e-8c94e5ea0223 tempest-VolumesListTestJSON-1125216116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c6bbfd-0df0-4f24-b718-daf47e0dc60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:00 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-e0ddb471-afcb-4c3c-9d5e-8c94e5ea0223 tempest-VolumesListTestJSON-1125216116 None] Volume volume-1924e3ae-56a8-4b3e-bb39-d3b0a649b593 (1924e3ae-56a8-4b3e-bb39-d3b0a649b593): created successfully
Nov 06 17:13:00 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e0ddb471-afcb-4c3c-9d5e-8c94e5ea0223 tempest-VolumesListTestJSON-1125216116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c6bbfd-0df0-4f24-b718-daf47e0dc60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:00 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e0ddb471-afcb-4c3c-9d5e-8c94e5ea0223 tempest-VolumesListTestJSON-1125216116 None] Flow 'volume_create_manager' (e75e3994-4f99-4b5b-a81b-6b94ef871e05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:13:00 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-e0ddb471-afcb-4c3c-9d5e-8c94e5ea0223 tempest-VolumesListTestJSON-1125216116 None] Created volume successfully.
Nov 06 17:13:01 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-99e040f2-9d64-4341-8c88-3d9c9a926495 tempest-VolumesTransfersV357Test-1137165598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:13:01 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-99e040f2-9d64-4341-8c88-3d9c9a926495 tempest-VolumesTransfersV357Test-1137165598 None] Flow 'volume_create_manager' (e13079bb-f725-4261-a6ba-17279c66edfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:13:01 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-99e040f2-9d64-4341-8c88-3d9c9a926495 tempest-VolumesTransfersV357Test-1137165598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a50f8c9-c8e5-4b1d-8db8-066d13b969ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:01 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-99e040f2-9d64-4341-8c88-3d9c9a926495 tempest-VolumesTransfersV357Test-1137165598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a50f8c9-c8e5-4b1d-8db8-066d13b969ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1032982147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab211baf-ee73-43c1-bc3f-cbbdc451efbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e815cd5dbc604562a1bf359182479670',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:13:01Z,use_quota=True,user_id='c9cd11bfcaad47ea9d6ee2ace432970b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:01 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-99e040f2-9d64-4341-8c88-3d9c9a926495 tempest-VolumesTransfersV357Test-1137165598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42305b9f-f88e-4b3f-b8a5-11b95ba3122e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:01 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-99e040f2-9d64-4341-8c88-3d9c9a926495 tempest-VolumesTransfersV357Test-1137165598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42305b9f-f88e-4b3f-b8a5-11b95ba3122e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:01 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-99e040f2-9d64-4341-8c88-3d9c9a926495 tempest-VolumesTransfersV357Test-1137165598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb8103f-768a-404f-858d-0b711f8bf266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:01 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-99e040f2-9d64-4341-8c88-3d9c9a926495 tempest-VolumesTransfersV357Test-1137165598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb8103f-768a-404f-858d-0b711f8bf266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab211baf-ee73-43c1-bc3f-cbbdc451efbe', 'volume_name': 'volume-ab211baf-ee73-43c1-bc3f-cbbdc451efbe', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:01 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-99e040f2-9d64-4341-8c88-3d9c9a926495 tempest-VolumesTransfersV357Test-1137165598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (742bd005-58d5-46f7-b951-3a1a9e308373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:01 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-99e040f2-9d64-4341-8c88-3d9c9a926495 tempest-VolumesTransfersV357Test-1137165598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (742bd005-58d5-46f7-b951-3a1a9e308373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:01 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-99e040f2-9d64-4341-8c88-3d9c9a926495 tempest-VolumesTransfersV357Test-1137165598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f255fdf6-d121-43c5-81a0-c08512da9d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:01 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-99e040f2-9d64-4341-8c88-3d9c9a926495 tempest-VolumesTransfersV357Test-1137165598 None] Volume ab211baf-ee73-43c1-bc3f-cbbdc451efbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab211baf-ee73-43c1-bc3f-cbbdc451efbe', 'volume_size': 1}
Nov 06 17:13:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-99e040f2-9d64-4341-8c88-3d9c9a926495 tempest-VolumesTransfersV357Test-1137165598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-99e040f2-9d64-4341-8c88-3d9c9a926495 tempest-VolumesTransfersV357Test-1137165598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:01 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-99e040f2-9d64-4341-8c88-3d9c9a926495 tempest-VolumesTransfersV357Test-1137165598 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1032982147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab211baf-ee73-43c1-bc3f-cbbdc451efbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e815cd5dbc604562a1bf359182479670',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:13:01Z,use_quota=True,user_id='c9cd11bfcaad47ea9d6ee2ace432970b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:13:01 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-99e040f2-9d64-4341-8c88-3d9c9a926495 tempest-VolumesTransfersV357Test-1137165598 None] Creating volume ab211baf-ee73-43c1-bc3f-cbbdc451efbe {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:13:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-99e040f2-9d64-4341-8c88-3d9c9a926495 tempest-VolumesTransfersV357Test-1137165598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-99e040f2-9d64-4341-8c88-3d9c9a926495 tempest-VolumesTransfersV357Test-1137165598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:01 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-99e040f2-9d64-4341-8c88-3d9c9a926495 tempest-VolumesTransfersV357Test-1137165598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:13:01 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-99e040f2-9d64-4341-8c88-3d9c9a926495 tempest-VolumesTransfersV357Test-1137165598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:13:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-99e040f2-9d64-4341-8c88-3d9c9a926495 tempest-VolumesTransfersV357Test-1137165598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:01 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-99e040f2-9d64-4341-8c88-3d9c9a926495 tempest-VolumesTransfersV357Test-1137165598 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:13:01 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-99e040f2-9d64-4341-8c88-3d9c9a926495 tempest-VolumesTransfersV357Test-1137165598 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:13:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-99e040f2-9d64-4341-8c88-3d9c9a926495 tempest-VolumesTransfersV357Test-1137165598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ab211baf-ee73-43c1-bc3f-cbbdc451efbe 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:01 devstack sudo[96762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ab211baf-ee73-43c1-bc3f-cbbdc451efbe 1073741824
Nov 06 17:13:01 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:02 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-99e040f2-9d64-4341-8c88-3d9c9a926495 tempest-VolumesTransfersV357Test-1137165598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ab211baf-ee73-43c1-bc3f-cbbdc451efbe 1073741824" returned: 0 in 0.880s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-99e040f2-9d64-4341-8c88-3d9c9a926495 tempest-VolumesTransfersV357Test-1137165598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ab211baf-ee73-43c1-bc3f-cbbdc451efbe {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:02 devstack sudo[96809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ab211baf-ee73-43c1-bc3f-cbbdc451efbe
Nov 06 17:13:02 devstack sudo[96809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:03 devstack sudo[96809]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-99e040f2-9d64-4341-8c88-3d9c9a926495 tempest-VolumesTransfersV357Test-1137165598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ab211baf-ee73-43c1-bc3f-cbbdc451efbe" returned: 0 in 0.746s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:03 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-99e040f2-9d64-4341-8c88-3d9c9a926495 tempest-VolumesTransfersV357Test-1137165598 None] <== create_volume: return (1722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:13:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-99e040f2-9d64-4341-8c88-3d9c9a926495 tempest-VolumesTransfersV357Test-1137165598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.725s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-99e040f2-9d64-4341-8c88-3d9c9a926495 tempest-VolumesTransfersV357Test-1137165598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f255fdf6-d121-43c5-81a0-c08512da9d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab211baf-ee73-43c1-bc3f-cbbdc451efbe', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-99e040f2-9d64-4341-8c88-3d9c9a926495 tempest-VolumesTransfersV357Test-1137165598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c11150f6-0a7e-40ef-a979-71189ceb93b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:03 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-99e040f2-9d64-4341-8c88-3d9c9a926495 tempest-VolumesTransfersV357Test-1137165598 None] Volume volume-ab211baf-ee73-43c1-bc3f-cbbdc451efbe (ab211baf-ee73-43c1-bc3f-cbbdc451efbe): created successfully
Nov 06 17:13:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-99e040f2-9d64-4341-8c88-3d9c9a926495 tempest-VolumesTransfersV357Test-1137165598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c11150f6-0a7e-40ef-a979-71189ceb93b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-99e040f2-9d64-4341-8c88-3d9c9a926495 tempest-VolumesTransfersV357Test-1137165598 None] Flow 'volume_create_manager' (e13079bb-f725-4261-a6ba-17279c66edfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:13:03 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-99e040f2-9d64-4341-8c88-3d9c9a926495 tempest-VolumesTransfersV357Test-1137165598 None] Created volume successfully.
Nov 06 17:13:05 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-256eb105-0e5e-4dc1-a6a6-a17e67e3bd45 tempest-VolumesTransfersV357Test-834417159 None] Transfer volume completed successfully.
Nov 06 17:13:05 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-60574e6f-18a3-4afb-8516-3e5f5fa19289 tempest-VolumesListTestJSON-1125216116 None] Acquiring lock "cinder-1924e3ae-56a8-4b3e-bb39-d3b0a649b593-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:05 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-60574e6f-18a3-4afb-8516-3e5f5fa19289 tempest-VolumesListTestJSON-1125216116 None] Lock "cinder-1924e3ae-56a8-4b3e-bb39-d3b0a649b593-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:05 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-60574e6f-18a3-4afb-8516-3e5f5fa19289 tempest-VolumesListTestJSON-1125216116 None] Acquiring lock "cinder-quobyte-1924e3ae-56a8-4b3e-bb39-d3b0a649b593" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:05 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-60574e6f-18a3-4afb-8516-3e5f5fa19289 tempest-VolumesListTestJSON-1125216116 None] Lock "cinder-quobyte-1924e3ae-56a8-4b3e-bb39-d3b0a649b593" acquired by "delete_volume" :: waited 0.068s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:05 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd834473-bc09-46f2-9558-5ebc446f29bc]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:13:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-60574e6f-18a3-4afb-8516-3e5f5fa19289 tempest-VolumesListTestJSON-1125216116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1924e3ae-56a8-4b3e-bb39-d3b0a649b593 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:06 devstack sudo[96841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1924e3ae-56a8-4b3e-bb39-d3b0a649b593
Nov 06 17:13:06 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:06 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-05fd94d2-f851-4ede-a25e-8f93108c7631 tempest-VolumesTransfersV357Test-81159551 None] Acquiring lock "cinder-ab211baf-ee73-43c1-bc3f-cbbdc451efbe-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:06 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-05fd94d2-f851-4ede-a25e-8f93108c7631 tempest-VolumesTransfersV357Test-81159551 None] Lock "cinder-ab211baf-ee73-43c1-bc3f-cbbdc451efbe-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:06 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-05fd94d2-f851-4ede-a25e-8f93108c7631 tempest-VolumesTransfersV357Test-81159551 None] Acquiring lock "cinder-quobyte-ab211baf-ee73-43c1-bc3f-cbbdc451efbe" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:06 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-05fd94d2-f851-4ede-a25e-8f93108c7631 tempest-VolumesTransfersV357Test-81159551 None] Lock "cinder-quobyte-ab211baf-ee73-43c1-bc3f-cbbdc451efbe" acquired by "delete_volume" :: waited 0.027s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:06 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[523c0ae8-869d-40ad-bc73-1750322796c7]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:13:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-05fd94d2-f851-4ede-a25e-8f93108c7631 tempest-VolumesTransfersV357Test-81159551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ab211baf-ee73-43c1-bc3f-cbbdc451efbe {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:06 devstack sudo[96843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ab211baf-ee73-43c1-bc3f-cbbdc451efbe
Nov 06 17:13:06 devstack sudo[96843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:06 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-60574e6f-18a3-4afb-8516-3e5f5fa19289 tempest-VolumesListTestJSON-1125216116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1924e3ae-56a8-4b3e-bb39-d3b0a649b593" returned: 0 in 1.021s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-60574e6f-18a3-4afb-8516-3e5f5fa19289 tempest-VolumesListTestJSON-1125216116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1924e3ae-56a8-4b3e-bb39-d3b0a649b593 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:06 devstack sudo[96849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1924e3ae-56a8-4b3e-bb39-d3b0a649b593
Nov 06 17:13:06 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:07 devstack sudo[96843]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-05fd94d2-f851-4ede-a25e-8f93108c7631 tempest-VolumesTransfersV357Test-81159551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ab211baf-ee73-43c1-bc3f-cbbdc451efbe" returned: 0 in 0.554s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-05fd94d2-f851-4ede-a25e-8f93108c7631 tempest-VolumesTransfersV357Test-81159551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ab211baf-ee73-43c1-bc3f-cbbdc451efbe {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:07 devstack sudo[96854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ab211baf-ee73-43c1-bc3f-cbbdc451efbe
Nov 06 17:13:07 devstack sudo[96854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:07 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-60574e6f-18a3-4afb-8516-3e5f5fa19289 tempest-VolumesListTestJSON-1125216116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1924e3ae-56a8-4b3e-bb39-d3b0a649b593" returned: 0 in 0.387s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:07 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-60574e6f-18a3-4afb-8516-3e5f5fa19289 tempest-VolumesListTestJSON-1125216116 None] Lock "cinder-quobyte-1924e3ae-56a8-4b3e-bb39-d3b0a649b593" released by "delete_volume" :: held 1.566s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:07 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-60574e6f-18a3-4afb-8516-3e5f5fa19289 tempest-VolumesListTestJSON-1125216116 None] Created reservations ['74783cd2-153c-4d2c-bc6e-af9ac00fc1bb', 'ac1145a2-9e00-4b70-a21b-96c030f6ca18', 'fc788eb1-598d-4f75-b8c0-040171878e6d', '7d4133bd-2035-43b9-a5db-fdc777ab7bcc'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:13:07 devstack sudo[96854]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-05fd94d2-f851-4ede-a25e-8f93108c7631 tempest-VolumesTransfersV357Test-81159551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ab211baf-ee73-43c1-bc3f-cbbdc451efbe" returned: 0 in 0.438s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:07 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-05fd94d2-f851-4ede-a25e-8f93108c7631 tempest-VolumesTransfersV357Test-81159551 None] Lock "cinder-quobyte-ab211baf-ee73-43c1-bc3f-cbbdc451efbe" released by "delete_volume" :: held 1.097s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-60574e6f-18a3-4afb-8516-3e5f5fa19289 tempest-VolumesListTestJSON-1125216116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-60574e6f-18a3-4afb-8516-3e5f5fa19289 tempest-VolumesListTestJSON-1125216116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:07 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-60574e6f-18a3-4afb-8516-3e5f5fa19289 tempest-VolumesListTestJSON-1125216116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:13:07 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-60574e6f-18a3-4afb-8516-3e5f5fa19289 tempest-VolumesListTestJSON-1125216116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:13:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-60574e6f-18a3-4afb-8516-3e5f5fa19289 tempest-VolumesListTestJSON-1125216116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-60574e6f-18a3-4afb-8516-3e5f5fa19289 tempest-VolumesListTestJSON-1125216116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:07 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-05fd94d2-f851-4ede-a25e-8f93108c7631 tempest-VolumesTransfersV357Test-81159551 None] Created reservations ['05fa3dec-a26b-4d2b-9198-cfe0ff59430b', 'f0e35b9e-9dd1-463c-bf5e-d4d537f83a6b', '63016cf6-b82e-4821-99dd-3d747b481086', 'f1968381-37ac-4d44-bd70-bb5132ec901e'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:13:07 devstack sudo[96878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:13:07 devstack sudo[96878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-05fd94d2-f851-4ede-a25e-8f93108c7631 tempest-VolumesTransfersV357Test-81159551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-05fd94d2-f851-4ede-a25e-8f93108c7631 tempest-VolumesTransfersV357Test-81159551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:07 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-05fd94d2-f851-4ede-a25e-8f93108c7631 tempest-VolumesTransfersV357Test-81159551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:13:07 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-05fd94d2-f851-4ede-a25e-8f93108c7631 tempest-VolumesTransfersV357Test-81159551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:13:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-05fd94d2-f851-4ede-a25e-8f93108c7631 tempest-VolumesTransfersV357Test-81159551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-05fd94d2-f851-4ede-a25e-8f93108c7631 tempest-VolumesTransfersV357Test-81159551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:07 devstack sudo[96880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:13:07 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:08 devstack sudo[96878]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-60574e6f-18a3-4afb-8516-3e5f5fa19289 tempest-VolumesListTestJSON-1125216116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.416s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:08 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-60574e6f-18a3-4afb-8516-3e5f5fa19289 tempest-VolumesListTestJSON-1125216116 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:13:08 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-60574e6f-18a3-4afb-8516-3e5f5fa19289 tempest-VolumesListTestJSON-1125216116 None] Deleted volume successfully.
Nov 06 17:13:08 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-60574e6f-18a3-4afb-8516-3e5f5fa19289 tempest-VolumesListTestJSON-1125216116 None] Lock "cinder-1924e3ae-56a8-4b3e-bb39-d3b0a649b593-delete_volume" released by "delete_volume" :: held 2.449s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:08 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-05fd94d2-f851-4ede-a25e-8f93108c7631 tempest-VolumesTransfersV357Test-81159551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.375s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:08 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-05fd94d2-f851-4ede-a25e-8f93108c7631 tempest-VolumesTransfersV357Test-81159551 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:13:08 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-05fd94d2-f851-4ede-a25e-8f93108c7631 tempest-VolumesTransfersV357Test-81159551 None] Deleted volume successfully.
Nov 06 17:13:08 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-05fd94d2-f851-4ede-a25e-8f93108c7631 tempest-VolumesTransfersV357Test-81159551 None] Lock "cinder-ab211baf-ee73-43c1-bc3f-cbbdc451efbe-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:08 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-4d2f48ae-3725-4cf0-a5f1-b9c1d999484a tempest-VolumesListTestJSON-1125216116 None] Acquiring lock "cinder-a088a258-7b93-413e-ac5a-5664f643d1d9-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:08 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-4d2f48ae-3725-4cf0-a5f1-b9c1d999484a tempest-VolumesListTestJSON-1125216116 None] Lock "cinder-a088a258-7b93-413e-ac5a-5664f643d1d9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:08 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-4d2f48ae-3725-4cf0-a5f1-b9c1d999484a tempest-VolumesListTestJSON-1125216116 None] Acquiring lock "cinder-quobyte-a088a258-7b93-413e-ac5a-5664f643d1d9" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:08 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-4d2f48ae-3725-4cf0-a5f1-b9c1d999484a tempest-VolumesListTestJSON-1125216116 None] Lock "cinder-quobyte-a088a258-7b93-413e-ac5a-5664f643d1d9" acquired by "delete_volume" :: waited 0.022s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:08 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[96650b73-db4b-4d54-ac4f-18779081b197]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:13:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4d2f48ae-3725-4cf0-a5f1-b9c1d999484a tempest-VolumesListTestJSON-1125216116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a088a258-7b93-413e-ac5a-5664f643d1d9 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:08 devstack sudo[96885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a088a258-7b93-413e-ac5a-5664f643d1d9
Nov 06 17:13:08 devstack sudo[96885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:08 devstack sudo[96885]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4d2f48ae-3725-4cf0-a5f1-b9c1d999484a tempest-VolumesListTestJSON-1125216116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a088a258-7b93-413e-ac5a-5664f643d1d9" returned: 0 in 0.408s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4d2f48ae-3725-4cf0-a5f1-b9c1d999484a tempest-VolumesListTestJSON-1125216116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a088a258-7b93-413e-ac5a-5664f643d1d9 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:08 devstack sudo[96891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a088a258-7b93-413e-ac5a-5664f643d1d9
Nov 06 17:13:08 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:09 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4d2f48ae-3725-4cf0-a5f1-b9c1d999484a tempest-VolumesListTestJSON-1125216116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a088a258-7b93-413e-ac5a-5664f643d1d9" returned: 0 in 0.405s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-4d2f48ae-3725-4cf0-a5f1-b9c1d999484a tempest-VolumesListTestJSON-1125216116 None] Lock "cinder-quobyte-a088a258-7b93-413e-ac5a-5664f643d1d9" released by "delete_volume" :: held 0.879s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-4d2f48ae-3725-4cf0-a5f1-b9c1d999484a tempest-VolumesListTestJSON-1125216116 None] Created reservations ['387de5e5-e7cb-456c-aab1-aa2026309ceb', '9527e88c-52b0-4c2d-af1f-9d321a1329b3', '498d89d4-d4e2-4dd0-bc42-53485c96b0c2', '21382d7d-7a33-40eb-ba8c-703d04d2f382'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4d2f48ae-3725-4cf0-a5f1-b9c1d999484a tempest-VolumesListTestJSON-1125216116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4d2f48ae-3725-4cf0-a5f1-b9c1d999484a tempest-VolumesListTestJSON-1125216116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4d2f48ae-3725-4cf0-a5f1-b9c1d999484a tempest-VolumesListTestJSON-1125216116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4d2f48ae-3725-4cf0-a5f1-b9c1d999484a tempest-VolumesListTestJSON-1125216116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4d2f48ae-3725-4cf0-a5f1-b9c1d999484a tempest-VolumesListTestJSON-1125216116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4d2f48ae-3725-4cf0-a5f1-b9c1d999484a tempest-VolumesListTestJSON-1125216116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:09 devstack sudo[96895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:13:09 devstack sudo[96895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2c7ed10-44b6-4518-b850-3e23fa93bd1b tempest-VolumesTransfersV357Test-1137165598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c2c7ed10-44b6-4518-b850-3e23fa93bd1b tempest-VolumesTransfersV357Test-1137165598 None] Flow 'volume_create_manager' (e2538356-04b3-41ff-9a40-9e3f3f0d110a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c2c7ed10-44b6-4518-b850-3e23fa93bd1b tempest-VolumesTransfersV357Test-1137165598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1c6ad25-aa1b-42e6-9967-3c3e506ae41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ee606ab5-8156-4ada-8ed8-69b08222ae61 tempest-VolumesListTestJSON-1125216116 None] Acquiring lock "cinder-114fb0ab-6527-4b47-ae27-00b81a92be59-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c2c7ed10-44b6-4518-b850-3e23fa93bd1b tempest-VolumesTransfersV357Test-1137165598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1c6ad25-aa1b-42e6-9967-3c3e506ae41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1304101155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1ab07fa-28bb-4b56-8b84-fe66a279fdc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e815cd5dbc604562a1bf359182479670',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:13:09Z,use_quota=True,user_id='c9cd11bfcaad47ea9d6ee2ace432970b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c2c7ed10-44b6-4518-b850-3e23fa93bd1b tempest-VolumesTransfersV357Test-1137165598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2db0be55-c832-489d-bd25-29bfa5e51272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c2c7ed10-44b6-4518-b850-3e23fa93bd1b tempest-VolumesTransfersV357Test-1137165598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2db0be55-c832-489d-bd25-29bfa5e51272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c2c7ed10-44b6-4518-b850-3e23fa93bd1b tempest-VolumesTransfersV357Test-1137165598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c3b322-7696-484d-b260-e24ff549f1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c2c7ed10-44b6-4518-b850-3e23fa93bd1b tempest-VolumesTransfersV357Test-1137165598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c3b322-7696-484d-b260-e24ff549f1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1ab07fa-28bb-4b56-8b84-fe66a279fdc4', 'volume_name': 'volume-c1ab07fa-28bb-4b56-8b84-fe66a279fdc4', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c2c7ed10-44b6-4518-b850-3e23fa93bd1b tempest-VolumesTransfersV357Test-1137165598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b21b5167-b299-48e1-95d5-ef872bd7dde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c2c7ed10-44b6-4518-b850-3e23fa93bd1b tempest-VolumesTransfersV357Test-1137165598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b21b5167-b299-48e1-95d5-ef872bd7dde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c2c7ed10-44b6-4518-b850-3e23fa93bd1b tempest-VolumesTransfersV357Test-1137165598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5856fe7e-a5b2-4588-85e3-698d48a76a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:09 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-c2c7ed10-44b6-4518-b850-3e23fa93bd1b tempest-VolumesTransfersV357Test-1137165598 None] Volume c1ab07fa-28bb-4b56-8b84-fe66a279fdc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1ab07fa-28bb-4b56-8b84-fe66a279fdc4', 'volume_size': 1}
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c2c7ed10-44b6-4518-b850-3e23fa93bd1b tempest-VolumesTransfersV357Test-1137165598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c2c7ed10-44b6-4518-b850-3e23fa93bd1b tempest-VolumesTransfersV357Test-1137165598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c2c7ed10-44b6-4518-b850-3e23fa93bd1b tempest-VolumesTransfersV357Test-1137165598 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1304101155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1ab07fa-28bb-4b56-8b84-fe66a279fdc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e815cd5dbc604562a1bf359182479670',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:13:09Z,use_quota=True,user_id='c9cd11bfcaad47ea9d6ee2ace432970b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-c2c7ed10-44b6-4518-b850-3e23fa93bd1b tempest-VolumesTransfersV357Test-1137165598 None] Creating volume c1ab07fa-28bb-4b56-8b84-fe66a279fdc4 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c2c7ed10-44b6-4518-b850-3e23fa93bd1b tempest-VolumesTransfersV357Test-1137165598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c2c7ed10-44b6-4518-b850-3e23fa93bd1b tempest-VolumesTransfersV357Test-1137165598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c2c7ed10-44b6-4518-b850-3e23fa93bd1b tempest-VolumesTransfersV357Test-1137165598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c2c7ed10-44b6-4518-b850-3e23fa93bd1b tempest-VolumesTransfersV357Test-1137165598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c2c7ed10-44b6-4518-b850-3e23fa93bd1b tempest-VolumesTransfersV357Test-1137165598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c2c7ed10-44b6-4518-b850-3e23fa93bd1b tempest-VolumesTransfersV357Test-1137165598 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:13:09 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-c2c7ed10-44b6-4518-b850-3e23fa93bd1b tempest-VolumesTransfersV357Test-1137165598 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c2c7ed10-44b6-4518-b850-3e23fa93bd1b tempest-VolumesTransfersV357Test-1137165598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c1ab07fa-28bb-4b56-8b84-fe66a279fdc4 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ee606ab5-8156-4ada-8ed8-69b08222ae61 tempest-VolumesListTestJSON-1125216116 None] Lock "cinder-114fb0ab-6527-4b47-ae27-00b81a92be59-delete_volume" acquired by "delete_volume" :: waited 0.136s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:09 devstack sudo[96897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c1ab07fa-28bb-4b56-8b84-fe66a279fdc4 1073741824
Nov 06 17:13:09 devstack sudo[96897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ee606ab5-8156-4ada-8ed8-69b08222ae61 tempest-VolumesListTestJSON-1125216116 None] Acquiring lock "cinder-quobyte-114fb0ab-6527-4b47-ae27-00b81a92be59" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:09 devstack sudo[96895]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4d2f48ae-3725-4cf0-a5f1-b9c1d999484a tempest-VolumesListTestJSON-1125216116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.360s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-4d2f48ae-3725-4cf0-a5f1-b9c1d999484a tempest-VolumesListTestJSON-1125216116 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:13:09 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-4d2f48ae-3725-4cf0-a5f1-b9c1d999484a tempest-VolumesListTestJSON-1125216116 None] Deleted volume successfully.
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ee606ab5-8156-4ada-8ed8-69b08222ae61 tempest-VolumesListTestJSON-1125216116 None] Lock "cinder-quobyte-114fb0ab-6527-4b47-ae27-00b81a92be59" acquired by "delete_volume" :: waited 0.027s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-4d2f48ae-3725-4cf0-a5f1-b9c1d999484a tempest-VolumesListTestJSON-1125216116 None] Lock "cinder-a088a258-7b93-413e-ac5a-5664f643d1d9-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfda914-92e2-47eb-a16d-ba7d6a841a03]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:13:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ee606ab5-8156-4ada-8ed8-69b08222ae61 tempest-VolumesListTestJSON-1125216116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-114fb0ab-6527-4b47-ae27-00b81a92be59 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:10 devstack sudo[96900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-114fb0ab-6527-4b47-ae27-00b81a92be59
Nov 06 17:13:10 devstack sudo[96900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:10 devstack sudo[96897]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c2c7ed10-44b6-4518-b850-3e23fa93bd1b tempest-VolumesTransfersV357Test-1137165598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c1ab07fa-28bb-4b56-8b84-fe66a279fdc4 1073741824" returned: 0 in 0.557s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:10 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=101,cinder:UPDATE=127,cinder:DELETE=14,cinder:INSERT=44 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:13:10 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=106,cinder:UPDATE=153,cinder:INSERT=31,cinder:DELETE=10 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:13:10 devstack sudo[96900]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ee606ab5-8156-4ada-8ed8-69b08222ae61 tempest-VolumesListTestJSON-1125216116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-114fb0ab-6527-4b47-ae27-00b81a92be59" returned: 0 in 0.471s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ee606ab5-8156-4ada-8ed8-69b08222ae61 tempest-VolumesListTestJSON-1125216116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-114fb0ab-6527-4b47-ae27-00b81a92be59 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c2c7ed10-44b6-4518-b850-3e23fa93bd1b tempest-VolumesTransfersV357Test-1137165598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c1ab07fa-28bb-4b56-8b84-fe66a279fdc4 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:10 devstack sudo[96910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-114fb0ab-6527-4b47-ae27-00b81a92be59
Nov 06 17:13:10 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:10 devstack sudo[96911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c1ab07fa-28bb-4b56-8b84-fe66a279fdc4
Nov 06 17:13:10 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:10 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c2c7ed10-44b6-4518-b850-3e23fa93bd1b tempest-VolumesTransfersV357Test-1137165598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c1ab07fa-28bb-4b56-8b84-fe66a279fdc4" returned: 0 in 0.328s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:10 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c2c7ed10-44b6-4518-b850-3e23fa93bd1b tempest-VolumesTransfersV357Test-1137165598 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:13:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c2c7ed10-44b6-4518-b850-3e23fa93bd1b tempest-VolumesTransfersV357Test-1137165598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c2c7ed10-44b6-4518-b850-3e23fa93bd1b tempest-VolumesTransfersV357Test-1137165598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5856fe7e-a5b2-4588-85e3-698d48a76a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1ab07fa-28bb-4b56-8b84-fe66a279fdc4', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c2c7ed10-44b6-4518-b850-3e23fa93bd1b tempest-VolumesTransfersV357Test-1137165598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3edf5b3-44b5-4c23-b17f-483def7cad1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:10 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-c2c7ed10-44b6-4518-b850-3e23fa93bd1b tempest-VolumesTransfersV357Test-1137165598 None] Volume volume-c1ab07fa-28bb-4b56-8b84-fe66a279fdc4 (c1ab07fa-28bb-4b56-8b84-fe66a279fdc4): created successfully
Nov 06 17:13:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c2c7ed10-44b6-4518-b850-3e23fa93bd1b tempest-VolumesTransfersV357Test-1137165598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3edf5b3-44b5-4c23-b17f-483def7cad1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c2c7ed10-44b6-4518-b850-3e23fa93bd1b tempest-VolumesTransfersV357Test-1137165598 None] Flow 'volume_create_manager' (e2538356-04b3-41ff-9a40-9e3f3f0d110a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:13:10 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-c2c7ed10-44b6-4518-b850-3e23fa93bd1b tempest-VolumesTransfersV357Test-1137165598 None] Created volume successfully.
Nov 06 17:13:10 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ee606ab5-8156-4ada-8ed8-69b08222ae61 tempest-VolumesListTestJSON-1125216116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-114fb0ab-6527-4b47-ae27-00b81a92be59" returned: 0 in 0.506s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:10 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ee606ab5-8156-4ada-8ed8-69b08222ae61 tempest-VolumesListTestJSON-1125216116 None] Lock "cinder-quobyte-114fb0ab-6527-4b47-ae27-00b81a92be59" released by "delete_volume" :: held 1.045s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:10 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-ee606ab5-8156-4ada-8ed8-69b08222ae61 tempest-VolumesListTestJSON-1125216116 None] Created reservations ['c17b90ba-b1f2-4a93-bc93-71edf138213f', '1fd6e957-dfbd-45e8-a7de-a6490a01fba0', '879c1e0f-6570-4264-97ae-1e99ad84a8db', 'dc8c138c-c065-4eac-9fe7-e547ba611a2c'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:13:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ee606ab5-8156-4ada-8ed8-69b08222ae61 tempest-VolumesListTestJSON-1125216116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ee606ab5-8156-4ada-8ed8-69b08222ae61 tempest-VolumesListTestJSON-1125216116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:11 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ee606ab5-8156-4ada-8ed8-69b08222ae61 tempest-VolumesListTestJSON-1125216116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:13:11 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ee606ab5-8156-4ada-8ed8-69b08222ae61 tempest-VolumesListTestJSON-1125216116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:13:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ee606ab5-8156-4ada-8ed8-69b08222ae61 tempest-VolumesListTestJSON-1125216116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ee606ab5-8156-4ada-8ed8-69b08222ae61 tempest-VolumesListTestJSON-1125216116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:11 devstack sudo[96916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:13:11 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:11 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ee606ab5-8156-4ada-8ed8-69b08222ae61 tempest-VolumesListTestJSON-1125216116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.261s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:11 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-ee606ab5-8156-4ada-8ed8-69b08222ae61 tempest-VolumesListTestJSON-1125216116 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:13:11 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-ee606ab5-8156-4ada-8ed8-69b08222ae61 tempest-VolumesListTestJSON-1125216116 None] Deleted volume successfully.
Nov 06 17:13:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ee606ab5-8156-4ada-8ed8-69b08222ae61 tempest-VolumesListTestJSON-1125216116 None] Lock "cinder-114fb0ab-6527-4b47-ae27-00b81a92be59-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:12 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-39be689d-1204-4360-884e-b93869da3a78 tempest-VolumesTransfersV357Test-81159551 None] Acquiring lock "cinder-c1ab07fa-28bb-4b56-8b84-fe66a279fdc4-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:12 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-39be689d-1204-4360-884e-b93869da3a78 tempest-VolumesTransfersV357Test-81159551 None] Lock "cinder-c1ab07fa-28bb-4b56-8b84-fe66a279fdc4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:12 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-39be689d-1204-4360-884e-b93869da3a78 tempest-VolumesTransfersV357Test-81159551 None] Acquiring lock "cinder-quobyte-c1ab07fa-28bb-4b56-8b84-fe66a279fdc4" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:12 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-39be689d-1204-4360-884e-b93869da3a78 tempest-VolumesTransfersV357Test-81159551 None] Lock "cinder-quobyte-c1ab07fa-28bb-4b56-8b84-fe66a279fdc4" acquired by "delete_volume" :: waited 0.030s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:12 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd636a47-4daf-42fa-b159-9706e15dbb6b]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:13:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-39be689d-1204-4360-884e-b93869da3a78 tempest-VolumesTransfersV357Test-81159551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c1ab07fa-28bb-4b56-8b84-fe66a279fdc4 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:12 devstack sudo[96920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c1ab07fa-28bb-4b56-8b84-fe66a279fdc4
Nov 06 17:13:12 devstack sudo[96920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:12 devstack sudo[96920]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-39be689d-1204-4360-884e-b93869da3a78 tempest-VolumesTransfersV357Test-81159551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c1ab07fa-28bb-4b56-8b84-fe66a279fdc4" returned: 0 in 0.568s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-39be689d-1204-4360-884e-b93869da3a78 tempest-VolumesTransfersV357Test-81159551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c1ab07fa-28bb-4b56-8b84-fe66a279fdc4 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:12 devstack sudo[96926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c1ab07fa-28bb-4b56-8b84-fe66a279fdc4
Nov 06 17:13:12 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:13 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-39be689d-1204-4360-884e-b93869da3a78 tempest-VolumesTransfersV357Test-81159551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c1ab07fa-28bb-4b56-8b84-fe66a279fdc4" returned: 0 in 0.319s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:13 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-39be689d-1204-4360-884e-b93869da3a78 tempest-VolumesTransfersV357Test-81159551 None] Lock "cinder-quobyte-c1ab07fa-28bb-4b56-8b84-fe66a279fdc4" released by "delete_volume" :: held 0.957s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:13 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-39be689d-1204-4360-884e-b93869da3a78 tempest-VolumesTransfersV357Test-81159551 None] Created reservations ['d6f2e045-6e43-45f8-93a4-6d4947a0ec12', '0a7a50ab-3dae-4bad-a58d-8b7e36846d13', '901d1ab0-e45a-4061-a8ec-70964fd9deef', '6bf93911-29ed-4b99-8b8f-a7b913d15a82'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:13:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-39be689d-1204-4360-884e-b93869da3a78 tempest-VolumesTransfersV357Test-81159551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-39be689d-1204-4360-884e-b93869da3a78 tempest-VolumesTransfersV357Test-81159551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:13 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-39be689d-1204-4360-884e-b93869da3a78 tempest-VolumesTransfersV357Test-81159551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:13:13 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-39be689d-1204-4360-884e-b93869da3a78 tempest-VolumesTransfersV357Test-81159551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:13:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-39be689d-1204-4360-884e-b93869da3a78 tempest-VolumesTransfersV357Test-81159551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-39be689d-1204-4360-884e-b93869da3a78 tempest-VolumesTransfersV357Test-81159551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:13 devstack sudo[96929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:13:13 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:13 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-39be689d-1204-4360-884e-b93869da3a78 tempest-VolumesTransfersV357Test-81159551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.333s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:13 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-39be689d-1204-4360-884e-b93869da3a78 tempest-VolumesTransfersV357Test-81159551 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:13:13 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-39be689d-1204-4360-884e-b93869da3a78 tempest-VolumesTransfersV357Test-81159551 None] Deleted volume successfully.
Nov 06 17:13:13 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-39be689d-1204-4360-884e-b93869da3a78 tempest-VolumesTransfersV357Test-81159551 None] Lock "cinder-c1ab07fa-28bb-4b56-8b84-fe66a279fdc4-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:17 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-4afb1532-ad7b-4f2b-bb8d-b543a02904ba tempest-VolumesSnapshotListTestJSON-1857191141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:13:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4afb1532-ad7b-4f2b-bb8d-b543a02904ba tempest-VolumesSnapshotListTestJSON-1857191141 None] Flow 'volume_create_manager' (af3744cc-6787-4841-ae94-91269f278caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:13:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4afb1532-ad7b-4f2b-bb8d-b543a02904ba tempest-VolumesSnapshotListTestJSON-1857191141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d72fe52c-cb88-4d67-87ab-bab23ce18678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4afb1532-ad7b-4f2b-bb8d-b543a02904ba tempest-VolumesSnapshotListTestJSON-1857191141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d72fe52c-cb88-4d67-87ab-bab23ce18678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1220261077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f56e11e-bac6-4444-b6cb-6d75b45db734,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f1db5bb045e4dea812451fe5556fc4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:13:17Z,use_quota=True,user_id='55b273ac54b94c30af6848289095f20c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4afb1532-ad7b-4f2b-bb8d-b543a02904ba tempest-VolumesSnapshotListTestJSON-1857191141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cef0a2a-c984-42d4-acc9-184b5f76e4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4afb1532-ad7b-4f2b-bb8d-b543a02904ba tempest-VolumesSnapshotListTestJSON-1857191141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cef0a2a-c984-42d4-acc9-184b5f76e4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4afb1532-ad7b-4f2b-bb8d-b543a02904ba tempest-VolumesSnapshotListTestJSON-1857191141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fabfdb6-13de-4487-8974-b473109f43d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4afb1532-ad7b-4f2b-bb8d-b543a02904ba tempest-VolumesSnapshotListTestJSON-1857191141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fabfdb6-13de-4487-8974-b473109f43d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f56e11e-bac6-4444-b6cb-6d75b45db734', 'volume_name': 'volume-0f56e11e-bac6-4444-b6cb-6d75b45db734', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4afb1532-ad7b-4f2b-bb8d-b543a02904ba tempest-VolumesSnapshotListTestJSON-1857191141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d8ac05a-f9a8-401b-beaa-fd94bdfcbf17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4afb1532-ad7b-4f2b-bb8d-b543a02904ba tempest-VolumesSnapshotListTestJSON-1857191141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d8ac05a-f9a8-401b-beaa-fd94bdfcbf17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4afb1532-ad7b-4f2b-bb8d-b543a02904ba tempest-VolumesSnapshotListTestJSON-1857191141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43f5a6c8-67c3-4e5d-ba7a-43832ea40d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:17 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-4afb1532-ad7b-4f2b-bb8d-b543a02904ba tempest-VolumesSnapshotListTestJSON-1857191141 None] Volume 0f56e11e-bac6-4444-b6cb-6d75b45db734: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f56e11e-bac6-4444-b6cb-6d75b45db734', 'volume_size': 1}
Nov 06 17:13:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4afb1532-ad7b-4f2b-bb8d-b543a02904ba tempest-VolumesSnapshotListTestJSON-1857191141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4afb1532-ad7b-4f2b-bb8d-b543a02904ba tempest-VolumesSnapshotListTestJSON-1857191141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:17 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4afb1532-ad7b-4f2b-bb8d-b543a02904ba tempest-VolumesSnapshotListTestJSON-1857191141 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1220261077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f56e11e-bac6-4444-b6cb-6d75b45db734,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f1db5bb045e4dea812451fe5556fc4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:13:17Z,use_quota=True,user_id='55b273ac54b94c30af6848289095f20c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:13:17 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-4afb1532-ad7b-4f2b-bb8d-b543a02904ba tempest-VolumesSnapshotListTestJSON-1857191141 None] Creating volume 0f56e11e-bac6-4444-b6cb-6d75b45db734 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:13:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4afb1532-ad7b-4f2b-bb8d-b543a02904ba tempest-VolumesSnapshotListTestJSON-1857191141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4afb1532-ad7b-4f2b-bb8d-b543a02904ba tempest-VolumesSnapshotListTestJSON-1857191141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:17 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4afb1532-ad7b-4f2b-bb8d-b543a02904ba tempest-VolumesSnapshotListTestJSON-1857191141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:13:17 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4afb1532-ad7b-4f2b-bb8d-b543a02904ba tempest-VolumesSnapshotListTestJSON-1857191141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:13:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4afb1532-ad7b-4f2b-bb8d-b543a02904ba tempest-VolumesSnapshotListTestJSON-1857191141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:17 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4afb1532-ad7b-4f2b-bb8d-b543a02904ba tempest-VolumesSnapshotListTestJSON-1857191141 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:13:17 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-4afb1532-ad7b-4f2b-bb8d-b543a02904ba tempest-VolumesSnapshotListTestJSON-1857191141 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:13:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4afb1532-ad7b-4f2b-bb8d-b543a02904ba tempest-VolumesSnapshotListTestJSON-1857191141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:17 devstack sudo[96934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734 1073741824
Nov 06 17:13:17 devstack sudo[96934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:18 devstack sudo[96934]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4afb1532-ad7b-4f2b-bb8d-b543a02904ba tempest-VolumesSnapshotListTestJSON-1857191141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734 1073741824" returned: 0 in 0.674s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4afb1532-ad7b-4f2b-bb8d-b543a02904ba tempest-VolumesSnapshotListTestJSON-1857191141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:18 devstack sudo[96940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734
Nov 06 17:13:18 devstack sudo[96940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:18 devstack sudo[96940]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4afb1532-ad7b-4f2b-bb8d-b543a02904ba tempest-VolumesSnapshotListTestJSON-1857191141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734" returned: 0 in 0.438s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:18 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4afb1532-ad7b-4f2b-bb8d-b543a02904ba tempest-VolumesSnapshotListTestJSON-1857191141 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:13:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4afb1532-ad7b-4f2b-bb8d-b543a02904ba tempest-VolumesSnapshotListTestJSON-1857191141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:18 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4afb1532-ad7b-4f2b-bb8d-b543a02904ba tempest-VolumesSnapshotListTestJSON-1857191141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43f5a6c8-67c3-4e5d-ba7a-43832ea40d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f56e11e-bac6-4444-b6cb-6d75b45db734', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:18 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4afb1532-ad7b-4f2b-bb8d-b543a02904ba tempest-VolumesSnapshotListTestJSON-1857191141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b512a01-4dd8-480c-8b76-aa10eeb2805b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:18 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-4afb1532-ad7b-4f2b-bb8d-b543a02904ba tempest-VolumesSnapshotListTestJSON-1857191141 None] Volume volume-0f56e11e-bac6-4444-b6cb-6d75b45db734 (0f56e11e-bac6-4444-b6cb-6d75b45db734): created successfully
Nov 06 17:13:18 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4afb1532-ad7b-4f2b-bb8d-b543a02904ba tempest-VolumesSnapshotListTestJSON-1857191141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b512a01-4dd8-480c-8b76-aa10eeb2805b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:18 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4afb1532-ad7b-4f2b-bb8d-b543a02904ba tempest-VolumesSnapshotListTestJSON-1857191141 None] Flow 'volume_create_manager' (af3744cc-6787-4841-ae94-91269f278caf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:13:18 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-4afb1532-ad7b-4f2b-bb8d-b543a02904ba tempest-VolumesSnapshotListTestJSON-1857191141 None] Created volume successfully.
Nov 06 17:13:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a5a4d16c-863f-43c8-af97-b73fd801fef6 tempest-VolumesSnapshotListTestJSON-1857191141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a5a4d16c-863f-43c8-af97-b73fd801fef6 tempest-VolumesSnapshotListTestJSON-1857191141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:20 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-a5a4d16c-863f-43c8-af97-b73fd801fef6 tempest-VolumesSnapshotListTestJSON-1857191141 None] Creating offline snapshot bd997963-e12f-441f-99fa-e2719d9de6e2 of volume 0f56e11e-bac6-4444-b6cb-6d75b45db734 {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:13:20 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebc891b-4672-48f7-9fc6-bac8c23998a7]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:13:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a5a4d16c-863f-43c8-af97-b73fd801fef6 tempest-VolumesSnapshotListTestJSON-1857191141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:20 devstack sudo[96943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734
Nov 06 17:13:20 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:20 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d052dc57-a374-4016-9a7a-830f1e6d781f tempest-VolumesNegativeTest-1737180247 None] Acquiring lock "cinder-0dbb8a78-91ad-4056-afb6-db76b6e3b482-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:20 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a5a4d16c-863f-43c8-af97-b73fd801fef6 tempest-VolumesSnapshotListTestJSON-1857191141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734" returned: 0 in 0.599s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a5a4d16c-863f-43c8-af97-b73fd801fef6 tempest-VolumesSnapshotListTestJSON-1857191141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.bd997963-e12f-441f-99fa-e2719d9de6e2 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:20 devstack sudo[96948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.bd997963-e12f-441f-99fa-e2719d9de6e2 1G
Nov 06 17:13:20 devstack sudo[96948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:20 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d052dc57-a374-4016-9a7a-830f1e6d781f tempest-VolumesNegativeTest-1737180247 None] Lock "cinder-0dbb8a78-91ad-4056-afb6-db76b6e3b482-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:20 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-82d5843f-4659-4117-a542-16558eb51374 tempest-VolumesSnapshotTestJSON-349969979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:13:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-82d5843f-4659-4117-a542-16558eb51374 tempest-VolumesSnapshotTestJSON-349969979 None] Flow 'volume_create_manager' (7a059a55-2b6a-4a0c-8373-34ce9021e1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:13:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-82d5843f-4659-4117-a542-16558eb51374 tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c3cb656-ce5f-45b4-ab61-6bb656278182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-82d5843f-4659-4117-a542-16558eb51374 tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c3cb656-ce5f-45b4-ab61-6bb656278182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-245385457',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01361e88-13cd-4903-a59e-4ca0cd5c8f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d8e6498df64229af85d96b1e8116f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:13:21Z,use_quota=True,user_id='f9e67809a7954e01a5321acb51af70fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-82d5843f-4659-4117-a542-16558eb51374 tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1afbc02-1879-4e00-9cce-a06e68d46772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-82d5843f-4659-4117-a542-16558eb51374 tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1afbc02-1879-4e00-9cce-a06e68d46772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-82d5843f-4659-4117-a542-16558eb51374 tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff4ee32-c5b9-4714-a0ea-fc6ac803f8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-82d5843f-4659-4117-a542-16558eb51374 tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff4ee32-c5b9-4714-a0ea-fc6ac803f8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01361e88-13cd-4903-a59e-4ca0cd5c8f85', 'volume_name': 'volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-82d5843f-4659-4117-a542-16558eb51374 tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d2cd5c8-9f39-443b-8524-41d39db35333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-82d5843f-4659-4117-a542-16558eb51374 tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d2cd5c8-9f39-443b-8524-41d39db35333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-82d5843f-4659-4117-a542-16558eb51374 tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a33d86e2-cf4f-41b9-81e8-037f2119d742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:20 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-82d5843f-4659-4117-a542-16558eb51374 tempest-VolumesSnapshotTestJSON-349969979 None] Volume 01361e88-13cd-4903-a59e-4ca0cd5c8f85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85', 'volume_size': 1}
Nov 06 17:13:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-82d5843f-4659-4117-a542-16558eb51374 tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:20 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d052dc57-a374-4016-9a7a-830f1e6d781f tempest-VolumesNegativeTest-1737180247 None] Acquiring lock "cinder-quobyte-0dbb8a78-91ad-4056-afb6-db76b6e3b482" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:20 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d052dc57-a374-4016-9a7a-830f1e6d781f tempest-VolumesNegativeTest-1737180247 None] Lock "cinder-quobyte-0dbb8a78-91ad-4056-afb6-db76b6e3b482" acquired by "delete_volume" :: waited 0.026s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:20 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74293fb-aa05-48fc-8657-18275bad3a6f]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:13:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d052dc57-a374-4016-9a7a-830f1e6d781f tempest-VolumesNegativeTest-1737180247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0dbb8a78-91ad-4056-afb6-db76b6e3b482 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:21 devstack sudo[96950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0dbb8a78-91ad-4056-afb6-db76b6e3b482
Nov 06 17:13:21 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:21 devstack sudo[96948]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a5a4d16c-863f-43c8-af97-b73fd801fef6 tempest-VolumesSnapshotListTestJSON-1857191141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.bd997963-e12f-441f-99fa-e2719d9de6e2 1G" returned: 0 in 0.514s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a5a4d16c-863f-43c8-af97-b73fd801fef6 tempest-VolumesSnapshotListTestJSON-1857191141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f56e11e-bac6-4444-b6cb-6d75b45db734 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.bd997963-e12f-441f-99fa-e2719d9de6e2 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:21 devstack sudo[96957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f56e11e-bac6-4444-b6cb-6d75b45db734 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.bd997963-e12f-441f-99fa-e2719d9de6e2
Nov 06 17:13:21 devstack sudo[96957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:21 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d052dc57-a374-4016-9a7a-830f1e6d781f tempest-VolumesNegativeTest-1737180247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0dbb8a78-91ad-4056-afb6-db76b6e3b482" returned: 0 in 0.482s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d052dc57-a374-4016-9a7a-830f1e6d781f tempest-VolumesNegativeTest-1737180247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0dbb8a78-91ad-4056-afb6-db76b6e3b482 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:21 devstack sudo[96962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0dbb8a78-91ad-4056-afb6-db76b6e3b482
Nov 06 17:13:21 devstack sudo[96962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:21 devstack sudo[96957]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a5a4d16c-863f-43c8-af97-b73fd801fef6 tempest-VolumesSnapshotListTestJSON-1857191141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f56e11e-bac6-4444-b6cb-6d75b45db734 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.bd997963-e12f-441f-99fa-e2719d9de6e2" returned: 0 in 0.424s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:21 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-a5a4d16c-863f-43c8-af97-b73fd801fef6 tempest-VolumesSnapshotListTestJSON-1857191141 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.bd997963-e12f-441f-99fa-e2719d9de6e2 is being set with open permissions: ugo+rw
Nov 06 17:13:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a5a4d16c-863f-43c8-af97-b73fd801fef6 tempest-VolumesSnapshotListTestJSON-1857191141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.bd997963-e12f-441f-99fa-e2719d9de6e2 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:21 devstack sudo[96968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.bd997963-e12f-441f-99fa-e2719d9de6e2
Nov 06 17:13:21 devstack sudo[96968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:21 devstack sudo[96962]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d052dc57-a374-4016-9a7a-830f1e6d781f tempest-VolumesNegativeTest-1737180247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0dbb8a78-91ad-4056-afb6-db76b6e3b482" returned: 0 in 0.307s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:21 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d052dc57-a374-4016-9a7a-830f1e6d781f tempest-VolumesNegativeTest-1737180247 None] Lock "cinder-quobyte-0dbb8a78-91ad-4056-afb6-db76b6e3b482" released by "delete_volume" :: held 0.837s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:21 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-d052dc57-a374-4016-9a7a-830f1e6d781f tempest-VolumesNegativeTest-1737180247 None] Created reservations ['341545b0-1b0f-417c-985b-b4181ef2ed52', 'e9cd010c-d456-4256-bec8-2318dd28e940', 'dfefe3a0-e74a-4811-8804-41788c20fea2', 'cbeb53d7-aede-4de1-895b-97a87aff952f'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:13:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d052dc57-a374-4016-9a7a-830f1e6d781f tempest-VolumesNegativeTest-1737180247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d052dc57-a374-4016-9a7a-830f1e6d781f tempest-VolumesNegativeTest-1737180247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:21 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d052dc57-a374-4016-9a7a-830f1e6d781f tempest-VolumesNegativeTest-1737180247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:13:21 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d052dc57-a374-4016-9a7a-830f1e6d781f tempest-VolumesNegativeTest-1737180247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:13:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d052dc57-a374-4016-9a7a-830f1e6d781f tempest-VolumesNegativeTest-1737180247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d052dc57-a374-4016-9a7a-830f1e6d781f tempest-VolumesNegativeTest-1737180247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:21 devstack sudo[96972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:13:21 devstack sudo[96972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:21 devstack sudo[96968]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a5a4d16c-863f-43c8-af97-b73fd801fef6 tempest-VolumesSnapshotListTestJSON-1857191141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.bd997963-e12f-441f-99fa-e2719d9de6e2" returned: 0 in 0.295s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a5a4d16c-863f-43c8-af97-b73fd801fef6 tempest-VolumesSnapshotListTestJSON-1857191141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:22 devstack sudo[96974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.info
Nov 06 17:13:22 devstack sudo[96974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:22 devstack sudo[96972]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d052dc57-a374-4016-9a7a-830f1e6d781f tempest-VolumesNegativeTest-1737180247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.293s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:22 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-d052dc57-a374-4016-9a7a-830f1e6d781f tempest-VolumesNegativeTest-1737180247 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:13:22 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-d052dc57-a374-4016-9a7a-830f1e6d781f tempest-VolumesNegativeTest-1737180247 None] Deleted volume successfully.
Nov 06 17:13:22 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d052dc57-a374-4016-9a7a-830f1e6d781f tempest-VolumesNegativeTest-1737180247 None] Lock "cinder-0dbb8a78-91ad-4056-afb6-db76b6e3b482-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:22 devstack sudo[96974]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a5a4d16c-863f-43c8-af97-b73fd801fef6 tempest-VolumesSnapshotListTestJSON-1857191141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.info" returned: 0 in 0.280s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:22 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-a5a4d16c-863f-43c8-af97-b73fd801fef6 tempest-VolumesSnapshotListTestJSON-1857191141 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.info is being set with open permissions: ugo+rw
Nov 06 17:13:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a5a4d16c-863f-43c8-af97-b73fd801fef6 tempest-VolumesSnapshotListTestJSON-1857191141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:22 devstack sudo[96978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.info
Nov 06 17:13:22 devstack sudo[96978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:22 devstack sudo[96978]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a5a4d16c-863f-43c8-af97-b73fd801fef6 tempest-VolumesSnapshotListTestJSON-1857191141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.info" returned: 0 in 0.251s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a5a4d16c-863f-43c8-af97-b73fd801fef6 tempest-VolumesSnapshotListTestJSON-1857191141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.486s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-82d5843f-4659-4117-a542-16558eb51374 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.659s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:22 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-82d5843f-4659-4117-a542-16558eb51374 tempest-VolumesSnapshotTestJSON-349969979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-245385457',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01361e88-13cd-4903-a59e-4ca0cd5c8f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d8e6498df64229af85d96b1e8116f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:13:21Z,use_quota=True,user_id='f9e67809a7954e01a5321acb51af70fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:13:22 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-82d5843f-4659-4117-a542-16558eb51374 tempest-VolumesSnapshotTestJSON-349969979 None] Creating volume 01361e88-13cd-4903-a59e-4ca0cd5c8f85 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:13:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-82d5843f-4659-4117-a542-16558eb51374 tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-82d5843f-4659-4117-a542-16558eb51374 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:22 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-82d5843f-4659-4117-a542-16558eb51374 tempest-VolumesSnapshotTestJSON-349969979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:13:22 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-82d5843f-4659-4117-a542-16558eb51374 tempest-VolumesSnapshotTestJSON-349969979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:13:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-82d5843f-4659-4117-a542-16558eb51374 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:22 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-82d5843f-4659-4117-a542-16558eb51374 tempest-VolumesSnapshotTestJSON-349969979 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:13:22 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-82d5843f-4659-4117-a542-16558eb51374 tempest-VolumesSnapshotTestJSON-349969979 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:13:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-82d5843f-4659-4117-a542-16558eb51374 tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:22 devstack sudo[96981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85 1073741824
Nov 06 17:13:22 devstack sudo[96981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:22 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-a5a4d16c-863f-43c8-af97-b73fd801fef6 tempest-VolumesSnapshotListTestJSON-1857191141 None] Create snapshot completed successfully
Nov 06 17:13:23 devstack sudo[96981]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-82d5843f-4659-4117-a542-16558eb51374 tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85 1073741824" returned: 0 in 0.476s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-82d5843f-4659-4117-a542-16558eb51374 tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:23 devstack sudo[96987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85
Nov 06 17:13:23 devstack sudo[96987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:23 devstack sudo[96987]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-82d5843f-4659-4117-a542-16558eb51374 tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85" returned: 0 in 0.299s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:23 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-82d5843f-4659-4117-a542-16558eb51374 tempest-VolumesSnapshotTestJSON-349969979 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:13:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-82d5843f-4659-4117-a542-16558eb51374 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:23 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-82d5843f-4659-4117-a542-16558eb51374 tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a33d86e2-cf4f-41b9-81e8-037f2119d742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:23 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-82d5843f-4659-4117-a542-16558eb51374 tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c1e0d15-f4f8-4d75-9ee0-459f36e7c3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:23 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-82d5843f-4659-4117-a542-16558eb51374 tempest-VolumesSnapshotTestJSON-349969979 None] Volume volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85 (01361e88-13cd-4903-a59e-4ca0cd5c8f85): created successfully
Nov 06 17:13:23 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-82d5843f-4659-4117-a542-16558eb51374 tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c1e0d15-f4f8-4d75-9ee0-459f36e7c3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:23 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-82d5843f-4659-4117-a542-16558eb51374 tempest-VolumesSnapshotTestJSON-349969979 None] Flow 'volume_create_manager' (7a059a55-2b6a-4a0c-8373-34ce9021e1f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:13:23 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-82d5843f-4659-4117-a542-16558eb51374 tempest-VolumesSnapshotTestJSON-349969979 None] Created volume successfully.
Nov 06 17:13:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-8bc573a9-048a-4f7b-87d4-1bbbfbe7760b tempest-VolumesSnapshotListTestJSON-1857191141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-8bc573a9-048a-4f7b-87d4-1bbbfbe7760b tempest-VolumesSnapshotListTestJSON-1857191141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:23 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-8bc573a9-048a-4f7b-87d4-1bbbfbe7760b tempest-VolumesSnapshotListTestJSON-1857191141 None] Creating offline snapshot fe9b8848-8eb6-4607-8f72-0314536ed5b6 of volume 0f56e11e-bac6-4444-b6cb-6d75b45db734 {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:13:23 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0c725f-f6b1-46ec-99c4-33f7cefce7cf]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:13:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8bc573a9-048a-4f7b-87d4-1bbbfbe7760b tempest-VolumesSnapshotListTestJSON-1857191141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.bd997963-e12f-441f-99fa-e2719d9de6e2 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:23 devstack sudo[96990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.bd997963-e12f-441f-99fa-e2719d9de6e2
Nov 06 17:13:23 devstack sudo[96990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:24 devstack sudo[96990]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8bc573a9-048a-4f7b-87d4-1bbbfbe7760b tempest-VolumesSnapshotListTestJSON-1857191141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.bd997963-e12f-441f-99fa-e2719d9de6e2" returned: 0 in 0.450s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:24 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-8bc573a9-048a-4f7b-87d4-1bbbfbe7760b tempest-VolumesSnapshotListTestJSON-1857191141 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f56e11e-bac6-4444-b6cb-6d75b45db734(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:13:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8bc573a9-048a-4f7b-87d4-1bbbfbe7760b tempest-VolumesSnapshotListTestJSON-1857191141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.bd997963-e12f-441f-99fa-e2719d9de6e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.fe9b8848-8eb6-4607-8f72-0314536ed5b6 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:24 devstack sudo[96996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.bd997963-e12f-441f-99fa-e2719d9de6e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.fe9b8848-8eb6-4607-8f72-0314536ed5b6 1G
Nov 06 17:13:24 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:24 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-10c1a7b4-f3cb-46a6-b4ad-71cde1987744 tempest-VolumesCloneNegativeTest-2012542469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:13:24 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-10c1a7b4-f3cb-46a6-b4ad-71cde1987744 tempest-VolumesCloneNegativeTest-2012542469 None] Flow 'volume_create_manager' (b26fc90f-c7a0-47e9-8bd1-8471f160dc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:13:24 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-10c1a7b4-f3cb-46a6-b4ad-71cde1987744 tempest-VolumesCloneNegativeTest-2012542469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec611676-fe64-4380-a289-af5d078024d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:24 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-10c1a7b4-f3cb-46a6-b4ad-71cde1987744 tempest-VolumesCloneNegativeTest-2012542469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec611676-fe64-4380-a289-af5d078024d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-964997989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adb213cd-dd6d-41c3-88f2-bef3ddf23ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd5df02c7acf439785cd3b62e67b2fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:13:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:13:24Z,use_quota=True,user_id='b0e179a36296492e9bd2cd5324479acb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:24 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-10c1a7b4-f3cb-46a6-b4ad-71cde1987744 tempest-VolumesCloneNegativeTest-2012542469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c727b066-debe-434d-8f81-7f98cc1e255a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:24 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-10c1a7b4-f3cb-46a6-b4ad-71cde1987744 tempest-VolumesCloneNegativeTest-2012542469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c727b066-debe-434d-8f81-7f98cc1e255a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:24 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-10c1a7b4-f3cb-46a6-b4ad-71cde1987744 tempest-VolumesCloneNegativeTest-2012542469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b900cd78-5d6f-4aa9-a20b-79977673a4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:24 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-10c1a7b4-f3cb-46a6-b4ad-71cde1987744 tempest-VolumesCloneNegativeTest-2012542469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b900cd78-5d6f-4aa9-a20b-79977673a4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adb213cd-dd6d-41c3-88f2-bef3ddf23ce3', 'volume_name': 'volume-adb213cd-dd6d-41c3-88f2-bef3ddf23ce3', 'volume_size': 2}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:24 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-10c1a7b4-f3cb-46a6-b4ad-71cde1987744 tempest-VolumesCloneNegativeTest-2012542469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (847c90b2-57a6-4044-97d5-865bcb11fe20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:24 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-10c1a7b4-f3cb-46a6-b4ad-71cde1987744 tempest-VolumesCloneNegativeTest-2012542469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (847c90b2-57a6-4044-97d5-865bcb11fe20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:24 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-10c1a7b4-f3cb-46a6-b4ad-71cde1987744 tempest-VolumesCloneNegativeTest-2012542469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9510c48-cb55-47de-958b-23a9f657fc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:24 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-10c1a7b4-f3cb-46a6-b4ad-71cde1987744 tempest-VolumesCloneNegativeTest-2012542469 None] Volume adb213cd-dd6d-41c3-88f2-bef3ddf23ce3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adb213cd-dd6d-41c3-88f2-bef3ddf23ce3', 'volume_size': 2}
Nov 06 17:13:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-10c1a7b4-f3cb-46a6-b4ad-71cde1987744 tempest-VolumesCloneNegativeTest-2012542469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4b0b9451-6f37-4d3f-861f-3a68540564b4 tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:24 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8bc573a9-048a-4f7b-87d4-1bbbfbe7760b tempest-VolumesSnapshotListTestJSON-1857191141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.bd997963-e12f-441f-99fa-e2719d9de6e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.fe9b8848-8eb6-4607-8f72-0314536ed5b6 1G" returned: 0 in 0.646s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8bc573a9-048a-4f7b-87d4-1bbbfbe7760b tempest-VolumesSnapshotListTestJSON-1857191141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.bd997963-e12f-441f-99fa-e2719d9de6e2 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.fe9b8848-8eb6-4607-8f72-0314536ed5b6 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:24 devstack sudo[97002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.bd997963-e12f-441f-99fa-e2719d9de6e2 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.fe9b8848-8eb6-4607-8f72-0314536ed5b6
Nov 06 17:13:24 devstack sudo[97002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:24 devstack sudo[97002]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8bc573a9-048a-4f7b-87d4-1bbbfbe7760b tempest-VolumesSnapshotListTestJSON-1857191141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.bd997963-e12f-441f-99fa-e2719d9de6e2 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.fe9b8848-8eb6-4607-8f72-0314536ed5b6" returned: 0 in 0.302s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:24 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-8bc573a9-048a-4f7b-87d4-1bbbfbe7760b tempest-VolumesSnapshotListTestJSON-1857191141 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.fe9b8848-8eb6-4607-8f72-0314536ed5b6 is being set with open permissions: ugo+rw
Nov 06 17:13:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8bc573a9-048a-4f7b-87d4-1bbbfbe7760b tempest-VolumesSnapshotListTestJSON-1857191141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.fe9b8848-8eb6-4607-8f72-0314536ed5b6 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:25 devstack sudo[97007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.fe9b8848-8eb6-4607-8f72-0314536ed5b6
Nov 06 17:13:25 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:25 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8bc573a9-048a-4f7b-87d4-1bbbfbe7760b tempest-VolumesSnapshotListTestJSON-1857191141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.fe9b8848-8eb6-4607-8f72-0314536ed5b6" returned: 0 in 0.256s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-8bc573a9-048a-4f7b-87d4-1bbbfbe7760b tempest-VolumesSnapshotListTestJSON-1857191141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.780s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-10c1a7b4-f3cb-46a6-b4ad-71cde1987744 tempest-VolumesCloneNegativeTest-2012542469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.787s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:25 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-10c1a7b4-f3cb-46a6-b4ad-71cde1987744 tempest-VolumesCloneNegativeTest-2012542469 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-964997989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adb213cd-dd6d-41c3-88f2-bef3ddf23ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd5df02c7acf439785cd3b62e67b2fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:13:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:13:24Z,use_quota=True,user_id='b0e179a36296492e9bd2cd5324479acb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:13:25 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-10c1a7b4-f3cb-46a6-b4ad-71cde1987744 tempest-VolumesCloneNegativeTest-2012542469 None] Creating volume adb213cd-dd6d-41c3-88f2-bef3ddf23ce3 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:13:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-10c1a7b4-f3cb-46a6-b4ad-71cde1987744 tempest-VolumesCloneNegativeTest-2012542469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-10c1a7b4-f3cb-46a6-b4ad-71cde1987744 tempest-VolumesCloneNegativeTest-2012542469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:25 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-10c1a7b4-f3cb-46a6-b4ad-71cde1987744 tempest-VolumesCloneNegativeTest-2012542469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:13:25 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-10c1a7b4-f3cb-46a6-b4ad-71cde1987744 tempest-VolumesCloneNegativeTest-2012542469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:13:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-10c1a7b4-f3cb-46a6-b4ad-71cde1987744 tempest-VolumesCloneNegativeTest-2012542469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:25 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-10c1a7b4-f3cb-46a6-b4ad-71cde1987744 tempest-VolumesCloneNegativeTest-2012542469 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:13:25 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-10c1a7b4-f3cb-46a6-b4ad-71cde1987744 tempest-VolumesCloneNegativeTest-2012542469 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:13:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-10c1a7b4-f3cb-46a6-b4ad-71cde1987744 tempest-VolumesCloneNegativeTest-2012542469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-adb213cd-dd6d-41c3-88f2-bef3ddf23ce3 2147483648 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:25 devstack sudo[97010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-adb213cd-dd6d-41c3-88f2-bef3ddf23ce3 2147483648
Nov 06 17:13:25 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:25 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-8bc573a9-048a-4f7b-87d4-1bbbfbe7760b tempest-VolumesSnapshotListTestJSON-1857191141 None] Create snapshot completed successfully
Nov 06 17:13:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-413361d3-b77a-43fe-96f3-3249a032af80 tempest-VolumesSnapshotListTestJSON-1857191141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:25 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-10c1a7b4-f3cb-46a6-b4ad-71cde1987744 tempest-VolumesCloneNegativeTest-2012542469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-adb213cd-dd6d-41c3-88f2-bef3ddf23ce3 2147483648" returned: 0 in 0.627s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-10c1a7b4-f3cb-46a6-b4ad-71cde1987744 tempest-VolumesCloneNegativeTest-2012542469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-adb213cd-dd6d-41c3-88f2-bef3ddf23ce3 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:25 devstack sudo[97016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-adb213cd-dd6d-41c3-88f2-bef3ddf23ce3
Nov 06 17:13:25 devstack sudo[97016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:26 devstack sudo[97016]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-10c1a7b4-f3cb-46a6-b4ad-71cde1987744 tempest-VolumesCloneNegativeTest-2012542469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-adb213cd-dd6d-41c3-88f2-bef3ddf23ce3" returned: 0 in 0.256s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:26 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-10c1a7b4-f3cb-46a6-b4ad-71cde1987744 tempest-VolumesCloneNegativeTest-2012542469 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:13:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-10c1a7b4-f3cb-46a6-b4ad-71cde1987744 tempest-VolumesCloneNegativeTest-2012542469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4b0b9451-6f37-4d3f-861f-3a68540564b4 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.628s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:26 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-10c1a7b4-f3cb-46a6-b4ad-71cde1987744 tempest-VolumesCloneNegativeTest-2012542469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9510c48-cb55-47de-958b-23a9f657fc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adb213cd-dd6d-41c3-88f2-bef3ddf23ce3', 'volume_size': 2}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:26 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-10c1a7b4-f3cb-46a6-b4ad-71cde1987744 tempest-VolumesCloneNegativeTest-2012542469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c883d8-cae6-4b3e-b01c-56f48b981aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:26 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-4b0b9451-6f37-4d3f-861f-3a68540564b4 tempest-VolumesSnapshotTestJSON-349969979 None] Creating offline snapshot fa4638ac-0875-4b90-aa12-9197d247900c of volume 01361e88-13cd-4903-a59e-4ca0cd5c8f85 {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:13:26 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-10c1a7b4-f3cb-46a6-b4ad-71cde1987744 tempest-VolumesCloneNegativeTest-2012542469 None] Volume volume-adb213cd-dd6d-41c3-88f2-bef3ddf23ce3 (adb213cd-dd6d-41c3-88f2-bef3ddf23ce3): created successfully
Nov 06 17:13:26 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-10c1a7b4-f3cb-46a6-b4ad-71cde1987744 tempest-VolumesCloneNegativeTest-2012542469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c883d8-cae6-4b3e-b01c-56f48b981aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:26 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-10c1a7b4-f3cb-46a6-b4ad-71cde1987744 tempest-VolumesCloneNegativeTest-2012542469 None] Flow 'volume_create_manager' (b26fc90f-c7a0-47e9-8bd1-8471f160dc57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:13:26 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ccd21f-07de-4b95-b261-bd2e1004bd97]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:13:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4b0b9451-6f37-4d3f-861f-3a68540564b4 tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:26 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-10c1a7b4-f3cb-46a6-b4ad-71cde1987744 tempest-VolumesCloneNegativeTest-2012542469 None] Created volume successfully.
Nov 06 17:13:26 devstack sudo[97019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85
Nov 06 17:13:26 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:26 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4b0b9451-6f37-4d3f-861f-3a68540564b4 tempest-VolumesSnapshotTestJSON-349969979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85" returned: 0 in 0.444s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4b0b9451-6f37-4d3f-861f-3a68540564b4 tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85.fa4638ac-0875-4b90-aa12-9197d247900c 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:26 devstack sudo[97024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85.fa4638ac-0875-4b90-aa12-9197d247900c 1G
Nov 06 17:13:26 devstack sudo[97024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:27 devstack sudo[97024]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4b0b9451-6f37-4d3f-861f-3a68540564b4 tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85.fa4638ac-0875-4b90-aa12-9197d247900c 1G" returned: 0 in 0.443s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4b0b9451-6f37-4d3f-861f-3a68540564b4 tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85.fa4638ac-0875-4b90-aa12-9197d247900c {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:27 devstack sudo[97031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85.fa4638ac-0875-4b90-aa12-9197d247900c
Nov 06 17:13:27 devstack sudo[97031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:27 devstack sudo[97031]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4b0b9451-6f37-4d3f-861f-3a68540564b4 tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85.fa4638ac-0875-4b90-aa12-9197d247900c" returned: 0 in 0.337s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:27 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-4b0b9451-6f37-4d3f-861f-3a68540564b4 tempest-VolumesSnapshotTestJSON-349969979 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85.fa4638ac-0875-4b90-aa12-9197d247900c is being set with open permissions: ugo+rw
Nov 06 17:13:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4b0b9451-6f37-4d3f-861f-3a68540564b4 tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85.fa4638ac-0875-4b90-aa12-9197d247900c {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:27 devstack sudo[97036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85.fa4638ac-0875-4b90-aa12-9197d247900c
Nov 06 17:13:27 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:27 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-aced703f-ea47-45e3-8a51-146bae6344bd tempest-VolumesCloneNegativeTest-2012542469 None] Acquiring lock "cinder-adb213cd-dd6d-41c3-88f2-bef3ddf23ce3-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:27 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-aced703f-ea47-45e3-8a51-146bae6344bd tempest-VolumesCloneNegativeTest-2012542469 None] Lock "cinder-adb213cd-dd6d-41c3-88f2-bef3ddf23ce3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:27 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-aced703f-ea47-45e3-8a51-146bae6344bd tempest-VolumesCloneNegativeTest-2012542469 None] Acquiring lock "cinder-quobyte-adb213cd-dd6d-41c3-88f2-bef3ddf23ce3" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:27 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-aced703f-ea47-45e3-8a51-146bae6344bd tempest-VolumesCloneNegativeTest-2012542469 None] Lock "cinder-quobyte-adb213cd-dd6d-41c3-88f2-bef3ddf23ce3" acquired by "delete_volume" :: waited 0.020s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:27 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[7098ad92-0b52-445b-9268-c9811d67d056]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:13:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-aced703f-ea47-45e3-8a51-146bae6344bd tempest-VolumesCloneNegativeTest-2012542469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-adb213cd-dd6d-41c3-88f2-bef3ddf23ce3 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:27 devstack sudo[97038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-adb213cd-dd6d-41c3-88f2-bef3ddf23ce3
Nov 06 17:13:27 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:27 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4b0b9451-6f37-4d3f-861f-3a68540564b4 tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85.fa4638ac-0875-4b90-aa12-9197d247900c" returned: 0 in 0.338s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4b0b9451-6f37-4d3f-861f-3a68540564b4 tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:27 devstack sudo[97041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85.info
Nov 06 17:13:27 devstack sudo[97041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:28 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-aced703f-ea47-45e3-8a51-146bae6344bd tempest-VolumesCloneNegativeTest-2012542469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-adb213cd-dd6d-41c3-88f2-bef3ddf23ce3" returned: 0 in 0.424s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-aced703f-ea47-45e3-8a51-146bae6344bd tempest-VolumesCloneNegativeTest-2012542469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-adb213cd-dd6d-41c3-88f2-bef3ddf23ce3 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:28 devstack sudo[97047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-adb213cd-dd6d-41c3-88f2-bef3ddf23ce3
Nov 06 17:13:28 devstack sudo[97047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:28 devstack sudo[97041]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4b0b9451-6f37-4d3f-861f-3a68540564b4 tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85.info" returned: 0 in 0.310s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:28 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-4b0b9451-6f37-4d3f-861f-3a68540564b4 tempest-VolumesSnapshotTestJSON-349969979 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85.info is being set with open permissions: ugo+rw
Nov 06 17:13:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4b0b9451-6f37-4d3f-861f-3a68540564b4 tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:28 devstack sudo[97049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85.info
Nov 06 17:13:28 devstack sudo[97049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:28 devstack sudo[97047]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-aced703f-ea47-45e3-8a51-146bae6344bd tempest-VolumesCloneNegativeTest-2012542469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-adb213cd-dd6d-41c3-88f2-bef3ddf23ce3" returned: 0 in 0.257s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:28 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-aced703f-ea47-45e3-8a51-146bae6344bd tempest-VolumesCloneNegativeTest-2012542469 None] Lock "cinder-quobyte-adb213cd-dd6d-41c3-88f2-bef3ddf23ce3" released by "delete_volume" :: held 0.728s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:28 devstack sudo[97049]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4b0b9451-6f37-4d3f-861f-3a68540564b4 tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85.info" returned: 0 in 0.273s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4b0b9451-6f37-4d3f-861f-3a68540564b4 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.301s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-413361d3-b77a-43fe-96f3-3249a032af80 tempest-VolumesSnapshotListTestJSON-1857191141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.670s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:28 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-aced703f-ea47-45e3-8a51-146bae6344bd tempest-VolumesCloneNegativeTest-2012542469 None] Created reservations ['0837d298-2e5b-408f-91be-32f08f4c4dd7', '9df768f9-093b-4a2a-a55d-3820c1abb1aa', 'c79d5fb4-5cec-42d0-84f0-ebfa755f363c', '9b94ca82-aa57-4400-8d1e-b4c4d87e7082'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:13:28 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-413361d3-b77a-43fe-96f3-3249a032af80 tempest-VolumesSnapshotListTestJSON-1857191141 None] Creating offline snapshot 2171e344-4bb3-46e3-9ca0-abdfe2be313b of volume 0f56e11e-bac6-4444-b6cb-6d75b45db734 {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:13:28 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[59244e3c-e62a-47ba-b91f-65558718d57b]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:13:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-413361d3-b77a-43fe-96f3-3249a032af80 tempest-VolumesSnapshotListTestJSON-1857191141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.fe9b8848-8eb6-4607-8f72-0314536ed5b6 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:28 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-4b0b9451-6f37-4d3f-861f-3a68540564b4 tempest-VolumesSnapshotTestJSON-349969979 None] Create snapshot completed successfully
Nov 06 17:13:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-aced703f-ea47-45e3-8a51-146bae6344bd tempest-VolumesCloneNegativeTest-2012542469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-aced703f-ea47-45e3-8a51-146bae6344bd tempest-VolumesCloneNegativeTest-2012542469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:28 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-aced703f-ea47-45e3-8a51-146bae6344bd tempest-VolumesCloneNegativeTest-2012542469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:13:28 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-aced703f-ea47-45e3-8a51-146bae6344bd tempest-VolumesCloneNegativeTest-2012542469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:13:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-aced703f-ea47-45e3-8a51-146bae6344bd tempest-VolumesCloneNegativeTest-2012542469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-aced703f-ea47-45e3-8a51-146bae6344bd tempest-VolumesCloneNegativeTest-2012542469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:28 devstack sudo[97054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:13:28 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:28 devstack sudo[97053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.fe9b8848-8eb6-4607-8f72-0314536ed5b6
Nov 06 17:13:28 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:29 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-aced703f-ea47-45e3-8a51-146bae6344bd tempest-VolumesCloneNegativeTest-2012542469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.359s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:29 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-aced703f-ea47-45e3-8a51-146bae6344bd tempest-VolumesCloneNegativeTest-2012542469 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:13:29 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-aced703f-ea47-45e3-8a51-146bae6344bd tempest-VolumesCloneNegativeTest-2012542469 None] Deleted volume successfully.
Nov 06 17:13:29 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1b362259-ee8c-4478-9cf8-71363915391c tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "cinder-fa4638ac-0875-4b90-aa12-9197d247900c-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:29 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-aced703f-ea47-45e3-8a51-146bae6344bd tempest-VolumesCloneNegativeTest-2012542469 None] Lock "cinder-adb213cd-dd6d-41c3-88f2-bef3ddf23ce3-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:29 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1b362259-ee8c-4478-9cf8-71363915391c tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-fa4638ac-0875-4b90-aa12-9197d247900c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:29 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1b362259-ee8c-4478-9cf8-71363915391c tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "cinder-quobyte-01361e88-13cd-4903-a59e-4ca0cd5c8f85" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:29 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-413361d3-b77a-43fe-96f3-3249a032af80 tempest-VolumesSnapshotListTestJSON-1857191141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.fe9b8848-8eb6-4607-8f72-0314536ed5b6" returned: 0 in 0.597s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:29 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-413361d3-b77a-43fe-96f3-3249a032af80 tempest-VolumesSnapshotListTestJSON-1857191141 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f56e11e-bac6-4444-b6cb-6d75b45db734(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:13:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-413361d3-b77a-43fe-96f3-3249a032af80 tempest-VolumesSnapshotListTestJSON-1857191141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.fe9b8848-8eb6-4607-8f72-0314536ed5b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.2171e344-4bb3-46e3-9ca0-abdfe2be313b 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:29 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1b362259-ee8c-4478-9cf8-71363915391c tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-quobyte-01361e88-13cd-4903-a59e-4ca0cd5c8f85" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:29 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1b362259-ee8c-4478-9cf8-71363915391c tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "cinder-quobyte-fa4638ac-0875-4b90-aa12-9197d247900c" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:29 devstack sudo[97061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.fe9b8848-8eb6-4607-8f72-0314536ed5b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.2171e344-4bb3-46e3-9ca0-abdfe2be313b 1G
Nov 06 17:13:29 devstack sudo[97061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:29 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1b362259-ee8c-4478-9cf8-71363915391c tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-quobyte-fa4638ac-0875-4b90-aa12-9197d247900c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:29 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-1b362259-ee8c-4478-9cf8-71363915391c tempest-VolumesSnapshotTestJSON-349969979 None] Deleting offline snapshot fa4638ac-0875-4b90-aa12-9197d247900c of volume 01361e88-13cd-4903-a59e-4ca0cd5c8f85 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:13:29 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-1b362259-ee8c-4478-9cf8-71363915391c tempest-VolumesSnapshotTestJSON-349969979 None] snapshot_file for this snap is: volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85.fa4638ac-0875-4b90-aa12-9197d247900c {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:13:29 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf98c928-e6be-44fb-b5f7-49a90c08f968]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:13:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1b362259-ee8c-4478-9cf8-71363915391c tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85.fa4638ac-0875-4b90-aa12-9197d247900c {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:29 devstack sudo[97063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85.fa4638ac-0875-4b90-aa12-9197d247900c
Nov 06 17:13:29 devstack sudo[97063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:29 devstack sudo[97063]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1b362259-ee8c-4478-9cf8-71363915391c tempest-VolumesSnapshotTestJSON-349969979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85.fa4638ac-0875-4b90-aa12-9197d247900c" returned: 0 in 0.455s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:29 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-1b362259-ee8c-4478-9cf8-71363915391c tempest-VolumesSnapshotTestJSON-349969979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:13:29 devstack sudo[97061]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:29 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2bf035-ba44-47bb-b7ca-effcee706fab]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:13:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1b362259-ee8c-4478-9cf8-71363915391c tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-413361d3-b77a-43fe-96f3-3249a032af80 tempest-VolumesSnapshotListTestJSON-1857191141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.fe9b8848-8eb6-4607-8f72-0314536ed5b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.2171e344-4bb3-46e3-9ca0-abdfe2be313b 1G" returned: 0 in 0.618s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-413361d3-b77a-43fe-96f3-3249a032af80 tempest-VolumesSnapshotListTestJSON-1857191141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.fe9b8848-8eb6-4607-8f72-0314536ed5b6 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.2171e344-4bb3-46e3-9ca0-abdfe2be313b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:29 devstack sudo[97076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.fe9b8848-8eb6-4607-8f72-0314536ed5b6 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.2171e344-4bb3-46e3-9ca0-abdfe2be313b
Nov 06 17:13:29 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:29 devstack sudo[97075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85
Nov 06 17:13:29 devstack sudo[97075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:30 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-413361d3-b77a-43fe-96f3-3249a032af80 tempest-VolumesSnapshotListTestJSON-1857191141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.fe9b8848-8eb6-4607-8f72-0314536ed5b6 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.2171e344-4bb3-46e3-9ca0-abdfe2be313b" returned: 0 in 0.439s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:30 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-413361d3-b77a-43fe-96f3-3249a032af80 tempest-VolumesSnapshotListTestJSON-1857191141 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.2171e344-4bb3-46e3-9ca0-abdfe2be313b is being set with open permissions: ugo+rw
Nov 06 17:13:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-413361d3-b77a-43fe-96f3-3249a032af80 tempest-VolumesSnapshotListTestJSON-1857191141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.2171e344-4bb3-46e3-9ca0-abdfe2be313b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:30 devstack sudo[97086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.2171e344-4bb3-46e3-9ca0-abdfe2be313b
Nov 06 17:13:30 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:30 devstack sudo[97075]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1b362259-ee8c-4478-9cf8-71363915391c tempest-VolumesSnapshotTestJSON-349969979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85" returned: 0 in 0.514s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1b362259-ee8c-4478-9cf8-71363915391c tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85.fa4638ac-0875-4b90-aa12-9197d247900c {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:30 devstack sudo[97088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85.fa4638ac-0875-4b90-aa12-9197d247900c
Nov 06 17:13:30 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:30 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-413361d3-b77a-43fe-96f3-3249a032af80 tempest-VolumesSnapshotListTestJSON-1857191141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.2171e344-4bb3-46e3-9ca0-abdfe2be313b" returned: 0 in 0.376s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-413361d3-b77a-43fe-96f3-3249a032af80 tempest-VolumesSnapshotListTestJSON-1857191141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.203s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:30 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-413361d3-b77a-43fe-96f3-3249a032af80 tempest-VolumesSnapshotListTestJSON-1857191141 None] Create snapshot completed successfully
Nov 06 17:13:30 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1b362259-ee8c-4478-9cf8-71363915391c tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85.fa4638ac-0875-4b90-aa12-9197d247900c" returned: 0 in 0.551s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1b362259-ee8c-4478-9cf8-71363915391c tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85.fa4638ac-0875-4b90-aa12-9197d247900c {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:30 devstack sudo[97095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85.fa4638ac-0875-4b90-aa12-9197d247900c
Nov 06 17:13:30 devstack sudo[97095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:31 devstack sudo[97095]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1b362259-ee8c-4478-9cf8-71363915391c tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85.fa4638ac-0875-4b90-aa12-9197d247900c" returned: 0 in 0.372s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:31 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1b362259-ee8c-4478-9cf8-71363915391c tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-quobyte-fa4638ac-0875-4b90-aa12-9197d247900c" released by "_delete_snapshot" :: held 2.059s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:31 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1b362259-ee8c-4478-9cf8-71363915391c tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-quobyte-01361e88-13cd-4903-a59e-4ca0cd5c8f85" released by "delete_snapshot" :: held 2.093s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:31 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-1b362259-ee8c-4478-9cf8-71363915391c tempest-VolumesSnapshotTestJSON-349969979 None] Created reservations ['d08bfcca-05ad-4e63-83d4-f88355b56eba', '38ee92b5-bf47-40c0-a5ac-69a3c182c9ce', 'b1e36da1-5c56-4c26-97aa-071f7d07f9c2', '5ca86fb0-215c-48fe-a833-409d013d21b9'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:13:31 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-1b362259-ee8c-4478-9cf8-71363915391c tempest-VolumesSnapshotTestJSON-349969979 None] Delete snapshot completed successfully.
Nov 06 17:13:31 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1b362259-ee8c-4478-9cf8-71363915391c tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-fa4638ac-0875-4b90-aa12-9197d247900c-delete_snapshot" released by "delete_snapshot" :: held 2.411s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:32 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-8f143263-5cdb-442a-8302-1bfbb9c6da2e tempest-VolumesSnapshotListTestJSON-1857191141 None] Acquiring lock "cinder-2171e344-4bb3-46e3-9ca0-abdfe2be313b-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:32 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-8f143263-5cdb-442a-8302-1bfbb9c6da2e tempest-VolumesSnapshotListTestJSON-1857191141 None] Lock "cinder-2171e344-4bb3-46e3-9ca0-abdfe2be313b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:32 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-8f143263-5cdb-442a-8302-1bfbb9c6da2e tempest-VolumesSnapshotListTestJSON-1857191141 None] Acquiring lock "cinder-quobyte-0f56e11e-bac6-4444-b6cb-6d75b45db734" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:32 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-8f143263-5cdb-442a-8302-1bfbb9c6da2e tempest-VolumesSnapshotListTestJSON-1857191141 None] Lock "cinder-quobyte-0f56e11e-bac6-4444-b6cb-6d75b45db734" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:32 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-8f143263-5cdb-442a-8302-1bfbb9c6da2e tempest-VolumesSnapshotListTestJSON-1857191141 None] Acquiring lock "cinder-quobyte-2171e344-4bb3-46e3-9ca0-abdfe2be313b" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:32 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-8f143263-5cdb-442a-8302-1bfbb9c6da2e tempest-VolumesSnapshotListTestJSON-1857191141 None] Lock "cinder-quobyte-2171e344-4bb3-46e3-9ca0-abdfe2be313b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:32 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-8f143263-5cdb-442a-8302-1bfbb9c6da2e tempest-VolumesSnapshotListTestJSON-1857191141 None] Deleting offline snapshot 2171e344-4bb3-46e3-9ca0-abdfe2be313b of volume 0f56e11e-bac6-4444-b6cb-6d75b45db734 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:13:32 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-8f143263-5cdb-442a-8302-1bfbb9c6da2e tempest-VolumesSnapshotListTestJSON-1857191141 None] snapshot_file for this snap is: volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.2171e344-4bb3-46e3-9ca0-abdfe2be313b {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:13:32 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[66201431-47ea-41ef-846c-946ef2c0396a]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:13:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8f143263-5cdb-442a-8302-1bfbb9c6da2e tempest-VolumesSnapshotListTestJSON-1857191141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.2171e344-4bb3-46e3-9ca0-abdfe2be313b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:32 devstack sudo[97099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.2171e344-4bb3-46e3-9ca0-abdfe2be313b
Nov 06 17:13:32 devstack sudo[97099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:33 devstack sudo[97099]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8f143263-5cdb-442a-8302-1bfbb9c6da2e tempest-VolumesSnapshotListTestJSON-1857191141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.2171e344-4bb3-46e3-9ca0-abdfe2be313b" returned: 0 in 0.530s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:33 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-8f143263-5cdb-442a-8302-1bfbb9c6da2e tempest-VolumesSnapshotListTestJSON-1857191141 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f56e11e-bac6-4444-b6cb-6d75b45db734(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:13:33 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[983fdf79-15a5-40b2-bd79-4bafee577e1a]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:13:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8f143263-5cdb-442a-8302-1bfbb9c6da2e tempest-VolumesSnapshotListTestJSON-1857191141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.fe9b8848-8eb6-4607-8f72-0314536ed5b6 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:33 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e1326f7-93cc-4248-b847-1464b0c3225f tempest-VolumesSnapshotTestJSON-349969979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:13:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7e1326f7-93cc-4248-b847-1464b0c3225f tempest-VolumesSnapshotTestJSON-349969979 None] Flow 'volume_create_manager' (1a71147c-b57d-45a2-94e7-f884b4657ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:13:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7e1326f7-93cc-4248-b847-1464b0c3225f tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfc7f1c8-cca0-4a6c-a683-cca046fa20fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7e1326f7-93cc-4248-b847-1464b0c3225f tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfc7f1c8-cca0-4a6c-a683-cca046fa20fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-471541498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50649687-752c-424c-b998-005a65d29311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d8e6498df64229af85d96b1e8116f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:13:33Z,use_quota=True,user_id='f9e67809a7954e01a5321acb51af70fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7e1326f7-93cc-4248-b847-1464b0c3225f tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7644aa1-75a8-4964-a8fe-eca07f27158f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7e1326f7-93cc-4248-b847-1464b0c3225f tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7644aa1-75a8-4964-a8fe-eca07f27158f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7e1326f7-93cc-4248-b847-1464b0c3225f tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5b065a1-272f-4491-9571-faafddca50bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7e1326f7-93cc-4248-b847-1464b0c3225f tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5b065a1-272f-4491-9571-faafddca50bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50649687-752c-424c-b998-005a65d29311', 'volume_name': 'volume-50649687-752c-424c-b998-005a65d29311', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7e1326f7-93cc-4248-b847-1464b0c3225f tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75e8bd20-3ac2-4cdc-9f23-7c617ed0655e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:33 devstack sudo[97104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.fe9b8848-8eb6-4607-8f72-0314536ed5b6
Nov 06 17:13:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7e1326f7-93cc-4248-b847-1464b0c3225f tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75e8bd20-3ac2-4cdc-9f23-7c617ed0655e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:33 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7e1326f7-93cc-4248-b847-1464b0c3225f tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (951d92c6-7922-4c76-ba54-313ec17e5b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:33 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-7e1326f7-93cc-4248-b847-1464b0c3225f tempest-VolumesSnapshotTestJSON-349969979 None] Volume 50649687-752c-424c-b998-005a65d29311: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50649687-752c-424c-b998-005a65d29311', 'volume_size': 1}
Nov 06 17:13:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7e1326f7-93cc-4248-b847-1464b0c3225f tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7e1326f7-93cc-4248-b847-1464b0c3225f tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:33 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7e1326f7-93cc-4248-b847-1464b0c3225f tempest-VolumesSnapshotTestJSON-349969979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-471541498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50649687-752c-424c-b998-005a65d29311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d8e6498df64229af85d96b1e8116f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:13:33Z,use_quota=True,user_id='f9e67809a7954e01a5321acb51af70fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:13:33 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-7e1326f7-93cc-4248-b847-1464b0c3225f tempest-VolumesSnapshotTestJSON-349969979 None] Creating volume 50649687-752c-424c-b998-005a65d29311 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:13:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7e1326f7-93cc-4248-b847-1464b0c3225f tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7e1326f7-93cc-4248-b847-1464b0c3225f tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:33 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7e1326f7-93cc-4248-b847-1464b0c3225f tempest-VolumesSnapshotTestJSON-349969979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:13:33 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7e1326f7-93cc-4248-b847-1464b0c3225f tempest-VolumesSnapshotTestJSON-349969979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:13:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7e1326f7-93cc-4248-b847-1464b0c3225f tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:33 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7e1326f7-93cc-4248-b847-1464b0c3225f tempest-VolumesSnapshotTestJSON-349969979 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:13:33 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-7e1326f7-93cc-4248-b847-1464b0c3225f tempest-VolumesSnapshotTestJSON-349969979 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:13:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7e1326f7-93cc-4248-b847-1464b0c3225f tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:33 devstack sudo[97106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311 1073741824
Nov 06 17:13:33 devstack sudo[97106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:33 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8f143263-5cdb-442a-8302-1bfbb9c6da2e tempest-VolumesSnapshotListTestJSON-1857191141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.fe9b8848-8eb6-4607-8f72-0314536ed5b6" returned: 0 in 0.530s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:33 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-8f143263-5cdb-442a-8302-1bfbb9c6da2e tempest-VolumesSnapshotListTestJSON-1857191141 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f56e11e-bac6-4444-b6cb-6d75b45db734(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:13:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8f143263-5cdb-442a-8302-1bfbb9c6da2e tempest-VolumesSnapshotListTestJSON-1857191141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.2171e344-4bb3-46e3-9ca0-abdfe2be313b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:33 devstack sudo[97114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.2171e344-4bb3-46e3-9ca0-abdfe2be313b
Nov 06 17:13:33 devstack sudo[97114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:33 devstack sudo[97106]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7e1326f7-93cc-4248-b847-1464b0c3225f tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311 1073741824" returned: 0 in 0.594s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7e1326f7-93cc-4248-b847-1464b0c3225f tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:34 devstack sudo[97117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311
Nov 06 17:13:34 devstack sudo[97117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:34 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-e71ec899-79ba-4424-bef7-dd89407e9a1a tempest-VolumesGetTest-776201853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:13:34 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e71ec899-79ba-4424-bef7-dd89407e9a1a tempest-VolumesGetTest-776201853 None] Flow 'volume_create_manager' (d6a009e0-f554-498e-acb4-d9e11912fb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:13:34 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e71ec899-79ba-4424-bef7-dd89407e9a1a tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b5328c-4a2a-4d90-b70f-5e6957f125d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:34 devstack sudo[97117]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7e1326f7-93cc-4248-b847-1464b0c3225f tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311" returned: 0 in 0.332s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:34 devstack sudo[97114]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7e1326f7-93cc-4248-b847-1464b0c3225f tempest-VolumesSnapshotTestJSON-349969979 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:13:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7e1326f7-93cc-4248-b847-1464b0c3225f tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8f143263-5cdb-442a-8302-1bfbb9c6da2e tempest-VolumesSnapshotListTestJSON-1857191141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.2171e344-4bb3-46e3-9ca0-abdfe2be313b" returned: 0 in 0.634s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8f143263-5cdb-442a-8302-1bfbb9c6da2e tempest-VolumesSnapshotListTestJSON-1857191141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.2171e344-4bb3-46e3-9ca0-abdfe2be313b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:34 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e71ec899-79ba-4424-bef7-dd89407e9a1a tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b5328c-4a2a-4d90-b70f-5e6957f125d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-201621637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9c530d6-35d7-4143-a95f-0cdefa528c4c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f5791703ccd54989903afbe71d00e5b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:13:34Z,use_quota=True,user_id='f8538f1b84ba4958b1f532c455a030d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:34 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e71ec899-79ba-4424-bef7-dd89407e9a1a tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69a5acf3-4d78-4c92-b390-9838589de8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:34 devstack sudo[97122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.2171e344-4bb3-46e3-9ca0-abdfe2be313b
Nov 06 17:13:34 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:34 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e71ec899-79ba-4424-bef7-dd89407e9a1a tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69a5acf3-4d78-4c92-b390-9838589de8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:34 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e71ec899-79ba-4424-bef7-dd89407e9a1a tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa260a02-8665-4f23-94fe-6d7dc28e611b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:34 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e71ec899-79ba-4424-bef7-dd89407e9a1a tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa260a02-8665-4f23-94fe-6d7dc28e611b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9c530d6-35d7-4143-a95f-0cdefa528c4c', 'volume_name': 'volume-f9c530d6-35d7-4143-a95f-0cdefa528c4c', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:34 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e71ec899-79ba-4424-bef7-dd89407e9a1a tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (574b4d29-bdfe-4ff8-addc-d6f981478beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:34 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e71ec899-79ba-4424-bef7-dd89407e9a1a tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (574b4d29-bdfe-4ff8-addc-d6f981478beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:34 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e71ec899-79ba-4424-bef7-dd89407e9a1a tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd3d9c70-e944-4406-88e4-135a72491d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:34 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-e71ec899-79ba-4424-bef7-dd89407e9a1a tempest-VolumesGetTest-776201853 None] Volume f9c530d6-35d7-4143-a95f-0cdefa528c4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9c530d6-35d7-4143-a95f-0cdefa528c4c', 'volume_size': 1}
Nov 06 17:13:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e71ec899-79ba-4424-bef7-dd89407e9a1a tempest-VolumesGetTest-776201853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e71ec899-79ba-4424-bef7-dd89407e9a1a tempest-VolumesGetTest-776201853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e71ec899-79ba-4424-bef7-dd89407e9a1a tempest-VolumesGetTest-776201853 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-201621637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9c530d6-35d7-4143-a95f-0cdefa528c4c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f5791703ccd54989903afbe71d00e5b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:13:34Z,use_quota=True,user_id='f8538f1b84ba4958b1f532c455a030d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:13:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-e71ec899-79ba-4424-bef7-dd89407e9a1a tempest-VolumesGetTest-776201853 None] Creating volume f9c530d6-35d7-4143-a95f-0cdefa528c4c {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:13:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e71ec899-79ba-4424-bef7-dd89407e9a1a tempest-VolumesGetTest-776201853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e71ec899-79ba-4424-bef7-dd89407e9a1a tempest-VolumesGetTest-776201853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e71ec899-79ba-4424-bef7-dd89407e9a1a tempest-VolumesGetTest-776201853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:13:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e71ec899-79ba-4424-bef7-dd89407e9a1a tempest-VolumesGetTest-776201853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:13:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e71ec899-79ba-4424-bef7-dd89407e9a1a tempest-VolumesGetTest-776201853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e71ec899-79ba-4424-bef7-dd89407e9a1a tempest-VolumesGetTest-776201853 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:13:34 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-e71ec899-79ba-4424-bef7-dd89407e9a1a tempest-VolumesGetTest-776201853 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:13:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e71ec899-79ba-4424-bef7-dd89407e9a1a tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9c530d6-35d7-4143-a95f-0cdefa528c4c 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:34 devstack sudo[97124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9c530d6-35d7-4143-a95f-0cdefa528c4c 1073741824
Nov 06 17:13:34 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7e1326f7-93cc-4248-b847-1464b0c3225f tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (951d92c6-7922-4c76-ba54-313ec17e5b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50649687-752c-424c-b998-005a65d29311', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:34 devstack sudo[97124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:34 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7e1326f7-93cc-4248-b847-1464b0c3225f tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d763605-1c89-4336-8d86-d3b21f72bf04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:34 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-7e1326f7-93cc-4248-b847-1464b0c3225f tempest-VolumesSnapshotTestJSON-349969979 None] Volume volume-50649687-752c-424c-b998-005a65d29311 (50649687-752c-424c-b998-005a65d29311): created successfully
Nov 06 17:13:34 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7e1326f7-93cc-4248-b847-1464b0c3225f tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d763605-1c89-4336-8d86-d3b21f72bf04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:34 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7e1326f7-93cc-4248-b847-1464b0c3225f tempest-VolumesSnapshotTestJSON-349969979 None] Flow 'volume_create_manager' (1a71147c-b57d-45a2-94e7-f884b4657ada) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:13:34 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-7e1326f7-93cc-4248-b847-1464b0c3225f tempest-VolumesSnapshotTestJSON-349969979 None] Created volume successfully.
Nov 06 17:13:34 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8f143263-5cdb-442a-8302-1bfbb9c6da2e tempest-VolumesSnapshotListTestJSON-1857191141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.2171e344-4bb3-46e3-9ca0-abdfe2be313b" returned: 0 in 0.314s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:34 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-8f143263-5cdb-442a-8302-1bfbb9c6da2e tempest-VolumesSnapshotListTestJSON-1857191141 None] Lock "cinder-quobyte-2171e344-4bb3-46e3-9ca0-abdfe2be313b" released by "_delete_snapshot" :: held 2.142s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:34 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-8f143263-5cdb-442a-8302-1bfbb9c6da2e tempest-VolumesSnapshotListTestJSON-1857191141 None] Lock "cinder-quobyte-0f56e11e-bac6-4444-b6cb-6d75b45db734" released by "delete_snapshot" :: held 2.167s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:34 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-8f143263-5cdb-442a-8302-1bfbb9c6da2e tempest-VolumesSnapshotListTestJSON-1857191141 None] Created reservations ['e3607ef5-d6af-451e-a82c-9aadd9615eeb', 'c3f7a785-150a-4e03-ad07-579a699cc1b8', 'a77c2799-a8d3-4032-8dc4-c05ad00e7fef', 'a29bfa28-cf21-4a6d-870b-a6c9c8024390'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:13:34 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-8f143263-5cdb-442a-8302-1bfbb9c6da2e tempest-VolumesSnapshotListTestJSON-1857191141 None] Delete snapshot completed successfully.
Nov 06 17:13:34 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-8f143263-5cdb-442a-8302-1bfbb9c6da2e tempest-VolumesSnapshotListTestJSON-1857191141 None] Lock "cinder-2171e344-4bb3-46e3-9ca0-abdfe2be313b-delete_snapshot" released by "delete_snapshot" :: held 2.330s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:34 devstack sudo[97124]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e71ec899-79ba-4424-bef7-dd89407e9a1a tempest-VolumesGetTest-776201853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9c530d6-35d7-4143-a95f-0cdefa528c4c 1073741824" returned: 0 in 0.510s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e71ec899-79ba-4424-bef7-dd89407e9a1a tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9c530d6-35d7-4143-a95f-0cdefa528c4c {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:34 devstack sudo[97131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9c530d6-35d7-4143-a95f-0cdefa528c4c
Nov 06 17:13:34 devstack sudo[97131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:35 devstack sudo[97131]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e71ec899-79ba-4424-bef7-dd89407e9a1a tempest-VolumesGetTest-776201853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9c530d6-35d7-4143-a95f-0cdefa528c4c" returned: 0 in 0.256s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e71ec899-79ba-4424-bef7-dd89407e9a1a tempest-VolumesGetTest-776201853 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:13:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e71ec899-79ba-4424-bef7-dd89407e9a1a tempest-VolumesGetTest-776201853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:35 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e71ec899-79ba-4424-bef7-dd89407e9a1a tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd3d9c70-e944-4406-88e4-135a72491d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9c530d6-35d7-4143-a95f-0cdefa528c4c', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:35 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e71ec899-79ba-4424-bef7-dd89407e9a1a tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f626cbda-45fb-42cc-aacc-10fce9e1df64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:35 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-e71ec899-79ba-4424-bef7-dd89407e9a1a tempest-VolumesGetTest-776201853 None] Volume volume-f9c530d6-35d7-4143-a95f-0cdefa528c4c (f9c530d6-35d7-4143-a95f-0cdefa528c4c): created successfully
Nov 06 17:13:35 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e71ec899-79ba-4424-bef7-dd89407e9a1a tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f626cbda-45fb-42cc-aacc-10fce9e1df64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:35 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e71ec899-79ba-4424-bef7-dd89407e9a1a tempest-VolumesGetTest-776201853 None] Flow 'volume_create_manager' (d6a009e0-f554-498e-acb4-d9e11912fb99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:13:35 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-e71ec899-79ba-4424-bef7-dd89407e9a1a tempest-VolumesGetTest-776201853 None] Created volume successfully.
Nov 06 17:13:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a51561ad-9bd0-45db-a893-deb7dacac24c tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a51561ad-9bd0-45db-a893-deb7dacac24c tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-a51561ad-9bd0-45db-a893-deb7dacac24c tempest-VolumesSnapshotTestJSON-349969979 None] Creating offline snapshot 322155c6-7497-4ef3-a5de-28a235502bfd of volume 50649687-752c-424c-b998-005a65d29311 {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:13:35 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb78125-1220-49d6-a30b-4d948599c0cd]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:13:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a51561ad-9bd0-45db-a893-deb7dacac24c tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:35 devstack sudo[97134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311
Nov 06 17:13:35 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:35 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-cce6262a-1ff0-479e-bf5f-28b9e518d52c tempest-VolumesSnapshotListTestJSON-1857191141 None] Acquiring lock "cinder-fe9b8848-8eb6-4607-8f72-0314536ed5b6-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:35 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-cce6262a-1ff0-479e-bf5f-28b9e518d52c tempest-VolumesSnapshotListTestJSON-1857191141 None] Lock "cinder-fe9b8848-8eb6-4607-8f72-0314536ed5b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:35 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-cce6262a-1ff0-479e-bf5f-28b9e518d52c tempest-VolumesSnapshotListTestJSON-1857191141 None] Acquiring lock "cinder-quobyte-0f56e11e-bac6-4444-b6cb-6d75b45db734" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:35 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-cce6262a-1ff0-479e-bf5f-28b9e518d52c tempest-VolumesSnapshotListTestJSON-1857191141 None] Lock "cinder-quobyte-0f56e11e-bac6-4444-b6cb-6d75b45db734" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:35 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-cce6262a-1ff0-479e-bf5f-28b9e518d52c tempest-VolumesSnapshotListTestJSON-1857191141 None] Acquiring lock "cinder-quobyte-fe9b8848-8eb6-4607-8f72-0314536ed5b6" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:35 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-cce6262a-1ff0-479e-bf5f-28b9e518d52c tempest-VolumesSnapshotListTestJSON-1857191141 None] Lock "cinder-quobyte-fe9b8848-8eb6-4607-8f72-0314536ed5b6" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-cce6262a-1ff0-479e-bf5f-28b9e518d52c tempest-VolumesSnapshotListTestJSON-1857191141 None] Deleting offline snapshot fe9b8848-8eb6-4607-8f72-0314536ed5b6 of volume 0f56e11e-bac6-4444-b6cb-6d75b45db734 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:13:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-cce6262a-1ff0-479e-bf5f-28b9e518d52c tempest-VolumesSnapshotListTestJSON-1857191141 None] snapshot_file for this snap is: volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.fe9b8848-8eb6-4607-8f72-0314536ed5b6 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:13:35 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6d6c4c-1228-4713-b72b-0c095309555b]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:13:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cce6262a-1ff0-479e-bf5f-28b9e518d52c tempest-VolumesSnapshotListTestJSON-1857191141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.fe9b8848-8eb6-4607-8f72-0314536ed5b6 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:35 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a51561ad-9bd0-45db-a893-deb7dacac24c tempest-VolumesSnapshotTestJSON-349969979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311" returned: 0 in 0.389s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a51561ad-9bd0-45db-a893-deb7dacac24c tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311.322155c6-7497-4ef3-a5de-28a235502bfd 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:35 devstack sudo[97140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311.322155c6-7497-4ef3-a5de-28a235502bfd 1G
Nov 06 17:13:35 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:35 devstack sudo[97139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.fe9b8848-8eb6-4607-8f72-0314536ed5b6
Nov 06 17:13:35 devstack sudo[97139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:36 devstack sudo[97139]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cce6262a-1ff0-479e-bf5f-28b9e518d52c tempest-VolumesSnapshotListTestJSON-1857191141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.fe9b8848-8eb6-4607-8f72-0314536ed5b6" returned: 0 in 0.474s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:36 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-cce6262a-1ff0-479e-bf5f-28b9e518d52c tempest-VolumesSnapshotListTestJSON-1857191141 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f56e11e-bac6-4444-b6cb-6d75b45db734(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:13:36 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[7321a564-5990-417a-9221-59310827a35d]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:13:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cce6262a-1ff0-479e-bf5f-28b9e518d52c tempest-VolumesSnapshotListTestJSON-1857191141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.bd997963-e12f-441f-99fa-e2719d9de6e2 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:36 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a51561ad-9bd0-45db-a893-deb7dacac24c tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311.322155c6-7497-4ef3-a5de-28a235502bfd 1G" returned: 0 in 0.508s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a51561ad-9bd0-45db-a893-deb7dacac24c tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50649687-752c-424c-b998-005a65d29311 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311.322155c6-7497-4ef3-a5de-28a235502bfd {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:36 devstack sudo[97151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50649687-752c-424c-b998-005a65d29311 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311.322155c6-7497-4ef3-a5de-28a235502bfd
Nov 06 17:13:36 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:36 devstack sudo[97150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.bd997963-e12f-441f-99fa-e2719d9de6e2
Nov 06 17:13:36 devstack sudo[97150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:36 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a51561ad-9bd0-45db-a893-deb7dacac24c tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50649687-752c-424c-b998-005a65d29311 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311.322155c6-7497-4ef3-a5de-28a235502bfd" returned: 0 in 0.383s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:36 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-a51561ad-9bd0-45db-a893-deb7dacac24c tempest-VolumesSnapshotTestJSON-349969979 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311.322155c6-7497-4ef3-a5de-28a235502bfd is being set with open permissions: ugo+rw
Nov 06 17:13:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a51561ad-9bd0-45db-a893-deb7dacac24c tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311.322155c6-7497-4ef3-a5de-28a235502bfd {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:36 devstack sudo[97150]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cce6262a-1ff0-479e-bf5f-28b9e518d52c tempest-VolumesSnapshotListTestJSON-1857191141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.bd997963-e12f-441f-99fa-e2719d9de6e2" returned: 0 in 0.445s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:36 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-cce6262a-1ff0-479e-bf5f-28b9e518d52c tempest-VolumesSnapshotListTestJSON-1857191141 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f56e11e-bac6-4444-b6cb-6d75b45db734(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:13:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cce6262a-1ff0-479e-bf5f-28b9e518d52c tempest-VolumesSnapshotListTestJSON-1857191141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.fe9b8848-8eb6-4607-8f72-0314536ed5b6 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:36 devstack sudo[97160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311.322155c6-7497-4ef3-a5de-28a235502bfd
Nov 06 17:13:36 devstack sudo[97160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:36 devstack sudo[97161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.fe9b8848-8eb6-4607-8f72-0314536ed5b6
Nov 06 17:13:36 devstack sudo[97161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:37 devstack sudo[97160]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a51561ad-9bd0-45db-a893-deb7dacac24c tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311.322155c6-7497-4ef3-a5de-28a235502bfd" returned: 0 in 0.309s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a51561ad-9bd0-45db-a893-deb7dacac24c tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:37 devstack sudo[97168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311.info
Nov 06 17:13:37 devstack sudo[97168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:37 devstack sudo[97161]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:37 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f1bfc3e-cb6c-4cda-ba40-308f7293f209 tempest-VolumesGetTest-776201853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:13:37 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f1bfc3e-cb6c-4cda-ba40-308f7293f209 tempest-VolumesGetTest-776201853 None] Flow 'volume_create_manager' (41b1db02-28e6-452a-b21d-d0d37e1b9fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:13:37 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f1bfc3e-cb6c-4cda-ba40-308f7293f209 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c3294fb-2475-4e60-8f1f-42051db7a7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cce6262a-1ff0-479e-bf5f-28b9e518d52c tempest-VolumesSnapshotListTestJSON-1857191141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.fe9b8848-8eb6-4607-8f72-0314536ed5b6" returned: 0 in 0.582s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cce6262a-1ff0-479e-bf5f-28b9e518d52c tempest-VolumesSnapshotListTestJSON-1857191141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.fe9b8848-8eb6-4607-8f72-0314536ed5b6 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:37 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f1bfc3e-cb6c-4cda-ba40-308f7293f209 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c3294fb-2475-4e60-8f1f-42051db7a7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:13:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1135605418',display_name='tempest-VolumesGetTest-Volume-1399831369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3c87313-a014-41d0-b8ad-355a56b46858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5791703ccd54989903afbe71d00e5b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:13:37Z,use_quota=True,user_id='f8538f1b84ba4958b1f532c455a030d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:37 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f1bfc3e-cb6c-4cda-ba40-308f7293f209 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (960030cc-bf1f-4c13-90c0-4bcfe9893e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:37 devstack sudo[97170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.fe9b8848-8eb6-4607-8f72-0314536ed5b6
Nov 06 17:13:37 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f1bfc3e-cb6c-4cda-ba40-308f7293f209 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (960030cc-bf1f-4c13-90c0-4bcfe9893e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:37 devstack sudo[97170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:37 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f1bfc3e-cb6c-4cda-ba40-308f7293f209 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed2080a7-1de4-4ab5-824c-e77a009ffe8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:37 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f1bfc3e-cb6c-4cda-ba40-308f7293f209 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed2080a7-1de4-4ab5-824c-e77a009ffe8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3c87313-a014-41d0-b8ad-355a56b46858', 'volume_name': 'volume-a3c87313-a014-41d0-b8ad-355a56b46858', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:37 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f1bfc3e-cb6c-4cda-ba40-308f7293f209 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c33b37b-bf10-427e-ac9b-7cc0ca60d1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:37 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f1bfc3e-cb6c-4cda-ba40-308f7293f209 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c33b37b-bf10-427e-ac9b-7cc0ca60d1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:37 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f1bfc3e-cb6c-4cda-ba40-308f7293f209 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1746509-c940-4723-bcf8-be514437abfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:37 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-4f1bfc3e-cb6c-4cda-ba40-308f7293f209 tempest-VolumesGetTest-776201853 None] Volume a3c87313-a014-41d0-b8ad-355a56b46858: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3c87313-a014-41d0-b8ad-355a56b46858', 'volume_size': 1}
Nov 06 17:13:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f1bfc3e-cb6c-4cda-ba40-308f7293f209 tempest-VolumesGetTest-776201853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:37 devstack sudo[97168]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a51561ad-9bd0-45db-a893-deb7dacac24c tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311.info" returned: 0 in 0.405s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:37 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-a51561ad-9bd0-45db-a893-deb7dacac24c tempest-VolumesSnapshotTestJSON-349969979 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311.info is being set with open permissions: ugo+rw
Nov 06 17:13:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a51561ad-9bd0-45db-a893-deb7dacac24c tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:37 devstack sudo[97173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311.info
Nov 06 17:13:37 devstack sudo[97173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:37 devstack sudo[97170]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cce6262a-1ff0-479e-bf5f-28b9e518d52c tempest-VolumesSnapshotListTestJSON-1857191141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.fe9b8848-8eb6-4607-8f72-0314536ed5b6" returned: 0 in 0.309s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-cce6262a-1ff0-479e-bf5f-28b9e518d52c tempest-VolumesSnapshotListTestJSON-1857191141 None] Lock "cinder-quobyte-fe9b8848-8eb6-4607-8f72-0314536ed5b6" released by "_delete_snapshot" :: held 1.956s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-cce6262a-1ff0-479e-bf5f-28b9e518d52c tempest-VolumesSnapshotListTestJSON-1857191141 None] Lock "cinder-quobyte-0f56e11e-bac6-4444-b6cb-6d75b45db734" released by "delete_snapshot" :: held 1.987s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:37 devstack sudo[97173]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a51561ad-9bd0-45db-a893-deb7dacac24c tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311.info" returned: 0 in 0.276s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a51561ad-9bd0-45db-a893-deb7dacac24c tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.385s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f1bfc3e-cb6c-4cda-ba40-308f7293f209 tempest-VolumesGetTest-776201853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.369s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:37 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f1bfc3e-cb6c-4cda-ba40-308f7293f209 tempest-VolumesGetTest-776201853 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:13:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1135605418',display_name='tempest-VolumesGetTest-Volume-1399831369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3c87313-a014-41d0-b8ad-355a56b46858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5791703ccd54989903afbe71d00e5b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:13:37Z,use_quota=True,user_id='f8538f1b84ba4958b1f532c455a030d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:13:37 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-4f1bfc3e-cb6c-4cda-ba40-308f7293f209 tempest-VolumesGetTest-776201853 None] Creating volume a3c87313-a014-41d0-b8ad-355a56b46858 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:13:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f1bfc3e-cb6c-4cda-ba40-308f7293f209 tempest-VolumesGetTest-776201853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f1bfc3e-cb6c-4cda-ba40-308f7293f209 tempest-VolumesGetTest-776201853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:37 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f1bfc3e-cb6c-4cda-ba40-308f7293f209 tempest-VolumesGetTest-776201853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:13:37 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f1bfc3e-cb6c-4cda-ba40-308f7293f209 tempest-VolumesGetTest-776201853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:13:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f1bfc3e-cb6c-4cda-ba40-308f7293f209 tempest-VolumesGetTest-776201853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:37 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f1bfc3e-cb6c-4cda-ba40-308f7293f209 tempest-VolumesGetTest-776201853 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:13:37 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-4f1bfc3e-cb6c-4cda-ba40-308f7293f209 tempest-VolumesGetTest-776201853 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:13:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f1bfc3e-cb6c-4cda-ba40-308f7293f209 tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a3c87313-a014-41d0-b8ad-355a56b46858 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:37 devstack sudo[97177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a3c87313-a014-41d0-b8ad-355a56b46858 1073741824
Nov 06 17:13:37 devstack sudo[97177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:37 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-cce6262a-1ff0-479e-bf5f-28b9e518d52c tempest-VolumesSnapshotListTestJSON-1857191141 None] Created reservations ['09843d9e-1b7f-4611-a98f-69ec8333b9ee', '32ed7f39-d2a9-46df-b99b-0a903053fad9', '6aa1daf2-379a-4dc5-99b4-318ca756ee89', '6da352ed-d663-4426-953f-b6fbf89d2ae0'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:13:37 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-a51561ad-9bd0-45db-a893-deb7dacac24c tempest-VolumesSnapshotTestJSON-349969979 None] Create snapshot completed successfully
Nov 06 17:13:37 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-cce6262a-1ff0-479e-bf5f-28b9e518d52c tempest-VolumesSnapshotListTestJSON-1857191141 None] Delete snapshot completed successfully.
Nov 06 17:13:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-cce6262a-1ff0-479e-bf5f-28b9e518d52c tempest-VolumesSnapshotListTestJSON-1857191141 None] Lock "cinder-fe9b8848-8eb6-4607-8f72-0314536ed5b6-delete_snapshot" released by "delete_snapshot" :: held 2.223s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:38 devstack sudo[97177]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f1bfc3e-cb6c-4cda-ba40-308f7293f209 tempest-VolumesGetTest-776201853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a3c87313-a014-41d0-b8ad-355a56b46858 1073741824" returned: 0 in 0.589s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f1bfc3e-cb6c-4cda-ba40-308f7293f209 tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a3c87313-a014-41d0-b8ad-355a56b46858 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:38 devstack sudo[97183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a3c87313-a014-41d0-b8ad-355a56b46858
Nov 06 17:13:38 devstack sudo[97183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:38 devstack sudo[97183]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f1bfc3e-cb6c-4cda-ba40-308f7293f209 tempest-VolumesGetTest-776201853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a3c87313-a014-41d0-b8ad-355a56b46858" returned: 0 in 0.278s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:38 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f1bfc3e-cb6c-4cda-ba40-308f7293f209 tempest-VolumesGetTest-776201853 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:13:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f1bfc3e-cb6c-4cda-ba40-308f7293f209 tempest-VolumesGetTest-776201853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:38 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f1bfc3e-cb6c-4cda-ba40-308f7293f209 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1746509-c940-4723-bcf8-be514437abfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3c87313-a014-41d0-b8ad-355a56b46858', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:38 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f1bfc3e-cb6c-4cda-ba40-308f7293f209 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5ea1e95-b810-4c8e-be2e-1265f57a9f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:38 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-4f1bfc3e-cb6c-4cda-ba40-308f7293f209 tempest-VolumesGetTest-776201853 None] Volume volume-a3c87313-a014-41d0-b8ad-355a56b46858 (a3c87313-a014-41d0-b8ad-355a56b46858): created successfully
Nov 06 17:13:38 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f1bfc3e-cb6c-4cda-ba40-308f7293f209 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5ea1e95-b810-4c8e-be2e-1265f57a9f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:38 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f1bfc3e-cb6c-4cda-ba40-308f7293f209 tempest-VolumesGetTest-776201853 None] Flow 'volume_create_manager' (41b1db02-28e6-452a-b21d-d0d37e1b9fbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:13:38 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-4f1bfc3e-cb6c-4cda-ba40-308f7293f209 tempest-VolumesGetTest-776201853 None] Created volume successfully.
Nov 06 17:13:38 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-49bacc34-e181-4172-afd8-a51282321ad1 tempest-VolumesSnapshotListTestJSON-1857191141 None] Acquiring lock "cinder-bd997963-e12f-441f-99fa-e2719d9de6e2-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:38 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-49bacc34-e181-4172-afd8-a51282321ad1 tempest-VolumesSnapshotListTestJSON-1857191141 None] Lock "cinder-bd997963-e12f-441f-99fa-e2719d9de6e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:38 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-49bacc34-e181-4172-afd8-a51282321ad1 tempest-VolumesSnapshotListTestJSON-1857191141 None] Acquiring lock "cinder-quobyte-0f56e11e-bac6-4444-b6cb-6d75b45db734" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:38 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-49bacc34-e181-4172-afd8-a51282321ad1 tempest-VolumesSnapshotListTestJSON-1857191141 None] Lock "cinder-quobyte-0f56e11e-bac6-4444-b6cb-6d75b45db734" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:38 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-49bacc34-e181-4172-afd8-a51282321ad1 tempest-VolumesSnapshotListTestJSON-1857191141 None] Acquiring lock "cinder-quobyte-bd997963-e12f-441f-99fa-e2719d9de6e2" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-49bacc34-e181-4172-afd8-a51282321ad1 tempest-VolumesSnapshotListTestJSON-1857191141 None] Lock "cinder-quobyte-bd997963-e12f-441f-99fa-e2719d9de6e2" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-49bacc34-e181-4172-afd8-a51282321ad1 tempest-VolumesSnapshotListTestJSON-1857191141 None] Deleting offline snapshot bd997963-e12f-441f-99fa-e2719d9de6e2 of volume 0f56e11e-bac6-4444-b6cb-6d75b45db734 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-49bacc34-e181-4172-afd8-a51282321ad1 tempest-VolumesSnapshotListTestJSON-1857191141 None] snapshot_file for this snap is: volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.bd997963-e12f-441f-99fa-e2719d9de6e2 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[4278de8f-7fbb-4c88-8610-e776744755a3]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-49bacc34-e181-4172-afd8-a51282321ad1 tempest-VolumesSnapshotListTestJSON-1857191141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.bd997963-e12f-441f-99fa-e2719d9de6e2 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:39 devstack sudo[97186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.bd997963-e12f-441f-99fa-e2719d9de6e2
Nov 06 17:13:39 devstack sudo[97186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Flow 'volume_create_manager' (995b9893-e8b1-4c34-8f87-e070ea5b8aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7311cec-eb89-4359-b923-3633a7989bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7311cec-eb89-4359-b923-3633a7989bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1007787151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0535e428-04df-4783-9ba4-7ff9d13b6f4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d8e6498df64229af85d96b1e8116f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:13:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=322155c6-7497-4ef3-a5de-28a235502bfd,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:13:39Z,use_quota=True,user_id='f9e67809a7954e01a5321acb51af70fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a7a200a-6ce7-492a-ad0d-1f87b4970303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a7a200a-6ce7-492a-ad0d-1f87b4970303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3425771-78cd-424f-9f24-758b7fa8241e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3425771-78cd-424f-9f24-758b7fa8241e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0535e428-04df-4783-9ba4-7ff9d13b6f4b', 'volume_name': 'volume-0535e428-04df-4783-9ba4-7ff9d13b6f4b', 'volume_size': 2, 'snapshot_id': '322155c6-7497-4ef3-a5de-28a235502bfd'}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f64f6b-bd05-4bed-a46e-58e307a8f6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f64f6b-bd05-4bed-a46e-58e307a8f6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59c85145-337b-455e-af72-9cfa41698294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:39 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Volume 0535e428-04df-4783-9ba4-7ff9d13b6f4b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0535e428-04df-4783-9ba4-7ff9d13b6f4b', 'volume_size': 2, 'snapshot_id': '322155c6-7497-4ef3-a5de-28a235502bfd'}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "cinder-quobyte-322155c6-7497-4ef3-a5de-28a235502bfd-0535e428-04df-4783-9ba4-7ff9d13b6f4b" by "_create_volume_from_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-quobyte-322155c6-7497-4ef3-a5de-28a235502bfd-0535e428-04df-4783-9ba4-7ff9d13b6f4b" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Creating volume 0535e428-04df-4783-9ba4-7ff9d13b6f4b from snapshot 322155c6-7497-4ef3-a5de-28a235502bfd {{(pid=86856) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "cinder-quobyte-0535e428-04df-4783-9ba4-7ff9d13b6f4b" by "_copy_volume_from_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-quobyte-0535e428-04df-4783-9ba4-7ff9d13b6f4b" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] snapshot: 322155c6-7497-4ef3-a5de-28a235502bfd, volume: 0535e428-04df-4783-9ba4-7ff9d13b6f4b,  {{(pid=86856) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 06 17:13:39 devstack sudo[97186]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-49bacc34-e181-4172-afd8-a51282321ad1 tempest-VolumesSnapshotListTestJSON-1857191141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.bd997963-e12f-441f-99fa-e2719d9de6e2" returned: 0 in 0.492s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-49bacc34-e181-4172-afd8-a51282321ad1 tempest-VolumesSnapshotListTestJSON-1857191141 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f56e11e-bac6-4444-b6cb-6d75b45db734(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[d368234b-3b19-4272-a075-f6f357f64895]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311.322155c6-7497-4ef3-a5de-28a235502bfd {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[51886720-6aea-4526-a4f8-e7f911c20eb9]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-49bacc34-e181-4172-afd8-a51282321ad1 tempest-VolumesSnapshotListTestJSON-1857191141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:39 devstack sudo[97193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734
Nov 06 17:13:39 devstack sudo[97193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:39 devstack sudo[97192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311.322155c6-7497-4ef3-a5de-28a235502bfd
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-89395117-055b-49fb-8ee9-51d648c17aba tempest-VolumesGetTest-776201853 None] Acquiring lock "cinder-a3c87313-a014-41d0-b8ad-355a56b46858-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:39 devstack sudo[97192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-89395117-055b-49fb-8ee9-51d648c17aba tempest-VolumesGetTest-776201853 None] Lock "cinder-a3c87313-a014-41d0-b8ad-355a56b46858-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-89395117-055b-49fb-8ee9-51d648c17aba tempest-VolumesGetTest-776201853 None] Acquiring lock "cinder-quobyte-a3c87313-a014-41d0-b8ad-355a56b46858" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-89395117-055b-49fb-8ee9-51d648c17aba tempest-VolumesGetTest-776201853 None] Lock "cinder-quobyte-a3c87313-a014-41d0-b8ad-355a56b46858" acquired by "delete_volume" :: waited 0.018s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c79214a-805a-44ad-bf83-996a174af502]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:13:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-89395117-055b-49fb-8ee9-51d648c17aba tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a3c87313-a014-41d0-b8ad-355a56b46858 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:40 devstack sudo[97196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a3c87313-a014-41d0-b8ad-355a56b46858
Nov 06 17:13:40 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:40 devstack sudo[97192]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311.322155c6-7497-4ef3-a5de-28a235502bfd" returned: 0 in 0.542s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:40 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50649687-752c-424c-b998-005a65d29311(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:13:40 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[457b2660-47d9-4e69-a137-b251ca5d9f79]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:13:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:40 devstack sudo[97193]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-49bacc34-e181-4172-afd8-a51282321ad1 tempest-VolumesSnapshotListTestJSON-1857191141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734" returned: 0 in 0.565s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-49bacc34-e181-4172-afd8-a51282321ad1 tempest-VolumesSnapshotListTestJSON-1857191141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.bd997963-e12f-441f-99fa-e2719d9de6e2 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:40 devstack sudo[97205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.bd997963-e12f-441f-99fa-e2719d9de6e2
Nov 06 17:13:40 devstack sudo[97205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:40 devstack sudo[97204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311
Nov 06 17:13:40 devstack sudo[97204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:40 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-89395117-055b-49fb-8ee9-51d648c17aba tempest-VolumesGetTest-776201853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a3c87313-a014-41d0-b8ad-355a56b46858" returned: 0 in 0.510s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-89395117-055b-49fb-8ee9-51d648c17aba tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a3c87313-a014-41d0-b8ad-355a56b46858 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:40 devstack sudo[97212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a3c87313-a014-41d0-b8ad-355a56b46858
Nov 06 17:13:40 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:40 devstack sudo[97204]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311" returned: 0 in 0.465s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:40 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311 {{(pid=86856) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 06 17:13:40 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Creating direct copy from snapshot {{(pid=86856) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 06 17:13:40 devstack cinder-volume[86856]: DEBUG cinder.utils [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Path /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0535e428-04df-4783-9ba4-7ff9d13b6f4b not found in is_blk_device check {{(pid=86856) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 06 17:13:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0535e428-04df-4783-9ba4-7ff9d13b6f4b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:40 devstack sudo[97205]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-49bacc34-e181-4172-afd8-a51282321ad1 tempest-VolumesSnapshotListTestJSON-1857191141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.bd997963-e12f-441f-99fa-e2719d9de6e2" returned: 0 in 0.468s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-49bacc34-e181-4172-afd8-a51282321ad1 tempest-VolumesSnapshotListTestJSON-1857191141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.bd997963-e12f-441f-99fa-e2719d9de6e2 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:40 devstack sudo[97221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0535e428-04df-4783-9ba4-7ff9d13b6f4b
Nov 06 17:13:40 devstack sudo[97221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:40 devstack sudo[97222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.bd997963-e12f-441f-99fa-e2719d9de6e2
Nov 06 17:13:40 devstack sudo[97222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:40 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-89395117-055b-49fb-8ee9-51d648c17aba tempest-VolumesGetTest-776201853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a3c87313-a014-41d0-b8ad-355a56b46858" returned: 0 in 0.279s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:40 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-89395117-055b-49fb-8ee9-51d648c17aba tempest-VolumesGetTest-776201853 None] Lock "cinder-quobyte-a3c87313-a014-41d0-b8ad-355a56b46858" released by "delete_volume" :: held 0.853s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:40 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-89395117-055b-49fb-8ee9-51d648c17aba tempest-VolumesGetTest-776201853 None] Created reservations ['72cc809b-23ef-47be-b60f-0a074a4910a4', '832ed891-5749-4056-bf4d-5768814beae8', 'e9e31d25-4b95-4421-8ce6-1d1e0d59bb91', '35f6d903-05d5-4805-8963-639ed96b4826'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:13:41 devstack sudo[97222]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-49bacc34-e181-4172-afd8-a51282321ad1 tempest-VolumesSnapshotListTestJSON-1857191141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734.bd997963-e12f-441f-99fa-e2719d9de6e2" returned: 0 in 0.335s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:41 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-49bacc34-e181-4172-afd8-a51282321ad1 tempest-VolumesSnapshotListTestJSON-1857191141 None] Lock "cinder-quobyte-bd997963-e12f-441f-99fa-e2719d9de6e2" released by "_delete_snapshot" :: held 2.036s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:41 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-49bacc34-e181-4172-afd8-a51282321ad1 tempest-VolumesSnapshotListTestJSON-1857191141 None] Lock "cinder-quobyte-0f56e11e-bac6-4444-b6cb-6d75b45db734" released by "delete_snapshot" :: held 2.076s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-89395117-055b-49fb-8ee9-51d648c17aba tempest-VolumesGetTest-776201853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-89395117-055b-49fb-8ee9-51d648c17aba tempest-VolumesGetTest-776201853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:41 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-89395117-055b-49fb-8ee9-51d648c17aba tempest-VolumesGetTest-776201853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:13:41 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-89395117-055b-49fb-8ee9-51d648c17aba tempest-VolumesGetTest-776201853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:13:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-89395117-055b-49fb-8ee9-51d648c17aba tempest-VolumesGetTest-776201853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-89395117-055b-49fb-8ee9-51d648c17aba tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:41 devstack sudo[97240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:13:41 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:41 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-49bacc34-e181-4172-afd8-a51282321ad1 tempest-VolumesSnapshotListTestJSON-1857191141 None] Created reservations ['d34d4f3e-a262-4af3-8dbe-1562307574b0', '71263ea2-3a42-47c3-b738-1b815c71863d', 'c283bcbf-a231-4ebc-92e8-5c4e92500720', 'a2b40367-4a4f-4e85-9942-64632430b75f'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:13:41 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-89395117-055b-49fb-8ee9-51d648c17aba tempest-VolumesGetTest-776201853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.342s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:41 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-89395117-055b-49fb-8ee9-51d648c17aba tempest-VolumesGetTest-776201853 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:13:41 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-89395117-055b-49fb-8ee9-51d648c17aba tempest-VolumesGetTest-776201853 None] Deleted volume successfully.
Nov 06 17:13:42 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-49bacc34-e181-4172-afd8-a51282321ad1 tempest-VolumesSnapshotListTestJSON-1857191141 None] Delete snapshot completed successfully.
Nov 06 17:13:42 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-89395117-055b-49fb-8ee9-51d648c17aba tempest-VolumesGetTest-776201853 None] Lock "cinder-a3c87313-a014-41d0-b8ad-355a56b46858-delete_volume" released by "delete_volume" :: held 2.235s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:42 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-49bacc34-e181-4172-afd8-a51282321ad1 tempest-VolumesSnapshotListTestJSON-1857191141 None] Lock "cinder-bd997963-e12f-441f-99fa-e2719d9de6e2-delete_snapshot" released by "delete_snapshot" :: held 3.119s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:42 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:13:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:13:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:13:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:42 devstack sudo[97243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:13:42 devstack sudo[97243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:42 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7467f79a-bdcf-48e0-bb9f-4f2e64031ea8 tempest-VolumesGetTest-776201853 None] Acquiring lock "cinder-f9c530d6-35d7-4143-a95f-0cdefa528c4c-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:42 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-58752be9-b8f5-46c0-aeef-d23994e41059 tempest-VolumesSnapshotListTestJSON-1857191141 None] Acquiring lock "cinder-0f56e11e-bac6-4444-b6cb-6d75b45db734-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:42 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7467f79a-bdcf-48e0-bb9f-4f2e64031ea8 tempest-VolumesGetTest-776201853 None] Lock "cinder-f9c530d6-35d7-4143-a95f-0cdefa528c4c-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:43 devstack sudo[97243]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-58752be9-b8f5-46c0-aeef-d23994e41059 tempest-VolumesSnapshotListTestJSON-1857191141 None] Lock "cinder-0f56e11e-bac6-4444-b6cb-6d75b45db734-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.543s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:43 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:13:43 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager._thread_info {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:13:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread count: 28 {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 17:13:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread info: [<_MainThread(MainThread, started 125183137599616)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125183027608256)>, <Thread(Thread-3 (stat_writer), started daemon 125183025243776)>, <Thread(Rabbit-heartbeat, started daemon 125183023512896)>, <Thread(Thread-5 (_runner), started daemon 125183023357120)>, <Thread(Thread-7 (_runner), started daemon 125183021306496)>, <Thread(fd_logger, started daemon 125183018711616)>, <Thread(privsep_reader, started daemon 125183017484224)>, <Thread(tpool_thread_0, started daemon 125183013742272)>, <Thread(tpool_thread_1, started daemon 125183005349568)>, <Thread(tpool_thread_2, started daemon 125182996956864)>, <Thread(tpool_thread_3, started daemon 125182988564160)>, <Thread(tpool_thread_4, started daemon 125182980171456)>, <Thread(tpool_thread_5, started daemon 125182971778752)>, <Thread(tpool_thread_6, started daemon 125182963386048)>, <Thread(tpool_thread_7, started daemon 125182954993344)>, <Thread(tpool_thread_8, started daemon 125182946600640)>, <Thread(tpool_thread_9, started daemon 125182938207936)>, <Thread(tpool_thread_10, started daemon 125182929815232)>, <Thread(tpool_thread_11, started daemon 125182921422528)>, <Thread(tpool_thread_12, started daemon 125182913013440)>, <Thread(tpool_thread_13, started daemon 125182904604352)>, <Thread(tpool_thread_14, started daemon 125182896195264)>, <Thread(tpool_thread_15, started daemon 125182887786176)>, <Thread(tpool_thread_16, started daemon 125182879377088)>, <Thread(tpool_thread_17, started daemon 125182870968000)>, <Thread(tpool_thread_18, started daemon 125182862558912)>, <Thread(tpool_thread_19, started daemon 125182854149824)>] {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 17:13:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7467f79a-bdcf-48e0-bb9f-4f2e64031ea8 tempest-VolumesGetTest-776201853 None] Acquiring lock "cinder-quobyte-f9c530d6-35d7-4143-a95f-0cdefa528c4c" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7467f79a-bdcf-48e0-bb9f-4f2e64031ea8 tempest-VolumesGetTest-776201853 None] Lock "cinder-quobyte-f9c530d6-35d7-4143-a95f-0cdefa528c4c" acquired by "delete_volume" :: waited 0.022s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:43 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b40ac1-5195-4e51-b31c-1cc674bd1c88]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:13:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7467f79a-bdcf-48e0-bb9f-4f2e64031ea8 tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9c530d6-35d7-4143-a95f-0cdefa528c4c {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-58752be9-b8f5-46c0-aeef-d23994e41059 tempest-VolumesSnapshotListTestJSON-1857191141 None] Acquiring lock "cinder-quobyte-0f56e11e-bac6-4444-b6cb-6d75b45db734" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-58752be9-b8f5-46c0-aeef-d23994e41059 tempest-VolumesSnapshotListTestJSON-1857191141 None] Lock "cinder-quobyte-0f56e11e-bac6-4444-b6cb-6d75b45db734" acquired by "delete_volume" :: waited 0.037s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:43 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[e120b52c-10d6-4c32-8580-a883e523140e]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:13:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-58752be9-b8f5-46c0-aeef-d23994e41059 tempest-VolumesSnapshotListTestJSON-1857191141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:43 devstack sudo[97246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9c530d6-35d7-4143-a95f-0cdefa528c4c
Nov 06 17:13:43 devstack sudo[97246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:43 devstack sudo[97247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734
Nov 06 17:13:43 devstack sudo[97247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:43 devstack sudo[97246]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7467f79a-bdcf-48e0-bb9f-4f2e64031ea8 tempest-VolumesGetTest-776201853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9c530d6-35d7-4143-a95f-0cdefa528c4c" returned: 0 in 0.721s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7467f79a-bdcf-48e0-bb9f-4f2e64031ea8 tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9c530d6-35d7-4143-a95f-0cdefa528c4c {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:44 devstack sudo[97253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9c530d6-35d7-4143-a95f-0cdefa528c4c
Nov 06 17:13:44 devstack sudo[97253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:44 devstack sudo[97247]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-58752be9-b8f5-46c0-aeef-d23994e41059 tempest-VolumesSnapshotListTestJSON-1857191141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734" returned: 0 in 0.908s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-58752be9-b8f5-46c0-aeef-d23994e41059 tempest-VolumesSnapshotListTestJSON-1857191141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:44 devstack sudo[97293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734
Nov 06 17:13:44 devstack sudo[97293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:44 devstack sudo[97253]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7467f79a-bdcf-48e0-bb9f-4f2e64031ea8 tempest-VolumesGetTest-776201853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9c530d6-35d7-4143-a95f-0cdefa528c4c" returned: 0 in 0.566s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:44 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7467f79a-bdcf-48e0-bb9f-4f2e64031ea8 tempest-VolumesGetTest-776201853 None] Lock "cinder-quobyte-f9c530d6-35d7-4143-a95f-0cdefa528c4c" released by "delete_volume" :: held 1.390s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:44 devstack sudo[97293]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-58752be9-b8f5-46c0-aeef-d23994e41059 tempest-VolumesSnapshotListTestJSON-1857191141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0f56e11e-bac6-4444-b6cb-6d75b45db734" returned: 0 in 0.407s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:44 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-58752be9-b8f5-46c0-aeef-d23994e41059 tempest-VolumesSnapshotListTestJSON-1857191141 None] Lock "cinder-quobyte-0f56e11e-bac6-4444-b6cb-6d75b45db734" released by "delete_volume" :: held 1.456s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:44 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-7467f79a-bdcf-48e0-bb9f-4f2e64031ea8 tempest-VolumesGetTest-776201853 None] Created reservations ['5334013c-b845-4adf-abb4-157d5fc58022', '2b2876b5-6082-4b88-b9d2-27baba5dc3a0', '440fd55b-d59a-42ee-823c-fd4ac5e188e3', '0d91e5e4-0964-40b2-ac36-f6770c0f049a'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:13:45 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-58752be9-b8f5-46c0-aeef-d23994e41059 tempest-VolumesSnapshotListTestJSON-1857191141 None] Created reservations ['e0a80efc-291c-4229-93e9-d2749b95cbaf', '94964b70-b36f-4473-ac86-a4df3b4431e7', 'efd5b158-d60d-4ff0-8195-3a4fe465c9d3', 'cdeb586e-10b2-4020-b1a8-c3744c3877ad'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:13:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7467f79a-bdcf-48e0-bb9f-4f2e64031ea8 tempest-VolumesGetTest-776201853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7467f79a-bdcf-48e0-bb9f-4f2e64031ea8 tempest-VolumesGetTest-776201853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:45 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7467f79a-bdcf-48e0-bb9f-4f2e64031ea8 tempest-VolumesGetTest-776201853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:13:45 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7467f79a-bdcf-48e0-bb9f-4f2e64031ea8 tempest-VolumesGetTest-776201853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:13:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7467f79a-bdcf-48e0-bb9f-4f2e64031ea8 tempest-VolumesGetTest-776201853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7467f79a-bdcf-48e0-bb9f-4f2e64031ea8 tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:45 devstack sudo[97306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:13:45 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-58752be9-b8f5-46c0-aeef-d23994e41059 tempest-VolumesSnapshotListTestJSON-1857191141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-58752be9-b8f5-46c0-aeef-d23994e41059 tempest-VolumesSnapshotListTestJSON-1857191141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:45 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-58752be9-b8f5-46c0-aeef-d23994e41059 tempest-VolumesSnapshotListTestJSON-1857191141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:13:45 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-58752be9-b8f5-46c0-aeef-d23994e41059 tempest-VolumesSnapshotListTestJSON-1857191141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:13:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-58752be9-b8f5-46c0-aeef-d23994e41059 tempest-VolumesSnapshotListTestJSON-1857191141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-58752be9-b8f5-46c0-aeef-d23994e41059 tempest-VolumesSnapshotListTestJSON-1857191141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:45 devstack sudo[97308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:13:45 devstack sudo[97308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:45 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7467f79a-bdcf-48e0-bb9f-4f2e64031ea8 tempest-VolumesGetTest-776201853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.551s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:45 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-7467f79a-bdcf-48e0-bb9f-4f2e64031ea8 tempest-VolumesGetTest-776201853 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:13:45 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-7467f79a-bdcf-48e0-bb9f-4f2e64031ea8 tempest-VolumesGetTest-776201853 None] Deleted volume successfully.
Nov 06 17:13:46 devstack sudo[97308]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-58752be9-b8f5-46c0-aeef-d23994e41059 tempest-VolumesSnapshotListTestJSON-1857191141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.493s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:46 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-58752be9-b8f5-46c0-aeef-d23994e41059 tempest-VolumesSnapshotListTestJSON-1857191141 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:13:46 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-58752be9-b8f5-46c0-aeef-d23994e41059 tempest-VolumesSnapshotListTestJSON-1857191141 None] Deleted volume successfully.
Nov 06 17:13:46 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7467f79a-bdcf-48e0-bb9f-4f2e64031ea8 tempest-VolumesGetTest-776201853 None] Lock "cinder-f9c530d6-35d7-4143-a95f-0cdefa528c4c-delete_volume" released by "delete_volume" :: held 3.122s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:46 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-58752be9-b8f5-46c0-aeef-d23994e41059 tempest-VolumesSnapshotListTestJSON-1857191141 None] Lock "cinder-0f56e11e-bac6-4444-b6cb-6d75b45db734-delete_volume" released by "delete_volume" :: held 3.074s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:46 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6b4ec84-ac58-4d1a-8a53-9230ad73133c tempest-VolumesGetTest-776201853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:13:46 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a6b4ec84-ac58-4d1a-8a53-9230ad73133c tempest-VolumesGetTest-776201853 None] Flow 'volume_create_manager' (27261ab5-c55a-42c0-bf3e-54d4c0e37420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:13:46 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a6b4ec84-ac58-4d1a-8a53-9230ad73133c tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d55b2a58-23d4-46d8-8d03-3036c2970bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:46 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a6b4ec84-ac58-4d1a-8a53-9230ad73133c tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d55b2a58-23d4-46d8-8d03-3036c2970bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-814380809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=701493b7-b42b-4f0c-8d2a-1b7962d1444a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5791703ccd54989903afbe71d00e5b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:13:47Z,use_quota=True,user_id='f8538f1b84ba4958b1f532c455a030d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a6b4ec84-ac58-4d1a-8a53-9230ad73133c tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (715584b7-96b0-4e95-ac08-132dabe12f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a6b4ec84-ac58-4d1a-8a53-9230ad73133c tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (715584b7-96b0-4e95-ac08-132dabe12f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a6b4ec84-ac58-4d1a-8a53-9230ad73133c tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74cbd49c-4676-4088-ab1a-8276d2b0a919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a6b4ec84-ac58-4d1a-8a53-9230ad73133c tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74cbd49c-4676-4088-ab1a-8276d2b0a919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '701493b7-b42b-4f0c-8d2a-1b7962d1444a', 'volume_name': 'volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a6b4ec84-ac58-4d1a-8a53-9230ad73133c tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e273524-d865-443c-8fb4-dc0f8d63f628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a6b4ec84-ac58-4d1a-8a53-9230ad73133c tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e273524-d865-443c-8fb4-dc0f8d63f628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a6b4ec84-ac58-4d1a-8a53-9230ad73133c tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2889413-a3a7-4060-ae62-b98d548c855f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:47 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-a6b4ec84-ac58-4d1a-8a53-9230ad73133c tempest-VolumesGetTest-776201853 None] Volume 701493b7-b42b-4f0c-8d2a-1b7962d1444a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a', 'volume_size': 1}
Nov 06 17:13:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a6b4ec84-ac58-4d1a-8a53-9230ad73133c tempest-VolumesGetTest-776201853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:49 devstack sudo[97221]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0535e428-04df-4783-9ba4-7ff9d13b6f4b" returned: 0 in 8.971s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:49 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Image conversion details: src /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311, size 1024.00 MB, duration 8.97 sec, destination /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0535e428-04df-4783-9ba4-7ff9d13b6f4b {{(pid=86856) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 17:13:49 devstack cinder-volume[86856]: INFO cinder.image.image_utils [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Converted 1024.00 MB image at 114.14 MB/s
Nov 06 17:13:49 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0535e428-04df-4783-9ba4-7ff9d13b6f4b is being set with open permissions: ugo+rw
Nov 06 17:13:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0535e428-04df-4783-9ba4-7ff9d13b6f4b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:49 devstack sudo[97312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0535e428-04df-4783-9ba4-7ff9d13b6f4b
Nov 06 17:13:49 devstack sudo[97312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:49 devstack sudo[97312]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0535e428-04df-4783-9ba4-7ff9d13b6f4b" returned: 0 in 0.347s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:49 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-quobyte-0535e428-04df-4783-9ba4-7ff9d13b6f4b" released by "_copy_volume_from_snapshot" :: held 10.516s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:50 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-quobyte-322155c6-7497-4ef3-a5de-28a235502bfd-0535e428-04df-4783-9ba4-7ff9d13b6f4b" released by "_create_volume_from_snapshot" :: held 10.650s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.690s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a6b4ec84-ac58-4d1a-8a53-9230ad73133c tempest-VolumesGetTest-776201853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.947s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a6b4ec84-ac58-4d1a-8a53-9230ad73133c tempest-VolumesGetTest-776201853 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-814380809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=701493b7-b42b-4f0c-8d2a-1b7962d1444a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5791703ccd54989903afbe71d00e5b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:13:47Z,use_quota=True,user_id='f8538f1b84ba4958b1f532c455a030d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:13:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-a6b4ec84-ac58-4d1a-8a53-9230ad73133c tempest-VolumesGetTest-776201853 None] Creating volume 701493b7-b42b-4f0c-8d2a-1b7962d1444a {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:13:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a6b4ec84-ac58-4d1a-8a53-9230ad73133c tempest-VolumesGetTest-776201853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a6b4ec84-ac58-4d1a-8a53-9230ad73133c tempest-VolumesGetTest-776201853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a6b4ec84-ac58-4d1a-8a53-9230ad73133c tempest-VolumesGetTest-776201853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:13:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a6b4ec84-ac58-4d1a-8a53-9230ad73133c tempest-VolumesGetTest-776201853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:13:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a6b4ec84-ac58-4d1a-8a53-9230ad73133c tempest-VolumesGetTest-776201853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a6b4ec84-ac58-4d1a-8a53-9230ad73133c tempest-VolumesGetTest-776201853 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:13:50 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-a6b4ec84-ac58-4d1a-8a53-9230ad73133c tempest-VolumesGetTest-776201853 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:13:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a6b4ec84-ac58-4d1a-8a53-9230ad73133c tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:50 devstack sudo[97315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a 1073741824
Nov 06 17:13:50 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59c85145-337b-455e-af72-9cfa41698294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0535e428-04df-4783-9ba4-7ff9d13b6f4b', 'volume_size': 2, 'snapshot_id': '322155c6-7497-4ef3-a5de-28a235502bfd'}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb34443-8126-499b-bc96-6164aa9c49eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:50 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Volume volume-0535e428-04df-4783-9ba4-7ff9d13b6f4b (0535e428-04df-4783-9ba4-7ff9d13b6f4b): created successfully
Nov 06 17:13:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb34443-8126-499b-bc96-6164aa9c49eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Flow 'volume_create_manager' (995b9893-e8b1-4c34-8f87-e070ea5b8aa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:13:50 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-28c0e696-0acb-4a49-8535-bf26b7ba5674 tempest-VolumesSnapshotTestJSON-349969979 None] Created volume successfully.
Nov 06 17:13:50 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a6b4ec84-ac58-4d1a-8a53-9230ad73133c tempest-VolumesGetTest-776201853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a 1073741824" returned: 0 in 0.623s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:50 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1f8f9956-362b-46af-b167-e5fb7e8a4157 tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "cinder-0535e428-04df-4783-9ba4-7ff9d13b6f4b-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:50 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1f8f9956-362b-46af-b167-e5fb7e8a4157 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-0535e428-04df-4783-9ba4-7ff9d13b6f4b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a6b4ec84-ac58-4d1a-8a53-9230ad73133c tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:50 devstack sudo[97321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a
Nov 06 17:13:50 devstack sudo[97321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:50 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1f8f9956-362b-46af-b167-e5fb7e8a4157 tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "cinder-quobyte-0535e428-04df-4783-9ba4-7ff9d13b6f4b" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:50 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1f8f9956-362b-46af-b167-e5fb7e8a4157 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-quobyte-0535e428-04df-4783-9ba4-7ff9d13b6f4b" acquired by "delete_volume" :: waited 0.018s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:50 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e174970-3036-4b0f-8492-7a819a5b6e72]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:13:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1f8f9956-362b-46af-b167-e5fb7e8a4157 tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0535e428-04df-4783-9ba4-7ff9d13b6f4b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:51 devstack sudo[97323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0535e428-04df-4783-9ba4-7ff9d13b6f4b
Nov 06 17:13:51 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:51 devstack sudo[97321]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a6b4ec84-ac58-4d1a-8a53-9230ad73133c tempest-VolumesGetTest-776201853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a" returned: 0 in 0.377s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:51 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a6b4ec84-ac58-4d1a-8a53-9230ad73133c tempest-VolumesGetTest-776201853 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:13:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a6b4ec84-ac58-4d1a-8a53-9230ad73133c tempest-VolumesGetTest-776201853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a6b4ec84-ac58-4d1a-8a53-9230ad73133c tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2889413-a3a7-4060-ae62-b98d548c855f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a6b4ec84-ac58-4d1a-8a53-9230ad73133c tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20c902dd-b2e0-4462-881f-4581ccb61f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:51 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-a6b4ec84-ac58-4d1a-8a53-9230ad73133c tempest-VolumesGetTest-776201853 None] Volume volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a (701493b7-b42b-4f0c-8d2a-1b7962d1444a): created successfully
Nov 06 17:13:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a6b4ec84-ac58-4d1a-8a53-9230ad73133c tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20c902dd-b2e0-4462-881f-4581ccb61f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a6b4ec84-ac58-4d1a-8a53-9230ad73133c tempest-VolumesGetTest-776201853 None] Flow 'volume_create_manager' (27261ab5-c55a-42c0-bf3e-54d4c0e37420) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:13:51 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-a6b4ec84-ac58-4d1a-8a53-9230ad73133c tempest-VolumesGetTest-776201853 None] Created volume successfully.
Nov 06 17:13:51 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1f8f9956-362b-46af-b167-e5fb7e8a4157 tempest-VolumesSnapshotTestJSON-349969979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0535e428-04df-4783-9ba4-7ff9d13b6f4b" returned: 0 in 0.468s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1f8f9956-362b-46af-b167-e5fb7e8a4157 tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0535e428-04df-4783-9ba4-7ff9d13b6f4b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:51 devstack sudo[97331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0535e428-04df-4783-9ba4-7ff9d13b6f4b
Nov 06 17:13:51 devstack sudo[97331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:51 devstack sudo[97331]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1f8f9956-362b-46af-b167-e5fb7e8a4157 tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0535e428-04df-4783-9ba4-7ff9d13b6f4b" returned: 0 in 0.279s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:51 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1f8f9956-362b-46af-b167-e5fb7e8a4157 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-quobyte-0535e428-04df-4783-9ba4-7ff9d13b6f4b" released by "delete_volume" :: held 0.808s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:51 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-1f8f9956-362b-46af-b167-e5fb7e8a4157 tempest-VolumesSnapshotTestJSON-349969979 None] Created reservations ['d03ed00b-2ad4-4641-9ea1-61370cebd6b2', '5f9af8b4-f07a-4ca3-8f88-72b7a64d2218', 'f98dd645-f412-4f16-9e22-aa95bb790132', 'f861066b-8914-4130-9f96-224313f22b7e'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:13:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1f8f9956-362b-46af-b167-e5fb7e8a4157 tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1f8f9956-362b-46af-b167-e5fb7e8a4157 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:51 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1f8f9956-362b-46af-b167-e5fb7e8a4157 tempest-VolumesSnapshotTestJSON-349969979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:13:51 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1f8f9956-362b-46af-b167-e5fb7e8a4157 tempest-VolumesSnapshotTestJSON-349969979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:13:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1f8f9956-362b-46af-b167-e5fb7e8a4157 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1f8f9956-362b-46af-b167-e5fb7e8a4157 tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:51 devstack sudo[97334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:13:51 devstack sudo[97334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:52 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-81339f9a-4154-448d-98f6-b564626bb867 tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "cinder-322155c6-7497-4ef3-a5de-28a235502bfd-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:52 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-81339f9a-4154-448d-98f6-b564626bb867 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-322155c6-7497-4ef3-a5de-28a235502bfd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:52 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-81339f9a-4154-448d-98f6-b564626bb867 tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "cinder-quobyte-50649687-752c-424c-b998-005a65d29311" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:52 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-81339f9a-4154-448d-98f6-b564626bb867 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-quobyte-50649687-752c-424c-b998-005a65d29311" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:52 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-81339f9a-4154-448d-98f6-b564626bb867 tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "cinder-quobyte-322155c6-7497-4ef3-a5de-28a235502bfd" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:52 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-81339f9a-4154-448d-98f6-b564626bb867 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-quobyte-322155c6-7497-4ef3-a5de-28a235502bfd" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:52 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-81339f9a-4154-448d-98f6-b564626bb867 tempest-VolumesSnapshotTestJSON-349969979 None] Deleting offline snapshot 322155c6-7497-4ef3-a5de-28a235502bfd of volume 50649687-752c-424c-b998-005a65d29311 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:13:52 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-81339f9a-4154-448d-98f6-b564626bb867 tempest-VolumesSnapshotTestJSON-349969979 None] snapshot_file for this snap is: volume-50649687-752c-424c-b998-005a65d29311.322155c6-7497-4ef3-a5de-28a235502bfd {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:13:52 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[4719fefb-c296-47aa-8651-6ba13c41ceb2]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:13:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-81339f9a-4154-448d-98f6-b564626bb867 tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311.322155c6-7497-4ef3-a5de-28a235502bfd {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:52 devstack sudo[97334]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1f8f9956-362b-46af-b167-e5fb7e8a4157 tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.401s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:52 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-1f8f9956-362b-46af-b167-e5fb7e8a4157 tempest-VolumesSnapshotTestJSON-349969979 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:13:52 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-1f8f9956-362b-46af-b167-e5fb7e8a4157 tempest-VolumesSnapshotTestJSON-349969979 None] Deleted volume successfully.
Nov 06 17:13:52 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1f8f9956-362b-46af-b167-e5fb7e8a4157 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-0535e428-04df-4783-9ba4-7ff9d13b6f4b-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:52 devstack sudo[97337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311.322155c6-7497-4ef3-a5de-28a235502bfd
Nov 06 17:13:52 devstack sudo[97337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:52 devstack sudo[97337]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-81339f9a-4154-448d-98f6-b564626bb867 tempest-VolumesSnapshotTestJSON-349969979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311.322155c6-7497-4ef3-a5de-28a235502bfd" returned: 0 in 0.511s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:52 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-81339f9a-4154-448d-98f6-b564626bb867 tempest-VolumesSnapshotTestJSON-349969979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50649687-752c-424c-b998-005a65d29311(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:13:52 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd06a543-9161-454c-ac09-108f53773451]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:13:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-81339f9a-4154-448d-98f6-b564626bb867 tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:52 devstack sudo[97342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311
Nov 06 17:13:52 devstack sudo[97342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:53 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:13:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Flow 'volume_create_manager' (e1172127-e93f-4d65-81f3-977c8381cad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:13:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a06cd3-1abe-4840-9cca-adf79b328753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a06cd3-1abe-4840-9cca-adf79b328753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1869268730',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8abf4f40-439b-4469-8957-451ba687cf53,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f5791703ccd54989903afbe71d00e5b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=701493b7-b42b-4f0c-8d2a-1b7962d1444a,status='creating',terminated_at=None,updated_at=2026-11-06T16:13:53Z,use_quota=True,user_id='f8538f1b84ba4958b1f532c455a030d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (908b9698-a6eb-4c84-baae-ef87caa47fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (908b9698-a6eb-4c84-baae-ef87caa47fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9703991f-6e64-4740-a12c-80babf29be2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9703991f-6e64-4740-a12c-80babf29be2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8abf4f40-439b-4469-8957-451ba687cf53', 'volume_name': 'volume-8abf4f40-439b-4469-8957-451ba687cf53', 'volume_size': 1, 'source_volid': '701493b7-b42b-4f0c-8d2a-1b7962d1444a', 'source_volstatus': 'available'}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2858cd0-8c39-409f-b2da-35b3134128f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2858cd0-8c39-409f-b2da-35b3134128f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a6b7b3-ddda-41a0-a5fa-c7d5adcbe5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:53 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Volume 8abf4f40-439b-4469-8957-451ba687cf53: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8abf4f40-439b-4469-8957-451ba687cf53', 'volume_size': 1, 'source_volid': '701493b7-b42b-4f0c-8d2a-1b7962d1444a', 'source_volstatus': 'available'}
Nov 06 17:13:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:53 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Cloning volume 701493b7-b42b-4f0c-8d2a-1b7962d1444a to volume 8abf4f40-439b-4469-8957-451ba687cf53
Nov 06 17:13:53 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Creating offline snapshot 9935f0ef-6c65-49b5-92ab-55b8aefe13e3 of volume 701493b7-b42b-4f0c-8d2a-1b7962d1444a {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:13:53 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a58db0-23df-47ad-af42-1ddc51bd91e8]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:13:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:53 devstack sudo[97346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a
Nov 06 17:13:53 devstack sudo[97346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:53 devstack sudo[97342]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-81339f9a-4154-448d-98f6-b564626bb867 tempest-VolumesSnapshotTestJSON-349969979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311" returned: 0 in 0.733s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-81339f9a-4154-448d-98f6-b564626bb867 tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311.322155c6-7497-4ef3-a5de-28a235502bfd {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:53 devstack sudo[97350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311.322155c6-7497-4ef3-a5de-28a235502bfd
Nov 06 17:13:53 devstack sudo[97350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:53 devstack sudo[97346]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a" returned: 0 in 0.458s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a.9935f0ef-6c65-49b5-92ab-55b8aefe13e3 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:53 devstack sudo[97358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a.9935f0ef-6c65-49b5-92ab-55b8aefe13e3 1G
Nov 06 17:13:53 devstack sudo[97358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:54 devstack sudo[97350]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-81339f9a-4154-448d-98f6-b564626bb867 tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311.322155c6-7497-4ef3-a5de-28a235502bfd" returned: 0 in 0.477s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-81339f9a-4154-448d-98f6-b564626bb867 tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311.322155c6-7497-4ef3-a5de-28a235502bfd {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:54 devstack sudo[97361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311.322155c6-7497-4ef3-a5de-28a235502bfd
Nov 06 17:13:54 devstack sudo[97361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:54 devstack sudo[97361]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-81339f9a-4154-448d-98f6-b564626bb867 tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311.322155c6-7497-4ef3-a5de-28a235502bfd" returned: 0 in 0.319s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:54 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-81339f9a-4154-448d-98f6-b564626bb867 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-quobyte-322155c6-7497-4ef3-a5de-28a235502bfd" released by "_delete_snapshot" :: held 2.220s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:54 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-81339f9a-4154-448d-98f6-b564626bb867 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-quobyte-50649687-752c-424c-b998-005a65d29311" released by "delete_snapshot" :: held 2.262s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:54 devstack sudo[97358]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a.9935f0ef-6c65-49b5-92ab-55b8aefe13e3 1G" returned: 0 in 0.637s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a.9935f0ef-6c65-49b5-92ab-55b8aefe13e3 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:54 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-81339f9a-4154-448d-98f6-b564626bb867 tempest-VolumesSnapshotTestJSON-349969979 None] Created reservations ['e11d9725-0238-4723-9d2b-d00bd77a0cff', '2813e765-fe61-4800-bb23-6ad2d8734df3', '75030899-bc9f-4d57-b750-01a6250ea8a7', '1da91c61-0c0d-4f44-9ef3-18a4140db6f5'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:13:54 devstack sudo[97368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a.9935f0ef-6c65-49b5-92ab-55b8aefe13e3
Nov 06 17:13:54 devstack sudo[97368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:54 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-81339f9a-4154-448d-98f6-b564626bb867 tempest-VolumesSnapshotTestJSON-349969979 None] Delete snapshot completed successfully.
Nov 06 17:13:54 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-81339f9a-4154-448d-98f6-b564626bb867 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-322155c6-7497-4ef3-a5de-28a235502bfd-delete_snapshot" released by "delete_snapshot" :: held 2.453s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:54 devstack sudo[97368]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a.9935f0ef-6c65-49b5-92ab-55b8aefe13e3" returned: 0 in 0.331s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:54 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a.9935f0ef-6c65-49b5-92ab-55b8aefe13e3 is being set with open permissions: ugo+rw
Nov 06 17:13:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a.9935f0ef-6c65-49b5-92ab-55b8aefe13e3 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:54 devstack sudo[97373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a.9935f0ef-6c65-49b5-92ab-55b8aefe13e3
Nov 06 17:13:54 devstack sudo[97373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:54 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:13:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Flow 'volume_create_manager' (a9d095fe-4c41-4e4c-b9b4-0098dc234ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:13:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc807131-2e58-4c86-9363-37677c237516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc807131-2e58-4c86-9363-37677c237516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a7e649c-c15d-452e-aead-99fee335686e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f5e0633bb6c40a7b80690d0b726d863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:13:55Z,use_quota=True,user_id='7f56a1b568cf4e80a8136b7d77da134a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48b1361c-2d18-49b7-9e3d-e9345f35b5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48b1361c-2d18-49b7-9e3d-e9345f35b5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49a937b5-1505-43bf-874f-cd3c176902ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:54 devstack cinder-volume[86856]: DEBUG cinder.image.glance [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Creating Keystone auth plugin from conf {{(pid=86856) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 06 17:13:55 devstack sudo[97373]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a.9935f0ef-6c65-49b5-92ab-55b8aefe13e3" returned: 0 in 0.303s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:55 devstack sudo[97376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a.info
Nov 06 17:13:55 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49a937b5-1505-43bf-874f-cd3c176902ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1a7e649c-c15d-452e-aead-99fee335686e', 'volume_name': 'volume-1a7e649c-c15d-452e-aead-99fee335686e', 'volume_size': 1, 'image_id': '608d6f94-ded9-4f67-982e-7d8d90ed87ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/608d6f94-ded9-4f67-982e-7d8d90ed87ab', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f126c8574887832108941880af6262ac', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8f5e0633bb6c40a7b80690d0b726d863', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8c80dcf7bbf50b8483cde37ee80a0f01f60cf5d47e7d2d3a168ab581f94761bca7b56a19ca5f378f6baac25ee0df56d85b02eafcaf238819bae9c87965d56124', 'id': '608d6f94-ded9-4f67-982e-7d8d90ed87ab', 'created_at': datetime.datetime(2026, 11, 6, 16, 13, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 16, 13, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/608d6f94-ded9-4f67-982e-7d8d90ed87ab/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x71da66e799d0>}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80386eee-e921-4f15-9341-472dad1f1bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80386eee-e921-4f15-9341-472dad1f1bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c737b24-a25c-4311-9874-3178ab2baf6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:55 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Volume 1a7e649c-c15d-452e-aead-99fee335686e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1a7e649c-c15d-452e-aead-99fee335686e', 'volume_size': 1, 'image_id': '608d6f94-ded9-4f67-982e-7d8d90ed87ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/608d6f94-ded9-4f67-982e-7d8d90ed87ab', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f126c8574887832108941880af6262ac', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8f5e0633bb6c40a7b80690d0b726d863', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8c80dcf7bbf50b8483cde37ee80a0f01f60cf5d47e7d2d3a168ab581f94761bca7b56a19ca5f378f6baac25ee0df56d85b02eafcaf238819bae9c87965d56124', 'id': '608d6f94-ded9-4f67-982e-7d8d90ed87ab', 'created_at': datetime.datetime(2026, 11, 6, 16, 13, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 16, 13, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/608d6f94-ded9-4f67-982e-7d8d90ed87ab/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x71da66e799d0>}
Nov 06 17:13:55 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Trying to clone 1a7e649c-c15d-452e-aead-99fee335686e from image 608d6f94-ded9-4f67-982e-7d8d90ed87ab at location (None, [{'url': 'file:///opt/stack/data/glance/images/608d6f94-ded9-4f67-982e-7d8d90ed87ab', 'metadata': {}}]). {{(pid=86856) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 06 17:13:55 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a.info" returned: 0 in 0.308s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:55 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a.info is being set with open permissions: ugo+rw
Nov 06 17:13:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:55 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-96f021c9-809e-48d8-8498-82aab367b36c tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "cinder-50649687-752c-424c-b998-005a65d29311-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:55 devstack sudo[97379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a.info
Nov 06 17:13:55 devstack sudo[97379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:55 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_608d6f94-ded9-4f67-982e-7d8d90ed87ab_ekfpiy1adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86856) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 06 17:13:55 devstack cinder-volume[86856]: INFO cinder.image.image_utils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Image download 0.00 MB at 0.00 MB/s
Nov 06 17:13:55 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-96f021c9-809e-48d8-8498-82aab367b36c tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-50649687-752c-424c-b998-005a65d29311-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:55 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-96f021c9-809e-48d8-8498-82aab367b36c tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "cinder-quobyte-50649687-752c-424c-b998-005a65d29311" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:55 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ea3668-b1d5-4601-9208-94f8b5231dba]: (4, 'raw') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:13:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_608d6f94-ded9-4f67-982e-7d8d90ed87ab_ekfpiy1adevstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:55 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-96f021c9-809e-48d8-8498-82aab367b36c tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-quobyte-50649687-752c-424c-b998-005a65d29311" acquired by "delete_volume" :: waited 0.040s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:55 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae84e2c-a319-4d69-9f8e-eee218e9d310]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:13:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-96f021c9-809e-48d8-8498-82aab367b36c tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:55 devstack sudo[97379]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a.info" returned: 0 in 0.318s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:55 devstack sudo[97381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_608d6f94-ded9-4f67-982e-7d8d90ed87ab_ekfpiy1adevstack@QuobyteHD
Nov 06 17:13:55 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:55 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Acquiring lock "cinder-quobyte-8abf4f40-439b-4469-8957-451ba687cf53" by "_copy_volume_from_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:13:55 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Lock "cinder-quobyte-8abf4f40-439b-4469-8957-451ba687cf53" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:13:55 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] snapshot: 9935f0ef-6c65-49b5-92ab-55b8aefe13e3, volume: 8abf4f40-439b-4469-8957-451ba687cf53,  {{(pid=86856) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 06 17:13:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:55 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:13:55 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:13:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:55 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e03c3cd-dad2-489e-87f0-c29e5851a519]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:13:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a.9935f0ef-6c65-49b5-92ab-55b8aefe13e3 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:55 devstack sudo[97383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311
Nov 06 17:13:55 devstack sudo[97383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:56 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_608d6f94-ded9-4f67-982e-7d8d90ed87ab_ekfpiy1adevstack@QuobyteHD" returned: 0 in 0.406s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_608d6f94-ded9-4f67-982e-7d8d90ed87ab_ekfpiy1adevstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:56 devstack sudo[97385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a.9935f0ef-6c65-49b5-92ab-55b8aefe13e3
Nov 06 17:13:56 devstack sudo[97385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:56 devstack sudo[97391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_608d6f94-ded9-4f67-982e-7d8d90ed87ab_ekfpiy1adevstack@QuobyteHD
Nov 06 17:13:56 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:56 devstack sudo[97383]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-96f021c9-809e-48d8-8498-82aab367b36c tempest-VolumesSnapshotTestJSON-349969979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311" returned: 0 in 0.499s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-96f021c9-809e-48d8-8498-82aab367b36c tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:56 devstack sudo[97397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311
Nov 06 17:13:56 devstack sudo[97397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:56 devstack sudo[97385]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a.9935f0ef-6c65-49b5-92ab-55b8aefe13e3" returned: 0 in 0.507s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:56 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:13:56 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df25756-c2ba-41cb-a649-ea9cf1825ce8]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:13:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:56 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_608d6f94-ded9-4f67-982e-7d8d90ed87ab_ekfpiy1adevstack@QuobyteHD" returned: 1 in 0.403s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_608d6f94-ded9-4f67-982e-7d8d90ed87ab_ekfpiy1adevstack@QuobyteHD' failed. Not Retrying. {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 17:13:56 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Temporary image 608d6f94-ded9-4f67-982e-7d8d90ed87ab is fetched for user 7f56a1b568cf4e80a8136b7d77da134a. {{(pid=86856) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 06 17:13:56 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab60e838-7ec6-4520-802f-d0457af10994]: (4, 'raw') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:13:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_608d6f94-ded9-4f67-982e-7d8d90ed87ab_ekfpiy1adevstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:56 devstack sudo[97397]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:56 devstack sudo[97406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a
Nov 06 17:13:56 devstack sudo[97406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-96f021c9-809e-48d8-8498-82aab367b36c tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-50649687-752c-424c-b998-005a65d29311" returned: 0 in 0.327s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:56 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-96f021c9-809e-48d8-8498-82aab367b36c tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-quobyte-50649687-752c-424c-b998-005a65d29311" released by "delete_volume" :: held 0.940s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:56 devstack sudo[97409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_608d6f94-ded9-4f67-982e-7d8d90ed87ab_ekfpiy1adevstack@QuobyteHD
Nov 06 17:13:56 devstack sudo[97409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:56 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-96f021c9-809e-48d8-8498-82aab367b36c tempest-VolumesSnapshotTestJSON-349969979 None] Created reservations ['e72c10e2-e329-4f3c-93fc-3efcf09eaa22', '504bb21f-673b-4358-bde7-988b11208318', 'c7120b18-1e69-4273-8407-3cfc53e79c0d', 'd24f30b1-713b-4216-abeb-eb8d773c5a6c'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:13:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-96f021c9-809e-48d8-8498-82aab367b36c tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-96f021c9-809e-48d8-8498-82aab367b36c tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:13:56 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-96f021c9-809e-48d8-8498-82aab367b36c tempest-VolumesSnapshotTestJSON-349969979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:13:56 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-96f021c9-809e-48d8-8498-82aab367b36c tempest-VolumesSnapshotTestJSON-349969979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:13:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-96f021c9-809e-48d8-8498-82aab367b36c tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:13:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-96f021c9-809e-48d8-8498-82aab367b36c tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:56 devstack sudo[97413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:13:56 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:57 devstack sudo[97406]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a" returned: 0 in 0.597s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:57 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a {{(pid=86856) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 06 17:13:57 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Creating direct copy from snapshot {{(pid=86856) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 06 17:13:57 devstack cinder-volume[86856]: DEBUG cinder.utils [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Path /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8abf4f40-439b-4469-8957-451ba687cf53 not found in is_blk_device check {{(pid=86856) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 06 17:13:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8abf4f40-439b-4469-8957-451ba687cf53 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:57 devstack sudo[97417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8abf4f40-439b-4469-8957-451ba687cf53
Nov 06 17:13:57 devstack sudo[97417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:57 devstack sudo[97409]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_608d6f94-ded9-4f67-982e-7d8d90ed87ab_ekfpiy1adevstack@QuobyteHD" returned: 0 in 0.536s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_608d6f94-ded9-4f67-982e-7d8d90ed87ab_ekfpiy1adevstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:13:57 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-96f021c9-809e-48d8-8498-82aab367b36c tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.308s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:57 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-96f021c9-809e-48d8-8498-82aab367b36c tempest-VolumesSnapshotTestJSON-349969979 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:13:57 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-96f021c9-809e-48d8-8498-82aab367b36c tempest-VolumesSnapshotTestJSON-349969979 None] Deleted volume successfully.
Nov 06 17:13:57 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-96f021c9-809e-48d8-8498-82aab367b36c tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-50649687-752c-424c-b998-005a65d29311-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:13:57 devstack sudo[97420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_608d6f94-ded9-4f67-982e-7d8d90ed87ab_ekfpiy1adevstack@QuobyteHD
Nov 06 17:13:57 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:13:57 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root
Nov 06 17:13:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_608d6f94-ded9-4f67-982e-7d8d90ed87ab_ekfpiy1adevstack@QuobyteHD" returned: 1 in 0.433s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:13:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_608d6f94-ded9-4f67-982e-7d8d90ed87ab_ekfpiy1adevstack@QuobyteHD' failed. Not Retrying. {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 17:13:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:13:59 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-290d248d-d057-4759-b17a-6e68185e99cf tempest-VolumesSnapshotTestJSON-349969979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:13:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-290d248d-d057-4759-b17a-6e68185e99cf tempest-VolumesSnapshotTestJSON-349969979 None] Flow 'volume_create_manager' (7fa7bf85-aab4-4b85-8176-7c56738063a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:13:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-290d248d-d057-4759-b17a-6e68185e99cf tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f99813d6-e49a-44ca-a422-fafcff6ae540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-290d248d-d057-4759-b17a-6e68185e99cf tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f99813d6-e49a-44ca-a422-fafcff6ae540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-256868936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=726a33a5-1e4c-4d35-9527-3ea7dfe5bb55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d8e6498df64229af85d96b1e8116f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:13:59Z,use_quota=True,user_id='f9e67809a7954e01a5321acb51af70fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-290d248d-d057-4759-b17a-6e68185e99cf tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19ee559b-adab-4e0e-98ee-b1d4f28fd594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-290d248d-d057-4759-b17a-6e68185e99cf tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19ee559b-adab-4e0e-98ee-b1d4f28fd594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-290d248d-d057-4759-b17a-6e68185e99cf tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74d22c31-7a3c-41a5-a953-4f9987837479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-290d248d-d057-4759-b17a-6e68185e99cf tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74d22c31-7a3c-41a5-a953-4f9987837479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '726a33a5-1e4c-4d35-9527-3ea7dfe5bb55', 'volume_name': 'volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-290d248d-d057-4759-b17a-6e68185e99cf tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c6c29ce-ddff-48d7-945a-d9bcda8726ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-290d248d-d057-4759-b17a-6e68185e99cf tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c6c29ce-ddff-48d7-945a-d9bcda8726ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:13:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-290d248d-d057-4759-b17a-6e68185e99cf tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9f47a28-7370-41cb-9f80-d5d6c2bbd4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:13:59 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-290d248d-d057-4759-b17a-6e68185e99cf tempest-VolumesSnapshotTestJSON-349969979 None] Volume 726a33a5-1e4c-4d35-9527-3ea7dfe5bb55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55', 'volume_size': 1}
Nov 06 17:13:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-290d248d-d057-4759-b17a-6e68185e99cf tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:03 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-5428a3a0-e23c-4768-8002-610d397cbacc tempest-TestInstancesWithCinderVolumes-52000996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:14:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5428a3a0-e23c-4768-8002-610d397cbacc tempest-TestInstancesWithCinderVolumes-52000996 None] Flow 'volume_create_manager' (9b96d074-6684-4681-beea-882d7b3d2e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:14:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5428a3a0-e23c-4768-8002-610d397cbacc tempest-TestInstancesWithCinderVolumes-52000996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c97dba73-4aa2-4bc0-82b4-543d52de1a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5428a3a0-e23c-4768-8002-610d397cbacc tempest-TestInstancesWithCinderVolumes-52000996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c97dba73-4aa2-4bc0-82b4-543d52de1a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-189523985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec8c9fe-9276-4d89-848f-52cef29e59bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6978a98141224ef1a9980ba9c2323a4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:14:03Z,use_quota=True,user_id='17722e39449b4ba6acadf4f37a9311e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81fced70-81f0-4517-b029-abc3cf5a1a97),volume_type_id=81fced70-81f0-4517-b029-abc3cf5a1a97)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5428a3a0-e23c-4768-8002-610d397cbacc tempest-TestInstancesWithCinderVolumes-52000996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f019c85-2bd2-4242-8303-2992e7ff533f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5428a3a0-e23c-4768-8002-610d397cbacc tempest-TestInstancesWithCinderVolumes-52000996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f019c85-2bd2-4242-8303-2992e7ff533f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5428a3a0-e23c-4768-8002-610d397cbacc tempest-TestInstancesWithCinderVolumes-52000996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc6e92ca-8860-4f69-b5ad-3ac87db40812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5428a3a0-e23c-4768-8002-610d397cbacc tempest-TestInstancesWithCinderVolumes-52000996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc6e92ca-8860-4f69-b5ad-3ac87db40812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bec8c9fe-9276-4d89-848f-52cef29e59bb', 'volume_name': 'volume-bec8c9fe-9276-4d89-848f-52cef29e59bb', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5428a3a0-e23c-4768-8002-610d397cbacc tempest-TestInstancesWithCinderVolumes-52000996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1530037d-0e4a-429b-aa50-787181dd904b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5428a3a0-e23c-4768-8002-610d397cbacc tempest-TestInstancesWithCinderVolumes-52000996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1530037d-0e4a-429b-aa50-787181dd904b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5428a3a0-e23c-4768-8002-610d397cbacc tempest-TestInstancesWithCinderVolumes-52000996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87de48b0-161d-4e83-a2fa-abc34f9d65a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:03 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-5428a3a0-e23c-4768-8002-610d397cbacc tempest-TestInstancesWithCinderVolumes-52000996 None] Volume bec8c9fe-9276-4d89-848f-52cef29e59bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bec8c9fe-9276-4d89-848f-52cef29e59bb', 'volume_size': 1}
Nov 06 17:14:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5428a3a0-e23c-4768-8002-610d397cbacc tempest-TestInstancesWithCinderVolumes-52000996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:03 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d9abd00-182e-4a40-9d00-aa66a5adfab8 tempest-TestInstancesWithCinderVolumes-52000996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:14:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4d9abd00-182e-4a40-9d00-aa66a5adfab8 tempest-TestInstancesWithCinderVolumes-52000996 None] Flow 'volume_create_manager' (6d107864-adf4-4888-b674-09d061b0209f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:14:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4d9abd00-182e-4a40-9d00-aa66a5adfab8 tempest-TestInstancesWithCinderVolumes-52000996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe370917-4c85-418e-905f-6a6c69582255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4d9abd00-182e-4a40-9d00-aa66a5adfab8 tempest-TestInstancesWithCinderVolumes-52000996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe370917-4c85-418e-905f-6a6c69582255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1190964794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c84613a1-b87a-4613-ab2f-4860fcbd6102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6978a98141224ef1a9980ba9c2323a4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:14:04Z,use_quota=True,user_id='17722e39449b4ba6acadf4f37a9311e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cde46a67-8f50-4538-a6aa-5d3c3c59663b),volume_type_id=cde46a67-8f50-4538-a6aa-5d3c3c59663b)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4d9abd00-182e-4a40-9d00-aa66a5adfab8 tempest-TestInstancesWithCinderVolumes-52000996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8057d700-b4bd-4d14-8efe-444269220763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4d9abd00-182e-4a40-9d00-aa66a5adfab8 tempest-TestInstancesWithCinderVolumes-52000996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8057d700-b4bd-4d14-8efe-444269220763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4d9abd00-182e-4a40-9d00-aa66a5adfab8 tempest-TestInstancesWithCinderVolumes-52000996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5a0df6c-6bca-4fbb-b6de-b2cd7ae472cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4d9abd00-182e-4a40-9d00-aa66a5adfab8 tempest-TestInstancesWithCinderVolumes-52000996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5a0df6c-6bca-4fbb-b6de-b2cd7ae472cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c84613a1-b87a-4613-ab2f-4860fcbd6102', 'volume_name': 'volume-c84613a1-b87a-4613-ab2f-4860fcbd6102', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4d9abd00-182e-4a40-9d00-aa66a5adfab8 tempest-TestInstancesWithCinderVolumes-52000996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (949184fb-4d44-4519-abde-387758bae371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4d9abd00-182e-4a40-9d00-aa66a5adfab8 tempest-TestInstancesWithCinderVolumes-52000996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (949184fb-4d44-4519-abde-387758bae371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4d9abd00-182e-4a40-9d00-aa66a5adfab8 tempest-TestInstancesWithCinderVolumes-52000996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c199d703-6bd8-4535-9348-3fcd474a24ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:03 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-4d9abd00-182e-4a40-9d00-aa66a5adfab8 tempest-TestInstancesWithCinderVolumes-52000996 None] Volume c84613a1-b87a-4613-ab2f-4860fcbd6102: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c84613a1-b87a-4613-ab2f-4860fcbd6102', 'volume_size': 1}
Nov 06 17:14:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4d9abd00-182e-4a40-9d00-aa66a5adfab8 tempest-TestInstancesWithCinderVolumes-52000996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:04 devstack sudo[97417]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8abf4f40-439b-4469-8957-451ba687cf53" returned: 0 in 7.675s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:04 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Image conversion details: src /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a, size 1024.00 MB, duration 7.68 sec, destination /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8abf4f40-439b-4469-8957-451ba687cf53 {{(pid=86856) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 17:14:04 devstack cinder-volume[86856]: INFO cinder.image.image_utils [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Converted 1024.00 MB image at 133.39 MB/s
Nov 06 17:14:04 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8abf4f40-439b-4469-8957-451ba687cf53 is being set with open permissions: ugo+rw
Nov 06 17:14:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8abf4f40-439b-4469-8957-451ba687cf53 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:04 devstack sudo[97438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8abf4f40-439b-4469-8957-451ba687cf53
Nov 06 17:14:04 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:04 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:14:04 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Flow 'volume_create_manager' (9590e240-fc0f-4e2a-846c-3476a95b4c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:14:04 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9284e8e7-779f-4f9a-94cc-d485072f27bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:04 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9284e8e7-779f-4f9a-94cc-d485072f27bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-316340171',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3a70268-1141-4755-9650-fd29871330f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6978a98141224ef1a9980ba9c2323a4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:14:05Z,use_quota=True,user_id='17722e39449b4ba6acadf4f37a9311e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5238534a-38ba-43eb-bb15-be2272252f3d),volume_type_id=5238534a-38ba-43eb-bb15-be2272252f3d)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:04 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f5490b5-ccaa-4660-9ba7-66fbba372941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:04 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f5490b5-ccaa-4660-9ba7-66fbba372941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:04 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2f4371c-85d8-4719-a0e3-1fba1412180e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:04 devstack cinder-volume[86856]: DEBUG cinder.image.glance [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Creating Keystone auth plugin from conf {{(pid=86856) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 06 17:14:04 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8abf4f40-439b-4469-8957-451ba687cf53" returned: 0 in 0.255s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:04 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Lock "cinder-quobyte-8abf4f40-439b-4469-8957-451ba687cf53" released by "_copy_volume_from_snapshot" :: held 9.136s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:05 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Acquiring lock "cinder-quobyte-9935f0ef-6c65-49b5-92ab-55b8aefe13e3" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:05 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Lock "cinder-quobyte-9935f0ef-6c65-49b5-92ab-55b8aefe13e3" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:05 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Deleting offline snapshot 9935f0ef-6c65-49b5-92ab-55b8aefe13e3 of volume 701493b7-b42b-4f0c-8d2a-1b7962d1444a {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:14:05 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] snapshot_file for this snap is: volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a.9935f0ef-6c65-49b5-92ab-55b8aefe13e3 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:14:05 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[56118f2f-c9ef-458b-8650-aaeeeb5331b1]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:14:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a.9935f0ef-6c65-49b5-92ab-55b8aefe13e3 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:05 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2f4371c-85d8-4719-a0e3-1fba1412180e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b3a70268-1141-4755-9650-fd29871330f2', 'volume_name': 'volume-b3a70268-1141-4755-9650-fd29871330f2', 'volume_size': 1, 'image_id': 'cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--652235432', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6978a98141224ef1a9980ba9c2323a4f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2', 'created_at': datetime.datetime(2026, 11, 6, 16, 13, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 16, 14, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x71da66fe95b0>}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:05 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa31d798-19a9-49d4-966f-d86158f1f7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:05 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa31d798-19a9-49d4-966f-d86158f1f7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:05 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44a86ed0-a007-42b7-9da0-faefdd7a892f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:05 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Volume b3a70268-1141-4755-9650-fd29871330f2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b3a70268-1141-4755-9650-fd29871330f2', 'volume_size': 1, 'image_id': 'cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--652235432', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6978a98141224ef1a9980ba9c2323a4f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2', 'created_at': datetime.datetime(2026, 11, 6, 16, 13, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 16, 14, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x71da66fe95b0>}
Nov 06 17:14:05 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Trying to clone b3a70268-1141-4755-9650-fd29871330f2 from image cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2', 'metadata': {}}]). {{(pid=86856) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 06 17:14:05 devstack sudo[97441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a.9935f0ef-6c65-49b5-92ab-55b8aefe13e3
Nov 06 17:14:05 devstack sudo[97441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:05 devstack sudo[97441]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a.9935f0ef-6c65-49b5-92ab-55b8aefe13e3" returned: 0 in 0.387s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:05 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:14:05 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[723b94fc-e0d4-44f8-a312-f7dfb364121b]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:14:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:05 devstack sudo[97446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a
Nov 06 17:14:05 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:06 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a" returned: 0 in 0.560s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a.9935f0ef-6c65-49b5-92ab-55b8aefe13e3 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:06 devstack sudo[97451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a.9935f0ef-6c65-49b5-92ab-55b8aefe13e3
Nov 06 17:14:06 devstack sudo[97451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:06 devstack sudo[97451]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a.9935f0ef-6c65-49b5-92ab-55b8aefe13e3" returned: 0 in 0.337s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a.9935f0ef-6c65-49b5-92ab-55b8aefe13e3 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:06 devstack sudo[97457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a.9935f0ef-6c65-49b5-92ab-55b8aefe13e3
Nov 06 17:14:06 devstack sudo[97457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:06 devstack sudo[97457]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a.9935f0ef-6c65-49b5-92ab-55b8aefe13e3" returned: 0 in 0.250s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:06 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Lock "cinder-quobyte-9935f0ef-6c65-49b5-92ab-55b8aefe13e3" released by "_delete_snapshot" :: held 1.642s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.475s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.175s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:06 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a7e649c-c15d-452e-aead-99fee335686e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f5e0633bb6c40a7b80690d0b726d863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:13:55Z,use_quota=True,user_id='7f56a1b568cf4e80a8136b7d77da134a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:14:06 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Creating volume 1a7e649c-c15d-452e-aead-99fee335686e {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:14:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:06 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:14:06 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:14:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:06 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:14:06 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:14:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a7e649c-c15d-452e-aead-99fee335686e 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:06 devstack sudo[97460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a7e649c-c15d-452e-aead-99fee335686e 1073741824
Nov 06 17:14:06 devstack sudo[97460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a6b7b3-ddda-41a0-a5fa-c7d5adcbe5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8abf4f40-439b-4469-8957-451ba687cf53', 'volume_size': 1, 'source_volid': '701493b7-b42b-4f0c-8d2a-1b7962d1444a', 'source_volstatus': 'available'}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35a7d0ee-9e5a-4f12-8aad-e3c860dbe560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:06 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Volume volume-8abf4f40-439b-4469-8957-451ba687cf53 (8abf4f40-439b-4469-8957-451ba687cf53): created successfully
Nov 06 17:14:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35a7d0ee-9e5a-4f12-8aad-e3c860dbe560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Flow 'volume_create_manager' (e1172127-e93f-4d65-81f3-977c8381cad8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:14:06 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-1cb1cc2f-5507-4849-84fe-f17f0f023a75 tempest-VolumesGetTest-776201853 None] Created volume successfully.
Nov 06 17:14:07 devstack sudo[97460]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a7e649c-c15d-452e-aead-99fee335686e 1073741824" returned: 0 in 0.475s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a7e649c-c15d-452e-aead-99fee335686e {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:07 devstack sudo[97466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a7e649c-c15d-452e-aead-99fee335686e
Nov 06 17:14:07 devstack sudo[97466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:07 devstack sudo[97466]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a7e649c-c15d-452e-aead-99fee335686e" returned: 0 in 0.280s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:07 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:14:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-290d248d-d057-4759-b17a-6e68185e99cf tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.221s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:07 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-290d248d-d057-4759-b17a-6e68185e99cf tempest-VolumesSnapshotTestJSON-349969979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-256868936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=726a33a5-1e4c-4d35-9527-3ea7dfe5bb55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d8e6498df64229af85d96b1e8116f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:13:59Z,use_quota=True,user_id='f9e67809a7954e01a5321acb51af70fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:14:07 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-290d248d-d057-4759-b17a-6e68185e99cf tempest-VolumesSnapshotTestJSON-349969979 None] Creating volume 726a33a5-1e4c-4d35-9527-3ea7dfe5bb55 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:14:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-290d248d-d057-4759-b17a-6e68185e99cf tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-290d248d-d057-4759-b17a-6e68185e99cf tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:07 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-290d248d-d057-4759-b17a-6e68185e99cf tempest-VolumesSnapshotTestJSON-349969979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:14:07 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-290d248d-d057-4759-b17a-6e68185e99cf tempest-VolumesSnapshotTestJSON-349969979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:14:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-290d248d-d057-4759-b17a-6e68185e99cf tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:07 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-290d248d-d057-4759-b17a-6e68185e99cf tempest-VolumesSnapshotTestJSON-349969979 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:14:07 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-290d248d-d057-4759-b17a-6e68185e99cf tempest-VolumesSnapshotTestJSON-349969979 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:14:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-290d248d-d057-4759-b17a-6e68185e99cf tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:07 devstack sudo[97469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55 1073741824
Nov 06 17:14:07 devstack sudo[97469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:07 devstack cinder-volume[86856]: DEBUG cinder.volume.volume_utils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Attempting download of 608d6f94-ded9-4f67-982e-7d8d90ed87ab ((None, [{'url': 'file:///opt/stack/data/glance/images/608d6f94-ded9-4f67-982e-7d8d90ed87ab', 'metadata': {}}])) to volume 1a7e649c-c15d-452e-aead-99fee335686e. {{(pid=86856) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 06 17:14:07 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cac58a-3b0c-4ac5-a1ac-96de8fdc104d]: (4, 'raw') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:14:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_608d6f94-ded9-4f67-982e-7d8d90ed87ab_0np_9y2g {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:07 devstack sudo[97471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_608d6f94-ded9-4f67-982e-7d8d90ed87ab_0np_9y2g
Nov 06 17:14:07 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:08 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-7edb1bcb-bf4f-487d-afe3-c22a32102cc8 tempest-VolumesGetTest-776201853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:14:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7edb1bcb-bf4f-487d-afe3-c22a32102cc8 tempest-VolumesGetTest-776201853 None] Flow 'volume_create_manager' (31dcf644-befe-474f-b32c-82f62a0935db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:14:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7edb1bcb-bf4f-487d-afe3-c22a32102cc8 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (978762ba-3274-4cd8-acec-c5e91a9b12ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7edb1bcb-bf4f-487d-afe3-c22a32102cc8 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (978762ba-3274-4cd8-acec-c5e91a9b12ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:14:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1244401737',display_name='tempest-VolumesGetTest-Volume-125928806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b4b48c7-fcba-492f-917a-722f4480b832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5791703ccd54989903afbe71d00e5b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:14:08Z,use_quota=True,user_id='f8538f1b84ba4958b1f532c455a030d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7edb1bcb-bf4f-487d-afe3-c22a32102cc8 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a832e1d-ef5d-4ae4-9f6f-fa2bbb911cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7edb1bcb-bf4f-487d-afe3-c22a32102cc8 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a832e1d-ef5d-4ae4-9f6f-fa2bbb911cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7edb1bcb-bf4f-487d-afe3-c22a32102cc8 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca15ffb4-cb2a-4604-8c77-0524f53b1c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7edb1bcb-bf4f-487d-afe3-c22a32102cc8 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca15ffb4-cb2a-4604-8c77-0524f53b1c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b4b48c7-fcba-492f-917a-722f4480b832', 'volume_name': 'volume-8b4b48c7-fcba-492f-917a-722f4480b832', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7edb1bcb-bf4f-487d-afe3-c22a32102cc8 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74b15844-025b-4e42-93b0-df0d611c87f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7edb1bcb-bf4f-487d-afe3-c22a32102cc8 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74b15844-025b-4e42-93b0-df0d611c87f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:08 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7edb1bcb-bf4f-487d-afe3-c22a32102cc8 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02f09980-4139-4711-8f0b-cf73f726d4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:08 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-7edb1bcb-bf4f-487d-afe3-c22a32102cc8 tempest-VolumesGetTest-776201853 None] Volume 8b4b48c7-fcba-492f-917a-722f4480b832: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b4b48c7-fcba-492f-917a-722f4480b832', 'volume_size': 1}
Nov 06 17:14:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7edb1bcb-bf4f-487d-afe3-c22a32102cc8 tempest-VolumesGetTest-776201853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_608d6f94-ded9-4f67-982e-7d8d90ed87ab_0np_9y2g" returned: 0 in 0.542s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_608d6f94-ded9-4f67-982e-7d8d90ed87ab_0np_9y2g {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:08 devstack sudo[97469]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-290d248d-d057-4759-b17a-6e68185e99cf tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55 1073741824" returned: 0 in 0.664s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-290d248d-d057-4759-b17a-6e68185e99cf tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:08 devstack sudo[97479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55
Nov 06 17:14:08 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:08 devstack sudo[97478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_608d6f94-ded9-4f67-982e-7d8d90ed87ab_0np_9y2g
Nov 06 17:14:08 devstack sudo[97478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:08 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-290d248d-d057-4759-b17a-6e68185e99cf tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55" returned: 0 in 0.271s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:08 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-290d248d-d057-4759-b17a-6e68185e99cf tempest-VolumesSnapshotTestJSON-349969979 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:14:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-290d248d-d057-4759-b17a-6e68185e99cf tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5428a3a0-e23c-4768-8002-610d397cbacc tempest-TestInstancesWithCinderVolumes-52000996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.194s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:08 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5428a3a0-e23c-4768-8002-610d397cbacc tempest-TestInstancesWithCinderVolumes-52000996 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-189523985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec8c9fe-9276-4d89-848f-52cef29e59bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6978a98141224ef1a9980ba9c2323a4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:14:03Z,use_quota=True,user_id='17722e39449b4ba6acadf4f37a9311e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81fced70-81f0-4517-b029-abc3cf5a1a97),volume_type_id=81fced70-81f0-4517-b029-abc3cf5a1a97)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:14:08 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-5428a3a0-e23c-4768-8002-610d397cbacc tempest-TestInstancesWithCinderVolumes-52000996 None] Creating volume bec8c9fe-9276-4d89-848f-52cef29e59bb {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:14:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5428a3a0-e23c-4768-8002-610d397cbacc tempest-TestInstancesWithCinderVolumes-52000996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5428a3a0-e23c-4768-8002-610d397cbacc tempest-TestInstancesWithCinderVolumes-52000996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:08 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5428a3a0-e23c-4768-8002-610d397cbacc tempest-TestInstancesWithCinderVolumes-52000996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:14:08 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5428a3a0-e23c-4768-8002-610d397cbacc tempest-TestInstancesWithCinderVolumes-52000996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:14:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5428a3a0-e23c-4768-8002-610d397cbacc tempest-TestInstancesWithCinderVolumes-52000996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:08 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5428a3a0-e23c-4768-8002-610d397cbacc tempest-TestInstancesWithCinderVolumes-52000996 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:14:08 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-5428a3a0-e23c-4768-8002-610d397cbacc tempest-TestInstancesWithCinderVolumes-52000996 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:14:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5428a3a0-e23c-4768-8002-610d397cbacc tempest-TestInstancesWithCinderVolumes-52000996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bec8c9fe-9276-4d89-848f-52cef29e59bb 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:08 devstack sudo[97478]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_608d6f94-ded9-4f67-982e-7d8d90ed87ab_0np_9y2g" returned: 1 in 0.368s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_608d6f94-ded9-4f67-982e-7d8d90ed87ab_0np_9y2g' failed. Not Retrying. {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 17:14:08 devstack sudo[97485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bec8c9fe-9276-4d89-848f-52cef29e59bb 1073741824
Nov 06 17:14:08 devstack sudo[97485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-290d248d-d057-4759-b17a-6e68185e99cf tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9f47a28-7370-41cb-9f80-d5d6c2bbd4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-290d248d-d057-4759-b17a-6e68185e99cf tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73f8e109-8b96-4b27-af17-4f192bbc3997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:08 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[02767945-91fb-4f3e-983a-d22eccacc123]: (4, 'raw') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:14:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_608d6f94-ded9-4f67-982e-7d8d90ed87ab_ekfpiy1adevstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:08 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-290d248d-d057-4759-b17a-6e68185e99cf tempest-VolumesSnapshotTestJSON-349969979 None] Volume volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55 (726a33a5-1e4c-4d35-9527-3ea7dfe5bb55): created successfully
Nov 06 17:14:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-290d248d-d057-4759-b17a-6e68185e99cf tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73f8e109-8b96-4b27-af17-4f192bbc3997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-290d248d-d057-4759-b17a-6e68185e99cf tempest-VolumesSnapshotTestJSON-349969979 None] Flow 'volume_create_manager' (7fa7bf85-aab4-4b85-8176-7c56738063a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:14:08 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-290d248d-d057-4759-b17a-6e68185e99cf tempest-VolumesSnapshotTestJSON-349969979 None] Created volume successfully.
Nov 06 17:14:08 devstack sudo[97487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_608d6f94-ded9-4f67-982e-7d8d90ed87ab_ekfpiy1adevstack@QuobyteHD
Nov 06 17:14:08 devstack sudo[97487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:08 devstack sudo[97487]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_608d6f94-ded9-4f67-982e-7d8d90ed87ab_ekfpiy1adevstack@QuobyteHD" returned: 0 in 0.388s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_608d6f94-ded9-4f67-982e-7d8d90ed87ab_ekfpiy1adevstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:09 devstack sudo[97485]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-40859c9f-6613-46d9-ae0e-86388f923990 tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5428a3a0-e23c-4768-8002-610d397cbacc tempest-TestInstancesWithCinderVolumes-52000996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bec8c9fe-9276-4d89-848f-52cef29e59bb 1073741824" returned: 0 in 0.569s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5428a3a0-e23c-4768-8002-610d397cbacc tempest-TestInstancesWithCinderVolumes-52000996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bec8c9fe-9276-4d89-848f-52cef29e59bb {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:09 devstack sudo[97495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_608d6f94-ded9-4f67-982e-7d8d90ed87ab_ekfpiy1adevstack@QuobyteHD
Nov 06 17:14:09 devstack sudo[97495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:09 devstack sudo[97497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bec8c9fe-9276-4d89-848f-52cef29e59bb
Nov 06 17:14:09 devstack sudo[97497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:09 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2_g3b05sczdevstack@QuobyteHD, size 20.69 MB, duration 4.11 sec {{(pid=86856) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 06 17:14:09 devstack cinder-volume[86856]: INFO cinder.image.image_utils [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Image download 20.69 MB at 5.03 MB/s
Nov 06 17:14:09 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40cc105-8f70-4186-a2a2-d550d2fe7fa0]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:14:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2_g3b05sczdevstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:09 devstack sudo[97495]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_608d6f94-ded9-4f67-982e-7d8d90ed87ab_ekfpiy1adevstack@QuobyteHD" returned: 1 in 0.391s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_608d6f94-ded9-4f67-982e-7d8d90ed87ab_ekfpiy1adevstack@QuobyteHD' failed. Not Retrying. {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 17:14:09 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] 608d6f94-ded9-4f67-982e-7d8d90ed87ab was raw, converting to qcow2 {{(pid=86856) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 06 17:14:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_608d6f94-ded9-4f67-982e-7d8d90ed87ab_ekfpiy1adevstack@QuobyteHD /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a7e649c-c15d-452e-aead-99fee335686e {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:09 devstack sudo[97499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2_g3b05sczdevstack@QuobyteHD
Nov 06 17:14:09 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:09 devstack sudo[97504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_608d6f94-ded9-4f67-982e-7d8d90ed87ab_ekfpiy1adevstack@QuobyteHD /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a7e649c-c15d-452e-aead-99fee335686e
Nov 06 17:14:09 devstack sudo[97504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:09 devstack sudo[97497]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5428a3a0-e23c-4768-8002-610d397cbacc tempest-TestInstancesWithCinderVolumes-52000996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bec8c9fe-9276-4d89-848f-52cef29e59bb" returned: 0 in 0.267s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:09 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5428a3a0-e23c-4768-8002-610d397cbacc tempest-TestInstancesWithCinderVolumes-52000996 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:14:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5428a3a0-e23c-4768-8002-610d397cbacc tempest-TestInstancesWithCinderVolumes-52000996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4d9abd00-182e-4a40-9d00-aa66a5adfab8 tempest-TestInstancesWithCinderVolumes-52000996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.420s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:09 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4d9abd00-182e-4a40-9d00-aa66a5adfab8 tempest-TestInstancesWithCinderVolumes-52000996 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1190964794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c84613a1-b87a-4613-ab2f-4860fcbd6102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6978a98141224ef1a9980ba9c2323a4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:14:04Z,use_quota=True,user_id='17722e39449b4ba6acadf4f37a9311e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cde46a67-8f50-4538-a6aa-5d3c3c59663b),volume_type_id=cde46a67-8f50-4538-a6aa-5d3c3c59663b)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:14:09 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-4d9abd00-182e-4a40-9d00-aa66a5adfab8 tempest-TestInstancesWithCinderVolumes-52000996 None] Creating volume c84613a1-b87a-4613-ab2f-4860fcbd6102 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:14:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4d9abd00-182e-4a40-9d00-aa66a5adfab8 tempest-TestInstancesWithCinderVolumes-52000996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4d9abd00-182e-4a40-9d00-aa66a5adfab8 tempest-TestInstancesWithCinderVolumes-52000996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:09 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4d9abd00-182e-4a40-9d00-aa66a5adfab8 tempest-TestInstancesWithCinderVolumes-52000996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:14:09 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4d9abd00-182e-4a40-9d00-aa66a5adfab8 tempest-TestInstancesWithCinderVolumes-52000996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:14:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4d9abd00-182e-4a40-9d00-aa66a5adfab8 tempest-TestInstancesWithCinderVolumes-52000996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:09 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4d9abd00-182e-4a40-9d00-aa66a5adfab8 tempest-TestInstancesWithCinderVolumes-52000996 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:14:09 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-4d9abd00-182e-4a40-9d00-aa66a5adfab8 tempest-TestInstancesWithCinderVolumes-52000996 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:14:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4d9abd00-182e-4a40-9d00-aa66a5adfab8 tempest-TestInstancesWithCinderVolumes-52000996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c84613a1-b87a-4613-ab2f-4860fcbd6102 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5428a3a0-e23c-4768-8002-610d397cbacc tempest-TestInstancesWithCinderVolumes-52000996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87de48b0-161d-4e83-a2fa-abc34f9d65a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bec8c9fe-9276-4d89-848f-52cef29e59bb', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:09 devstack sudo[97507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c84613a1-b87a-4613-ab2f-4860fcbd6102 1073741824
Nov 06 17:14:09 devstack sudo[97507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5428a3a0-e23c-4768-8002-610d397cbacc tempest-TestInstancesWithCinderVolumes-52000996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a71585d-4ca5-4a2a-b2d4-acd6666495af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:09 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-5428a3a0-e23c-4768-8002-610d397cbacc tempest-TestInstancesWithCinderVolumes-52000996 None] Volume volume-bec8c9fe-9276-4d89-848f-52cef29e59bb (bec8c9fe-9276-4d89-848f-52cef29e59bb): created successfully
Nov 06 17:14:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5428a3a0-e23c-4768-8002-610d397cbacc tempest-TestInstancesWithCinderVolumes-52000996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a71585d-4ca5-4a2a-b2d4-acd6666495af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5428a3a0-e23c-4768-8002-610d397cbacc tempest-TestInstancesWithCinderVolumes-52000996 None] Flow 'volume_create_manager' (9b96d074-6684-4681-beea-882d7b3d2e95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:14:09 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-5428a3a0-e23c-4768-8002-610d397cbacc tempest-TestInstancesWithCinderVolumes-52000996 None] Created volume successfully.
Nov 06 17:14:09 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2_g3b05sczdevstack@QuobyteHD" returned: 0 in 0.343s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:09 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Temporary image cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2 is fetched for user 17722e39449b4ba6acadf4f37a9311e6. {{(pid=86856) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 06 17:14:09 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea6a3fc-8eac-4ab7-8c96-004e3b85b336]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:14:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2_g3b05sczdevstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:09 devstack sudo[97517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2_g3b05sczdevstack@QuobyteHD
Nov 06 17:14:09 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:09 devstack sudo[97504]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_608d6f94-ded9-4f67-982e-7d8d90ed87ab_ekfpiy1adevstack@QuobyteHD /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a7e649c-c15d-452e-aead-99fee335686e" returned: 0 in 0.486s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:09 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_608d6f94-ded9-4f67-982e-7d8d90ed87ab_ekfpiy1adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a7e649c-c15d-452e-aead-99fee335686e {{(pid=86856) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 17:14:09 devstack cinder-volume[86856]: INFO cinder.image.image_utils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Converted 0.00 MB image at 0.00 MB/s
Nov 06 17:14:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a7e649c-c15d-452e-aead-99fee335686e 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:09 devstack sudo[97521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a7e649c-c15d-452e-aead-99fee335686e 1G
Nov 06 17:14:09 devstack sudo[97521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:09 devstack sudo[97507]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4d9abd00-182e-4a40-9d00-aa66a5adfab8 tempest-TestInstancesWithCinderVolumes-52000996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c84613a1-b87a-4613-ab2f-4860fcbd6102 1073741824" returned: 0 in 0.475s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4d9abd00-182e-4a40-9d00-aa66a5adfab8 tempest-TestInstancesWithCinderVolumes-52000996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c84613a1-b87a-4613-ab2f-4860fcbd6102 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:09 devstack sudo[97523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c84613a1-b87a-4613-ab2f-4860fcbd6102
Nov 06 17:14:09 devstack sudo[97523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:10 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2_g3b05sczdevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:10 devstack sudo[97523]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4d9abd00-182e-4a40-9d00-aa66a5adfab8 tempest-TestInstancesWithCinderVolumes-52000996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c84613a1-b87a-4613-ab2f-4860fcbd6102" returned: 0 in 0.265s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4d9abd00-182e-4a40-9d00-aa66a5adfab8 tempest-TestInstancesWithCinderVolumes-52000996 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4d9abd00-182e-4a40-9d00-aa66a5adfab8 tempest-TestInstancesWithCinderVolumes-52000996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7edb1bcb-bf4f-487d-afe3-c22a32102cc8 tempest-VolumesGetTest-776201853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.027s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7edb1bcb-bf4f-487d-afe3-c22a32102cc8 tempest-VolumesGetTest-776201853 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:14:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1244401737',display_name='tempest-VolumesGetTest-Volume-125928806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b4b48c7-fcba-492f-917a-722f4480b832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5791703ccd54989903afbe71d00e5b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:14:08Z,use_quota=True,user_id='f8538f1b84ba4958b1f532c455a030d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-7edb1bcb-bf4f-487d-afe3-c22a32102cc8 tempest-VolumesGetTest-776201853 None] Creating volume 8b4b48c7-fcba-492f-917a-722f4480b832 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7edb1bcb-bf4f-487d-afe3-c22a32102cc8 tempest-VolumesGetTest-776201853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7edb1bcb-bf4f-487d-afe3-c22a32102cc8 tempest-VolumesGetTest-776201853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7edb1bcb-bf4f-487d-afe3-c22a32102cc8 tempest-VolumesGetTest-776201853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7edb1bcb-bf4f-487d-afe3-c22a32102cc8 tempest-VolumesGetTest-776201853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7edb1bcb-bf4f-487d-afe3-c22a32102cc8 tempest-VolumesGetTest-776201853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7edb1bcb-bf4f-487d-afe3-c22a32102cc8 tempest-VolumesGetTest-776201853 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:14:10 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-7edb1bcb-bf4f-487d-afe3-c22a32102cc8 tempest-VolumesGetTest-776201853 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7edb1bcb-bf4f-487d-afe3-c22a32102cc8 tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8b4b48c7-fcba-492f-917a-722f4480b832 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:10 devstack sudo[97521]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4d9abd00-182e-4a40-9d00-aa66a5adfab8 tempest-TestInstancesWithCinderVolumes-52000996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c199d703-6bd8-4535-9348-3fcd474a24ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c84613a1-b87a-4613-ab2f-4860fcbd6102', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:10 devstack sudo[97532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8b4b48c7-fcba-492f-917a-722f4480b832 1073741824
Nov 06 17:14:10 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4d9abd00-182e-4a40-9d00-aa66a5adfab8 tempest-TestInstancesWithCinderVolumes-52000996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d58f27d5-ae2a-452a-87a7-3a194148cfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a7e649c-c15d-452e-aead-99fee335686e 1G" returned: 0 in 0.398s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG cinder.volume.volume_utils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Downloaded image 608d6f94-ded9-4f67-982e-7d8d90ed87ab ((None, [{'url': 'file:///opt/stack/data/glance/images/608d6f94-ded9-4f67-982e-7d8d90ed87ab', 'metadata': {}}])) to volume 1a7e649c-c15d-452e-aead-99fee335686e successfully. {{(pid=86856) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Temporary image 608d6f94-ded9-4f67-982e-7d8d90ed87ab for user 7f56a1b568cf4e80a8136b7d77da134a is deleted. {{(pid=86856) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG cinder.volume.volume_utils [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Marking volume 1a7e649c-c15d-452e-aead-99fee335686e as bootable. {{(pid=86856) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 06 17:14:10 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-4d9abd00-182e-4a40-9d00-aa66a5adfab8 tempest-TestInstancesWithCinderVolumes-52000996 None] Volume volume-c84613a1-b87a-4613-ab2f-4860fcbd6102 (c84613a1-b87a-4613-ab2f-4860fcbd6102): created successfully
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4d9abd00-182e-4a40-9d00-aa66a5adfab8 tempest-TestInstancesWithCinderVolumes-52000996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d58f27d5-ae2a-452a-87a7-3a194148cfde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4d9abd00-182e-4a40-9d00-aa66a5adfab8 tempest-TestInstancesWithCinderVolumes-52000996 None] Flow 'volume_create_manager' (6d107864-adf4-4888-b674-09d061b0209f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Copying metadata from image 608d6f94-ded9-4f67-982e-7d8d90ed87ab to 1a7e649c-c15d-452e-aead-99fee335686e. {{(pid=86856) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Creating volume glance metadata for volume 1a7e649c-c15d-452e-aead-99fee335686e backed by image 608d6f94-ded9-4f67-982e-7d8d90ed87ab with: {'image_id': '608d6f94-ded9-4f67-982e-7d8d90ed87ab', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f126c8574887832108941880af6262ac', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86856) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 06 17:14:10 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-4d9abd00-182e-4a40-9d00-aa66a5adfab8 tempest-TestInstancesWithCinderVolumes-52000996 None] Created volume successfully.
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c737b24-a25c-4311-9874-3178ab2baf6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a7e649c-c15d-452e-aead-99fee335686e', 'volume_size': 1, 'image_id': '608d6f94-ded9-4f67-982e-7d8d90ed87ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/608d6f94-ded9-4f67-982e-7d8d90ed87ab', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f126c8574887832108941880af6262ac', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8f5e0633bb6c40a7b80690d0b726d863', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8c80dcf7bbf50b8483cde37ee80a0f01f60cf5d47e7d2d3a168ab581f94761bca7b56a19ca5f378f6baac25ee0df56d85b02eafcaf238819bae9c87965d56124', 'id': '608d6f94-ded9-4f67-982e-7d8d90ed87ab', 'created_at': datetime.datetime(2026, 11, 6, 16, 13, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 16, 13, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/608d6f94-ded9-4f67-982e-7d8d90ed87ab/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x71da66e799d0>}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (549aa2f2-10d6-4f4e-819c-b5b3e43a6394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:10 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Volume volume-1a7e649c-c15d-452e-aead-99fee335686e (1a7e649c-c15d-452e-aead-99fee335686e): created successfully
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (549aa2f2-10d6-4f4e-819c-b5b3e43a6394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Flow 'volume_create_manager' (a9d095fe-4c41-4e4c-b9b4-0098dc234ebd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:14:10 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-cd219f44-fa41-42e5-8fc6-f65ee010beb3 tempest-VolumeImageDependencyTests-1030416884 None] Created volume successfully.
Nov 06 17:14:10 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7edb1bcb-bf4f-487d-afe3-c22a32102cc8 tempest-VolumesGetTest-776201853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8b4b48c7-fcba-492f-917a-722f4480b832 1073741824" returned: 0 in 0.409s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=125,cinder:INSERT=47,cinder:UPDATE=149,cinder:DELETE=11 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:UPDATE=156,cinder:DELETE=17,cinder:SELECT=139,cinder:INSERT=38 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7edb1bcb-bf4f-487d-afe3-c22a32102cc8 tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8b4b48c7-fcba-492f-917a-722f4480b832 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:10 devstack sudo[97538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8b4b48c7-fcba-492f-917a-722f4480b832
Nov 06 17:14:10 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:10 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7edb1bcb-bf4f-487d-afe3-c22a32102cc8 tempest-VolumesGetTest-776201853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8b4b48c7-fcba-492f-917a-722f4480b832" returned: 0 in 0.240s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7edb1bcb-bf4f-487d-afe3-c22a32102cc8 tempest-VolumesGetTest-776201853 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7edb1bcb-bf4f-487d-afe3-c22a32102cc8 tempest-VolumesGetTest-776201853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-40859c9f-6613-46d9-ae0e-86388f923990 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.805s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7edb1bcb-bf4f-487d-afe3-c22a32102cc8 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02f09980-4139-4711-8f0b-cf73f726d4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b4b48c7-fcba-492f-917a-722f4480b832', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7edb1bcb-bf4f-487d-afe3-c22a32102cc8 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc54ab5a-dcd8-411c-86e5-9733a75d69e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-40859c9f-6613-46d9-ae0e-86388f923990 tempest-VolumesSnapshotTestJSON-349969979 None] Creating offline snapshot 63b6d6a5-de20-4f56-8414-3ee5305d551e of volume 726a33a5-1e4c-4d35-9527-3ea7dfe5bb55 {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:14:10 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-7edb1bcb-bf4f-487d-afe3-c22a32102cc8 tempest-VolumesGetTest-776201853 None] Volume volume-8b4b48c7-fcba-492f-917a-722f4480b832 (8b4b48c7-fcba-492f-917a-722f4480b832): created successfully
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7edb1bcb-bf4f-487d-afe3-c22a32102cc8 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc54ab5a-dcd8-411c-86e5-9733a75d69e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7edb1bcb-bf4f-487d-afe3-c22a32102cc8 tempest-VolumesGetTest-776201853 None] Flow 'volume_create_manager' (31dcf644-befe-474f-b32c-82f62a0935db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f77dd10-13e4-4784-9f65-ced2fa424d98]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:14:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-40859c9f-6613-46d9-ae0e-86388f923990 tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:10 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-7edb1bcb-bf4f-487d-afe3-c22a32102cc8 tempest-VolumesGetTest-776201853 None] Created volume successfully.
Nov 06 17:14:11 devstack sudo[97541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55
Nov 06 17:14:11 devstack sudo[97541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9827ef1f-928d-4207-8e9a-296ac26c3bd8 tempest-VolumeImageDependencyTests-1030416884 None] Acquiring lock "cinder-1a7e649c-c15d-452e-aead-99fee335686e-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9827ef1f-928d-4207-8e9a-296ac26c3bd8 tempest-VolumeImageDependencyTests-1030416884 None] Lock "cinder-1a7e649c-c15d-452e-aead-99fee335686e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:11 devstack sudo[97541]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-3c4394f4-2fba-49d6-a8ab-e83117fd31e7 tempest-VolumesGetTest-776201853 None] Acquiring lock "cinder-8b4b48c7-fcba-492f-917a-722f4480b832-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-40859c9f-6613-46d9-ae0e-86388f923990 tempest-VolumesSnapshotTestJSON-349969979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55" returned: 0 in 0.442s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-40859c9f-6613-46d9-ae0e-86388f923990 tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55.63b6d6a5-de20-4f56-8414-3ee5305d551e 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-3c4394f4-2fba-49d6-a8ab-e83117fd31e7 tempest-VolumesGetTest-776201853 None] Lock "cinder-8b4b48c7-fcba-492f-917a-722f4480b832-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:11 devstack sudo[97547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55.63b6d6a5-de20-4f56-8414-3ee5305d551e 1G
Nov 06 17:14:11 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9827ef1f-928d-4207-8e9a-296ac26c3bd8 tempest-VolumeImageDependencyTests-1030416884 None] Acquiring lock "cinder-quobyte-1a7e649c-c15d-452e-aead-99fee335686e" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-3c4394f4-2fba-49d6-a8ab-e83117fd31e7 tempest-VolumesGetTest-776201853 None] Acquiring lock "cinder-quobyte-8b4b48c7-fcba-492f-917a-722f4480b832" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9827ef1f-928d-4207-8e9a-296ac26c3bd8 tempest-VolumeImageDependencyTests-1030416884 None] Lock "cinder-quobyte-1a7e649c-c15d-452e-aead-99fee335686e" acquired by "delete_volume" :: waited 0.025s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-3c4394f4-2fba-49d6-a8ab-e83117fd31e7 tempest-VolumesGetTest-776201853 None] Lock "cinder-quobyte-8b4b48c7-fcba-492f-917a-722f4480b832" acquired by "delete_volume" :: waited 0.028s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:11 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[78670dc4-52ec-44c0-aaae-765e89999aea]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:14:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9827ef1f-928d-4207-8e9a-296ac26c3bd8 tempest-VolumeImageDependencyTests-1030416884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a7e649c-c15d-452e-aead-99fee335686e {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:11 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7279a5b-02d6-4a94-889c-2a5f409b4c93]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:14:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3c4394f4-2fba-49d6-a8ab-e83117fd31e7 tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8b4b48c7-fcba-492f-917a-722f4480b832 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:11 devstack sudo[97549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a7e649c-c15d-452e-aead-99fee335686e
Nov 06 17:14:11 devstack sudo[97549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:11 devstack sudo[97550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8b4b48c7-fcba-492f-917a-722f4480b832
Nov 06 17:14:11 devstack sudo[97550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:11 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-40859c9f-6613-46d9-ae0e-86388f923990 tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55.63b6d6a5-de20-4f56-8414-3ee5305d551e 1G" returned: 0 in 0.449s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-40859c9f-6613-46d9-ae0e-86388f923990 tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55.63b6d6a5-de20-4f56-8414-3ee5305d551e {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:11 devstack sudo[97559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55.63b6d6a5-de20-4f56-8414-3ee5305d551e
Nov 06 17:14:11 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:11 devstack sudo[97549]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9827ef1f-928d-4207-8e9a-296ac26c3bd8 tempest-VolumeImageDependencyTests-1030416884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a7e649c-c15d-452e-aead-99fee335686e" returned: 0 in 0.414s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9827ef1f-928d-4207-8e9a-296ac26c3bd8 tempest-VolumeImageDependencyTests-1030416884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a7e649c-c15d-452e-aead-99fee335686e {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:11 devstack sudo[97550]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3c4394f4-2fba-49d6-a8ab-e83117fd31e7 tempest-VolumesGetTest-776201853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8b4b48c7-fcba-492f-917a-722f4480b832" returned: 0 in 0.424s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3c4394f4-2fba-49d6-a8ab-e83117fd31e7 tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8b4b48c7-fcba-492f-917a-722f4480b832 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:11 devstack sudo[97565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a7e649c-c15d-452e-aead-99fee335686e
Nov 06 17:14:11 devstack sudo[97565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:11 devstack sudo[97567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8b4b48c7-fcba-492f-917a-722f4480b832
Nov 06 17:14:11 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:12 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-40859c9f-6613-46d9-ae0e-86388f923990 tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55.63b6d6a5-de20-4f56-8414-3ee5305d551e" returned: 0 in 0.326s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:12 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-40859c9f-6613-46d9-ae0e-86388f923990 tempest-VolumesSnapshotTestJSON-349969979 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55.63b6d6a5-de20-4f56-8414-3ee5305d551e is being set with open permissions: ugo+rw
Nov 06 17:14:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-40859c9f-6613-46d9-ae0e-86388f923990 tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55.63b6d6a5-de20-4f56-8414-3ee5305d551e {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:12 devstack sudo[97573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55.63b6d6a5-de20-4f56-8414-3ee5305d551e
Nov 06 17:14:12 devstack sudo[97573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:12 devstack sudo[97565]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9827ef1f-928d-4207-8e9a-296ac26c3bd8 tempest-VolumeImageDependencyTests-1030416884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a7e649c-c15d-452e-aead-99fee335686e" returned: 0 in 0.281s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:12 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9827ef1f-928d-4207-8e9a-296ac26c3bd8 tempest-VolumeImageDependencyTests-1030416884 None] Lock "cinder-quobyte-1a7e649c-c15d-452e-aead-99fee335686e" released by "delete_volume" :: held 0.750s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:12 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3c4394f4-2fba-49d6-a8ab-e83117fd31e7 tempest-VolumesGetTest-776201853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8b4b48c7-fcba-492f-917a-722f4480b832" returned: 0 in 0.285s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:12 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-3c4394f4-2fba-49d6-a8ab-e83117fd31e7 tempest-VolumesGetTest-776201853 None] Lock "cinder-quobyte-8b4b48c7-fcba-492f-917a-722f4480b832" released by "delete_volume" :: held 0.775s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:12 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-9827ef1f-928d-4207-8e9a-296ac26c3bd8 tempest-VolumeImageDependencyTests-1030416884 None] Created reservations ['57db3039-ed9a-447b-9b15-0fa4bc61a30c', '94cc10de-0406-44ff-b6c9-b1dcb9b306dc', '64776c0e-ff96-4045-a6af-3fb04a147911', 'c9c21b7e-d063-44ce-b6b1-565a94247202'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:14:12 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-3c4394f4-2fba-49d6-a8ab-e83117fd31e7 tempest-VolumesGetTest-776201853 None] Created reservations ['203a4631-2b13-4dd1-9119-21e0a3feb8fb', 'f4882e32-2f55-40f9-82a7-4ade420f7c45', '3abee84d-bc24-4a4c-90d8-f7f8c9648be7', 'e45fbdf8-fc90-41ab-97df-d0b669443111'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:14:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9827ef1f-928d-4207-8e9a-296ac26c3bd8 tempest-VolumeImageDependencyTests-1030416884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9827ef1f-928d-4207-8e9a-296ac26c3bd8 tempest-VolumeImageDependencyTests-1030416884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:12 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-9827ef1f-928d-4207-8e9a-296ac26c3bd8 tempest-VolumeImageDependencyTests-1030416884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:14:12 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-9827ef1f-928d-4207-8e9a-296ac26c3bd8 tempest-VolumeImageDependencyTests-1030416884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:14:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9827ef1f-928d-4207-8e9a-296ac26c3bd8 tempest-VolumeImageDependencyTests-1030416884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9827ef1f-928d-4207-8e9a-296ac26c3bd8 tempest-VolumeImageDependencyTests-1030416884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:12 devstack sudo[97577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:14:12 devstack sudo[97577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:12 devstack sudo[97573]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-40859c9f-6613-46d9-ae0e-86388f923990 tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55.63b6d6a5-de20-4f56-8414-3ee5305d551e" returned: 0 in 0.275s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3c4394f4-2fba-49d6-a8ab-e83117fd31e7 tempest-VolumesGetTest-776201853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3c4394f4-2fba-49d6-a8ab-e83117fd31e7 tempest-VolumesGetTest-776201853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:12 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3c4394f4-2fba-49d6-a8ab-e83117fd31e7 tempest-VolumesGetTest-776201853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:14:12 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3c4394f4-2fba-49d6-a8ab-e83117fd31e7 tempest-VolumesGetTest-776201853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:14:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3c4394f4-2fba-49d6-a8ab-e83117fd31e7 tempest-VolumesGetTest-776201853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3c4394f4-2fba-49d6-a8ab-e83117fd31e7 tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:12 devstack sudo[97579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:14:12 devstack sudo[97579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-40859c9f-6613-46d9-ae0e-86388f923990 tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:12 devstack sudo[97581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55.info
Nov 06 17:14:12 devstack sudo[97581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:12 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-525ae670-826a-4910-956c-1eb8c728235e tempest-VolumesGetTest-776201853 None] Acquiring lock "cinder-8abf4f40-439b-4469-8957-451ba687cf53-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:12 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-525ae670-826a-4910-956c-1eb8c728235e tempest-VolumesGetTest-776201853 None] Lock "cinder-8abf4f40-439b-4469-8957-451ba687cf53-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:12 devstack sudo[97577]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9827ef1f-928d-4207-8e9a-296ac26c3bd8 tempest-VolumeImageDependencyTests-1030416884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.382s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:12 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-9827ef1f-928d-4207-8e9a-296ac26c3bd8 tempest-VolumeImageDependencyTests-1030416884 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:14:12 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-9827ef1f-928d-4207-8e9a-296ac26c3bd8 tempest-VolumeImageDependencyTests-1030416884 None] Deleted volume successfully.
Nov 06 17:14:12 devstack sudo[97579]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:12 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-525ae670-826a-4910-956c-1eb8c728235e tempest-VolumesGetTest-776201853 None] Acquiring lock "cinder-quobyte-8abf4f40-439b-4469-8957-451ba687cf53" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3c4394f4-2fba-49d6-a8ab-e83117fd31e7 tempest-VolumesGetTest-776201853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.337s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:12 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-3c4394f4-2fba-49d6-a8ab-e83117fd31e7 tempest-VolumesGetTest-776201853 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:14:12 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-3c4394f4-2fba-49d6-a8ab-e83117fd31e7 tempest-VolumesGetTest-776201853 None] Deleted volume successfully.
Nov 06 17:14:12 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-525ae670-826a-4910-956c-1eb8c728235e tempest-VolumesGetTest-776201853 None] Lock "cinder-quobyte-8abf4f40-439b-4469-8957-451ba687cf53" acquired by "delete_volume" :: waited 0.029s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:12 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9827ef1f-928d-4207-8e9a-296ac26c3bd8 tempest-VolumeImageDependencyTests-1030416884 None] Lock "cinder-1a7e649c-c15d-452e-aead-99fee335686e-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:12 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-3c4394f4-2fba-49d6-a8ab-e83117fd31e7 tempest-VolumesGetTest-776201853 None] Lock "cinder-8b4b48c7-fcba-492f-917a-722f4480b832-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:12 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[240b013f-3e62-443a-9d86-3197e59a7746]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:14:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-525ae670-826a-4910-956c-1eb8c728235e tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8abf4f40-439b-4469-8957-451ba687cf53 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:12 devstack sudo[97581]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-40859c9f-6613-46d9-ae0e-86388f923990 tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55.info" returned: 0 in 0.380s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:12 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-40859c9f-6613-46d9-ae0e-86388f923990 tempest-VolumesSnapshotTestJSON-349969979 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55.info is being set with open permissions: ugo+rw
Nov 06 17:14:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-40859c9f-6613-46d9-ae0e-86388f923990 tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:12 devstack sudo[97587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55.info
Nov 06 17:14:12 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:13 devstack sudo[97586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8abf4f40-439b-4469-8957-451ba687cf53
Nov 06 17:14:13 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:13 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-40859c9f-6613-46d9-ae0e-86388f923990 tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55.info" returned: 0 in 0.304s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-40859c9f-6613-46d9-ae0e-86388f923990 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.367s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.246s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:13 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-316340171',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3a70268-1141-4755-9650-fd29871330f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6978a98141224ef1a9980ba9c2323a4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:14:05Z,use_quota=True,user_id='17722e39449b4ba6acadf4f37a9311e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5238534a-38ba-43eb-bb15-be2272252f3d),volume_type_id=5238534a-38ba-43eb-bb15-be2272252f3d)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:14:13 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Creating volume b3a70268-1141-4755-9650-fd29871330f2 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:14:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:13 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:14:13 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:14:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:13 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:14:13 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:14:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b3a70268-1141-4755-9650-fd29871330f2 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:13 devstack sudo[97593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b3a70268-1141-4755-9650-fd29871330f2 1073741824
Nov 06 17:14:13 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:13 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-40859c9f-6613-46d9-ae0e-86388f923990 tempest-VolumesSnapshotTestJSON-349969979 None] Create snapshot completed successfully
Nov 06 17:14:13 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-525ae670-826a-4910-956c-1eb8c728235e tempest-VolumesGetTest-776201853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8abf4f40-439b-4469-8957-451ba687cf53" returned: 0 in 0.550s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-525ae670-826a-4910-956c-1eb8c728235e tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8abf4f40-439b-4469-8957-451ba687cf53 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:13 devstack sudo[97596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8abf4f40-439b-4469-8957-451ba687cf53
Nov 06 17:14:13 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:13 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-525ae670-826a-4910-956c-1eb8c728235e tempest-VolumesGetTest-776201853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8abf4f40-439b-4469-8957-451ba687cf53" returned: 0 in 0.276s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:13 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-525ae670-826a-4910-956c-1eb8c728235e tempest-VolumesGetTest-776201853 None] Lock "cinder-quobyte-8abf4f40-439b-4469-8957-451ba687cf53" released by "delete_volume" :: held 0.882s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:13 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-525ae670-826a-4910-956c-1eb8c728235e tempest-VolumesGetTest-776201853 None] Created reservations ['163aba59-6f0f-4142-b117-f6dc7d268dee', '8efd61bd-714b-47a7-ac34-ee24795a6211', 'b0729b67-1656-4591-aead-b53cdffa39ef', '20e94cb5-fabd-45e0-898a-b657ba35c4a4'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:14:13 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b3a70268-1141-4755-9650-fd29871330f2 1073741824" returned: 0 in 0.588s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-525ae670-826a-4910-956c-1eb8c728235e tempest-VolumesGetTest-776201853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-525ae670-826a-4910-956c-1eb8c728235e tempest-VolumesGetTest-776201853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:13 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-525ae670-826a-4910-956c-1eb8c728235e tempest-VolumesGetTest-776201853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:14:13 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-525ae670-826a-4910-956c-1eb8c728235e tempest-VolumesGetTest-776201853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:14:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-525ae670-826a-4910-956c-1eb8c728235e tempest-VolumesGetTest-776201853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-525ae670-826a-4910-956c-1eb8c728235e tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b3a70268-1141-4755-9650-fd29871330f2 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:13 devstack sudo[97603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:14:13 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:13 devstack sudo[97605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b3a70268-1141-4755-9650-fd29871330f2
Nov 06 17:14:13 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:14 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-525ae670-826a-4910-956c-1eb8c728235e tempest-VolumesGetTest-776201853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.278s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:14 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-525ae670-826a-4910-956c-1eb8c728235e tempest-VolumesGetTest-776201853 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:14:14 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b3a70268-1141-4755-9650-fd29871330f2" returned: 0 in 0.260s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:14 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:14:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:14 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-525ae670-826a-4910-956c-1eb8c728235e tempest-VolumesGetTest-776201853 None] Deleted volume successfully.
Nov 06 17:14:14 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-525ae670-826a-4910-956c-1eb8c728235e tempest-VolumesGetTest-776201853 None] Lock "cinder-8abf4f40-439b-4469-8957-451ba687cf53-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:14 devstack cinder-volume[86856]: DEBUG cinder.volume.volume_utils [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Attempting download of cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2 ((None, [{'url': 'file:///opt/stack/data/glance/images/cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2', 'metadata': {}}])) to volume b3a70268-1141-4755-9650-fd29871330f2. {{(pid=86856) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 06 17:14:14 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11d6785-0373-4034-bf15-588ab620ba66]: (4, 'raw') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:14:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2_yh9ob5ed {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:14 devstack sudo[97609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2_yh9ob5ed
Nov 06 17:14:14 devstack sudo[97609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:14 devstack sudo[97609]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2_yh9ob5ed" returned: 0 in 0.392s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2_yh9ob5ed {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:14 devstack sudo[97613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2_yh9ob5ed
Nov 06 17:14:14 devstack sudo[97613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:14:15 devstack sudo[97613]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2_yh9ob5ed" returned: 1 in 0.401s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2_yh9ob5ed' failed. Not Retrying. {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec28fe06-a194-43d4-ad97-f7046f44de59]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2_g3b05sczdevstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Flow 'volume_create_manager' (2b2779c4-58e1-49e4-ba81-ce6410f4083f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3417048d-1e55-4feb-a72a-1396e36bbb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-cf0f517c-592c-46e1-9844-78401e21235a tempest-VolumesGetTest-776201853 None] Acquiring lock "cinder-701493b7-b42b-4f0c-8d2a-1b7962d1444a-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3417048d-1e55-4feb-a72a-1396e36bbb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1543808512',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c05433f1-22ac-4f91-961b-59210aeda6c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d8e6498df64229af85d96b1e8116f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=63b6d6a5-de20-4f56-8414-3ee5305d551e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:14:15Z,use_quota=True,user_id='f9e67809a7954e01a5321acb51af70fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e24ee6-0951-4b17-a633-de21cc2eee48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e24ee6-0951-4b17-a633-de21cc2eee48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a141a53-6436-4e65-a3b2-efc6c5cb2e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a141a53-6436-4e65-a3b2-efc6c5cb2e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c05433f1-22ac-4f91-961b-59210aeda6c2', 'volume_name': 'volume-c05433f1-22ac-4f91-961b-59210aeda6c2', 'volume_size': 1, 'snapshot_id': '63b6d6a5-de20-4f56-8414-3ee5305d551e'}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0756364e-e645-4193-a6d6-2e9e9dbfeb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0756364e-e645-4193-a6d6-2e9e9dbfeb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d2723e2-a6ce-47f8-bd4e-f90f11dfdb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:15 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Volume c05433f1-22ac-4f91-961b-59210aeda6c2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c05433f1-22ac-4f91-961b-59210aeda6c2', 'volume_size': 1, 'snapshot_id': '63b6d6a5-de20-4f56-8414-3ee5305d551e'}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-cf0f517c-592c-46e1-9844-78401e21235a tempest-VolumesGetTest-776201853 None] Lock "cinder-701493b7-b42b-4f0c-8d2a-1b7962d1444a-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:15 devstack sudo[97617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2_g3b05sczdevstack@QuobyteHD
Nov 06 17:14:15 devstack sudo[97617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "cinder-quobyte-63b6d6a5-de20-4f56-8414-3ee5305d551e-c05433f1-22ac-4f91-961b-59210aeda6c2" by "_create_volume_from_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-quobyte-63b6d6a5-de20-4f56-8414-3ee5305d551e-c05433f1-22ac-4f91-961b-59210aeda6c2" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Creating volume c05433f1-22ac-4f91-961b-59210aeda6c2 from snapshot 63b6d6a5-de20-4f56-8414-3ee5305d551e {{(pid=86856) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "cinder-quobyte-c05433f1-22ac-4f91-961b-59210aeda6c2" by "_copy_volume_from_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-cf0f517c-592c-46e1-9844-78401e21235a tempest-VolumesGetTest-776201853 None] Acquiring lock "cinder-quobyte-701493b7-b42b-4f0c-8d2a-1b7962d1444a" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-quobyte-c05433f1-22ac-4f91-961b-59210aeda6c2" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] snapshot: 63b6d6a5-de20-4f56-8414-3ee5305d551e, volume: c05433f1-22ac-4f91-961b-59210aeda6c2,  {{(pid=86856) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-cf0f517c-592c-46e1-9844-78401e21235a tempest-VolumesGetTest-776201853 None] Lock "cinder-quobyte-701493b7-b42b-4f0c-8d2a-1b7962d1444a" acquired by "delete_volume" :: waited 0.023s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2a7375-84d8-40b5-b587-391ca9253e32]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cf0f517c-592c-46e1-9844-78401e21235a tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5e1c20-a4df-4ae6-a5f4-0f63877ea808]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55.63b6d6a5-de20-4f56-8414-3ee5305d551e {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:15 devstack sudo[97617]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2_g3b05sczdevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2 was qcow2, converting to qcow2 {{(pid=86856) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2_g3b05sczdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b3a70268-1141-4755-9650-fd29871330f2 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:15 devstack sudo[97619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a
Nov 06 17:14:15 devstack sudo[97619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:15 devstack sudo[97624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2_g3b05sczdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b3a70268-1141-4755-9650-fd29871330f2
Nov 06 17:14:15 devstack sudo[97624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:15 devstack sudo[97620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55.63b6d6a5-de20-4f56-8414-3ee5305d551e
Nov 06 17:14:15 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:15 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55.63b6d6a5-de20-4f56-8414-3ee5305d551e" returned: 0 in 0.420s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:14:15 devstack sudo[97619]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cf0f517c-592c-46e1-9844-78401e21235a tempest-VolumesGetTest-776201853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a" returned: 0 in 0.445s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cf0f517c-592c-46e1-9844-78401e21235a tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[7491805a-04c8-4013-8bc7-77a3dc850253]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:14:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:15 devstack sudo[97639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a
Nov 06 17:14:15 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:15 devstack sudo[97640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55
Nov 06 17:14:15 devstack sudo[97640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:16 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cf0f517c-592c-46e1-9844-78401e21235a tempest-VolumesGetTest-776201853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-701493b7-b42b-4f0c-8d2a-1b7962d1444a" returned: 0 in 0.374s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:16 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-cf0f517c-592c-46e1-9844-78401e21235a tempest-VolumesGetTest-776201853 None] Lock "cinder-quobyte-701493b7-b42b-4f0c-8d2a-1b7962d1444a" released by "delete_volume" :: held 0.918s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:16 devstack sudo[97640]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55" returned: 0 in 0.454s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:16 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55 {{(pid=86856) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 06 17:14:16 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Creating direct copy from snapshot {{(pid=86856) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 06 17:14:16 devstack cinder-volume[86856]: DEBUG cinder.utils [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Path /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c05433f1-22ac-4f91-961b-59210aeda6c2 not found in is_blk_device check {{(pid=86856) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 06 17:14:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c05433f1-22ac-4f91-961b-59210aeda6c2 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:16 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-cf0f517c-592c-46e1-9844-78401e21235a tempest-VolumesGetTest-776201853 None] Created reservations ['74d4ec02-e2d9-4167-8f7d-c1b9fe16ad24', '481a58f3-24e8-4d31-b42f-bddc63975912', 'cd54b707-6941-4c71-baab-9fe8ecceb6a1', '0beb58a4-b282-4cb4-9c53-71bc3e365c0c'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:14:16 devstack sudo[97654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c05433f1-22ac-4f91-961b-59210aeda6c2
Nov 06 17:14:16 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-cf0f517c-592c-46e1-9844-78401e21235a tempest-VolumesGetTest-776201853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-cf0f517c-592c-46e1-9844-78401e21235a tempest-VolumesGetTest-776201853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:16 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-cf0f517c-592c-46e1-9844-78401e21235a tempest-VolumesGetTest-776201853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:14:16 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-cf0f517c-592c-46e1-9844-78401e21235a tempest-VolumesGetTest-776201853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:14:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-cf0f517c-592c-46e1-9844-78401e21235a tempest-VolumesGetTest-776201853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cf0f517c-592c-46e1-9844-78401e21235a tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:16 devstack sudo[97656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:14:16 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:16 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-86e29382-4324-4245-816c-1da6d10d33be tempest-CinderUnicodeTest-1889886783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:14:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-86e29382-4324-4245-816c-1da6d10d33be tempest-CinderUnicodeTest-1889886783 None] Flow 'volume_create_manager' (243af6e7-6b99-4e93-8874-bd7a43cde086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:14:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-86e29382-4324-4245-816c-1da6d10d33be tempest-CinderUnicodeTest-1889886783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0616be07-b2b7-467e-a120-066dd4f2adbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-86e29382-4324-4245-816c-1da6d10d33be tempest-CinderUnicodeTest-1889886783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0616be07-b2b7-467e-a120-066dd4f2adbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aa7242d-35bb-4ca4-b33c-81516d1fa81a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b863de2d13342be901657bacc76c5b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:14:17Z,use_quota=True,user_id='8efea1b4cb954ffe9124d05e2eb4028f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-86e29382-4324-4245-816c-1da6d10d33be tempest-CinderUnicodeTest-1889886783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0870c2c2-465f-4d6f-9b0f-c024aeb37500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-86e29382-4324-4245-816c-1da6d10d33be tempest-CinderUnicodeTest-1889886783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0870c2c2-465f-4d6f-9b0f-c024aeb37500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:16 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-86e29382-4324-4245-816c-1da6d10d33be tempest-CinderUnicodeTest-1889886783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dad290e-5a1d-451b-a7c0-b44927232c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-86e29382-4324-4245-816c-1da6d10d33be tempest-CinderUnicodeTest-1889886783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dad290e-5a1d-451b-a7c0-b44927232c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2aa7242d-35bb-4ca4-b33c-81516d1fa81a', 'volume_name': 'volume-2aa7242d-35bb-4ca4-b33c-81516d1fa81a', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-86e29382-4324-4245-816c-1da6d10d33be tempest-CinderUnicodeTest-1889886783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba86a94e-6995-4122-ae1f-5f4ec821cdb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-86e29382-4324-4245-816c-1da6d10d33be tempest-CinderUnicodeTest-1889886783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba86a94e-6995-4122-ae1f-5f4ec821cdb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-86e29382-4324-4245-816c-1da6d10d33be tempest-CinderUnicodeTest-1889886783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d85c0583-9b08-4e31-a73a-c39b1651266b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:16 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-86e29382-4324-4245-816c-1da6d10d33be tempest-CinderUnicodeTest-1889886783 None] Volume 2aa7242d-35bb-4ca4-b33c-81516d1fa81a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2aa7242d-35bb-4ca4-b33c-81516d1fa81a', 'volume_size': 1}
Nov 06 17:14:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-86e29382-4324-4245-816c-1da6d10d33be tempest-CinderUnicodeTest-1889886783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cf0f517c-592c-46e1-9844-78401e21235a tempest-VolumesGetTest-776201853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.314s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:16 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-cf0f517c-592c-46e1-9844-78401e21235a tempest-VolumesGetTest-776201853 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:14:16 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-cf0f517c-592c-46e1-9844-78401e21235a tempest-VolumesGetTest-776201853 None] Deleted volume successfully.
Nov 06 17:14:16 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-cf0f517c-592c-46e1-9844-78401e21235a tempest-VolumesGetTest-776201853 None] Lock "cinder-701493b7-b42b-4f0c-8d2a-1b7962d1444a-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:18 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:14:18 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Flow 'volume_create_manager' (49dd97e5-4ec6-4204-a65f-6a005626ee8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:14:18 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7074e44-7425-481a-af23-7010570ba797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:18 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7074e44-7425-481a-af23-7010570ba797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1128711913',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8224e363-c491-4a44-bb6b-b9e8974493d1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f5791703ccd54989903afbe71d00e5b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:14:18Z,use_quota=True,user_id='f8538f1b84ba4958b1f532c455a030d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:18 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec4b1cbd-4ada-40c7-974f-dcb5b009685c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:18 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec4b1cbd-4ada-40c7-974f-dcb5b009685c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:18 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d396122-097f-445f-819d-f4faebd86440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:18 devstack cinder-volume[86856]: DEBUG cinder.image.glance [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Creating Keystone auth plugin from conf {{(pid=86856) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 06 17:14:19 devstack sudo[97624]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2_g3b05sczdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b3a70268-1141-4755-9650-fd29871330f2" returned: 0 in 3.544s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:19 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2_g3b05sczdevstack@QuobyteHD, size 112.00 MB, duration 3.55 sec, destination /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b3a70268-1141-4755-9650-fd29871330f2 {{(pid=86856) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 17:14:19 devstack cinder-volume[86856]: INFO cinder.image.image_utils [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Converted 112.00 MB image at 31.59 MB/s
Nov 06 17:14:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b3a70268-1141-4755-9650-fd29871330f2 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:19 devstack sudo[97669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b3a70268-1141-4755-9650-fd29871330f2 1G
Nov 06 17:14:19 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:19 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d396122-097f-445f-819d-f4faebd86440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8224e363-c491-4a44-bb6b-b9e8974493d1', 'volume_name': 'volume-8224e363-c491-4a44-bb6b-b9e8974493d1', 'volume_size': 1, 'image_id': '420ae2ee-253a-40a6-ad62-b130f2314d4a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/420ae2ee-253a-40a6-ad62-b130f2314d4a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '805e2cf12fa14002ae5dfa994733f868', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '420ae2ee-253a-40a6-ad62-b130f2314d4a', 'created_at': datetime.datetime(2026, 11, 6, 15, 57, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 15, 57, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/420ae2ee-253a-40a6-ad62-b130f2314d4a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x71da66e9fdd0>}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:19 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae58596c-e0ea-4fef-8e3c-3bacb315f3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:19 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae58596c-e0ea-4fef-8e3c-3bacb315f3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:19 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bf45d18-0d04-4046-b276-e7efb0cfa64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:19 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Volume 8224e363-c491-4a44-bb6b-b9e8974493d1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8224e363-c491-4a44-bb6b-b9e8974493d1', 'volume_size': 1, 'image_id': '420ae2ee-253a-40a6-ad62-b130f2314d4a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/420ae2ee-253a-40a6-ad62-b130f2314d4a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '805e2cf12fa14002ae5dfa994733f868', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '420ae2ee-253a-40a6-ad62-b130f2314d4a', 'created_at': datetime.datetime(2026, 11, 6, 15, 57, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 15, 57, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/420ae2ee-253a-40a6-ad62-b130f2314d4a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x71da66e9fdd0>}
Nov 06 17:14:19 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Trying to clone 8224e363-c491-4a44-bb6b-b9e8974493d1 from image 420ae2ee-253a-40a6-ad62-b130f2314d4a at location (None, [{'url': 'file:///opt/stack/data/glance/images/420ae2ee-253a-40a6-ad62-b130f2314d4a', 'metadata': {}}]). {{(pid=86856) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 06 17:14:19 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b3a70268-1141-4755-9650-fd29871330f2 1G" returned: 0 in 0.801s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:19 devstack cinder-volume[86856]: DEBUG cinder.volume.volume_utils [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Downloaded image cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2 ((None, [{'url': 'file:///opt/stack/data/glance/images/cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2', 'metadata': {}}])) to volume b3a70268-1141-4755-9650-fd29871330f2 successfully. {{(pid=86856) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 06 17:14:19 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Temporary image cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2 for user 17722e39449b4ba6acadf4f37a9311e6 is deleted. {{(pid=86856) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 06 17:14:19 devstack cinder-volume[86856]: DEBUG cinder.volume.volume_utils [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Marking volume b3a70268-1141-4755-9650-fd29871330f2 as bootable. {{(pid=86856) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 06 17:14:19 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Copying metadata from image cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2 to b3a70268-1141-4755-9650-fd29871330f2. {{(pid=86856) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 06 17:14:19 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Creating volume glance metadata for volume b3a70268-1141-4755-9650-fd29871330f2 backed by image cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2 with: {'image_id': 'cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2', 'image_name': 'tempest-scenario-img--652235432', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86856) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 06 17:14:19 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_4wii2vxadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86856) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 06 17:14:19 devstack cinder-volume[86856]: INFO cinder.image.image_utils [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Image download 20.69 MB at 20.69 MB/s
Nov 06 17:14:20 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f5bfc1-285a-4cbc-80e4-5f127a1846d7]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:14:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_4wii2vxadevstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44a86ed0-a007-42b7-9da0-faefdd7a892f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3a70268-1141-4755-9650-fd29871330f2', 'volume_size': 1, 'image_id': 'cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--652235432', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6978a98141224ef1a9980ba9c2323a4f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2', 'created_at': datetime.datetime(2026, 11, 6, 16, 13, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 16, 14, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cfaaf372-41f7-4f41-8ffd-6ab7e4813fb2/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x71da66fe95b0>}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9df0b20-dbdb-4814-804b-9d1cd814cd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:20 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Volume volume-b3a70268-1141-4755-9650-fd29871330f2 (b3a70268-1141-4755-9650-fd29871330f2): created successfully
Nov 06 17:14:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9df0b20-dbdb-4814-804b-9d1cd814cd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Flow 'volume_create_manager' (9590e240-fc0f-4e2a-846c-3476a95b4c91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:14:20 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-04bfe3e1-f6b1-4253-834d-e845d78ab8c0 tempest-TestInstancesWithCinderVolumes-52000996 None] Created volume successfully.
Nov 06 17:14:20 devstack sudo[97676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_4wii2vxadevstack@QuobyteHD
Nov 06 17:14:20 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:20 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_4wii2vxadevstack@QuobyteHD" returned: 0 in 0.551s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:20 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Temporary image 420ae2ee-253a-40a6-ad62-b130f2314d4a is fetched for user f8538f1b84ba4958b1f532c455a030d1. {{(pid=86856) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 06 17:14:20 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e23485-0e87-4ec7-bb63-acf1f1fcac23]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:14:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_4wii2vxadevstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:20 devstack sudo[97681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_4wii2vxadevstack@QuobyteHD
Nov 06 17:14:20 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:21 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_4wii2vxadevstack@QuobyteHD" returned: 0 in 0.445s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:24 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c05433f1-22ac-4f91-961b-59210aeda6c2" returned: 0 in 7.908s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:24 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Image conversion details: src /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55, size 1024.00 MB, duration 7.91 sec, destination /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c05433f1-22ac-4f91-961b-59210aeda6c2 {{(pid=86856) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 17:14:24 devstack cinder-volume[86856]: INFO cinder.image.image_utils [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Converted 1024.00 MB image at 129.47 MB/s
Nov 06 17:14:24 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c05433f1-22ac-4f91-961b-59210aeda6c2 is being set with open permissions: ugo+rw
Nov 06 17:14:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c05433f1-22ac-4f91-961b-59210aeda6c2 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:24 devstack sudo[97690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c05433f1-22ac-4f91-961b-59210aeda6c2
Nov 06 17:14:24 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:24 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c05433f1-22ac-4f91-961b-59210aeda6c2" returned: 0 in 0.245s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:24 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-quobyte-c05433f1-22ac-4f91-961b-59210aeda6c2" released by "_copy_volume_from_snapshot" :: held 9.178s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:24 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-quobyte-63b6d6a5-de20-4f56-8414-3ee5305d551e-c05433f1-22ac-4f91-961b-59210aeda6c2" released by "_create_volume_from_snapshot" :: held 9.245s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.271s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-86e29382-4324-4245-816c-1da6d10d33be tempest-CinderUnicodeTest-1889886783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.730s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:24 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-86e29382-4324-4245-816c-1da6d10d33be tempest-CinderUnicodeTest-1889886783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aa7242d-35bb-4ca4-b33c-81516d1fa81a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b863de2d13342be901657bacc76c5b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:14:17Z,use_quota=True,user_id='8efea1b4cb954ffe9124d05e2eb4028f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:14:24 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-86e29382-4324-4245-816c-1da6d10d33be tempest-CinderUnicodeTest-1889886783 None] Creating volume 2aa7242d-35bb-4ca4-b33c-81516d1fa81a {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:14:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-86e29382-4324-4245-816c-1da6d10d33be tempest-CinderUnicodeTest-1889886783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-86e29382-4324-4245-816c-1da6d10d33be tempest-CinderUnicodeTest-1889886783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:24 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-86e29382-4324-4245-816c-1da6d10d33be tempest-CinderUnicodeTest-1889886783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:14:24 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-86e29382-4324-4245-816c-1da6d10d33be tempest-CinderUnicodeTest-1889886783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:14:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-86e29382-4324-4245-816c-1da6d10d33be tempest-CinderUnicodeTest-1889886783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:24 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-86e29382-4324-4245-816c-1da6d10d33be tempest-CinderUnicodeTest-1889886783 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:14:24 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-86e29382-4324-4245-816c-1da6d10d33be tempest-CinderUnicodeTest-1889886783 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:14:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-86e29382-4324-4245-816c-1da6d10d33be tempest-CinderUnicodeTest-1889886783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2aa7242d-35bb-4ca4-b33c-81516d1fa81a 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:24 devstack sudo[97693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2aa7242d-35bb-4ca4-b33c-81516d1fa81a 1073741824
Nov 06 17:14:24 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:24 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d2723e2-a6ce-47f8-bd4e-f90f11dfdb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c05433f1-22ac-4f91-961b-59210aeda6c2', 'volume_size': 1, 'snapshot_id': '63b6d6a5-de20-4f56-8414-3ee5305d551e'}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:24 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab2f5c77-4bd7-496e-af19-30aa795ffa75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:24 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Volume volume-c05433f1-22ac-4f91-961b-59210aeda6c2 (c05433f1-22ac-4f91-961b-59210aeda6c2): created successfully
Nov 06 17:14:24 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab2f5c77-4bd7-496e-af19-30aa795ffa75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:24 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Flow 'volume_create_manager' (2b2779c4-58e1-49e4-ba81-ce6410f4083f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:14:24 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-a1bc9cfd-3605-410e-a80a-562062dc76ad tempest-VolumesSnapshotTestJSON-349969979 None] Created volume successfully.
Nov 06 17:14:25 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-40ee45aa-bb4d-4ddd-98e6-9bd7abe8e5c6 tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "cinder-c05433f1-22ac-4f91-961b-59210aeda6c2-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:25 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-40ee45aa-bb4d-4ddd-98e6-9bd7abe8e5c6 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-c05433f1-22ac-4f91-961b-59210aeda6c2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:25 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-86e29382-4324-4245-816c-1da6d10d33be tempest-CinderUnicodeTest-1889886783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2aa7242d-35bb-4ca4-b33c-81516d1fa81a 1073741824" returned: 0 in 0.574s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:25 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-40ee45aa-bb4d-4ddd-98e6-9bd7abe8e5c6 tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "cinder-quobyte-c05433f1-22ac-4f91-961b-59210aeda6c2" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-86e29382-4324-4245-816c-1da6d10d33be tempest-CinderUnicodeTest-1889886783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2aa7242d-35bb-4ca4-b33c-81516d1fa81a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:25 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-40ee45aa-bb4d-4ddd-98e6-9bd7abe8e5c6 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-quobyte-c05433f1-22ac-4f91-961b-59210aeda6c2" acquired by "delete_volume" :: waited 0.042s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:25 devstack sudo[97699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2aa7242d-35bb-4ca4-b33c-81516d1fa81a
Nov 06 17:14:25 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:25 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b41bf86-bc1d-4443-9aa2-692eb1802d53]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:14:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-40ee45aa-bb4d-4ddd-98e6-9bd7abe8e5c6 tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c05433f1-22ac-4f91-961b-59210aeda6c2 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:25 devstack sudo[97701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c05433f1-22ac-4f91-961b-59210aeda6c2
Nov 06 17:14:25 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:25 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-86e29382-4324-4245-816c-1da6d10d33be tempest-CinderUnicodeTest-1889886783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2aa7242d-35bb-4ca4-b33c-81516d1fa81a" returned: 0 in 0.322s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:25 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-86e29382-4324-4245-816c-1da6d10d33be tempest-CinderUnicodeTest-1889886783 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:14:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-86e29382-4324-4245-816c-1da6d10d33be tempest-CinderUnicodeTest-1889886783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.243s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:25 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1128711913',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8224e363-c491-4a44-bb6b-b9e8974493d1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f5791703ccd54989903afbe71d00e5b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:14:18Z,use_quota=True,user_id='f8538f1b84ba4958b1f532c455a030d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:14:25 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Creating volume 8224e363-c491-4a44-bb6b-b9e8974493d1 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:14:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:25 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:14:25 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:14:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:25 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:14:25 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:14:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8224e363-c491-4a44-bb6b-b9e8974493d1 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:25 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-86e29382-4324-4245-816c-1da6d10d33be tempest-CinderUnicodeTest-1889886783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d85c0583-9b08-4e31-a73a-c39b1651266b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aa7242d-35bb-4ca4-b33c-81516d1fa81a', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:25 devstack sudo[97711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8224e363-c491-4a44-bb6b-b9e8974493d1 1073741824
Nov 06 17:14:25 devstack sudo[97711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:25 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-86e29382-4324-4245-816c-1da6d10d33be tempest-CinderUnicodeTest-1889886783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92df2b70-4ed3-426e-842a-b0664cc0bbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:25 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-86e29382-4324-4245-816c-1da6d10d33be tempest-CinderUnicodeTest-1889886783 None] Volume volume-2aa7242d-35bb-4ca4-b33c-81516d1fa81a (2aa7242d-35bb-4ca4-b33c-81516d1fa81a): created successfully
Nov 06 17:14:25 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-86e29382-4324-4245-816c-1da6d10d33be tempest-CinderUnicodeTest-1889886783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92df2b70-4ed3-426e-842a-b0664cc0bbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:25 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-86e29382-4324-4245-816c-1da6d10d33be tempest-CinderUnicodeTest-1889886783 None] Flow 'volume_create_manager' (243af6e7-6b99-4e93-8874-bd7a43cde086) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:14:25 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-86e29382-4324-4245-816c-1da6d10d33be tempest-CinderUnicodeTest-1889886783 None] Created volume successfully.
Nov 06 17:14:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-6ada4e37-869b-43bc-9484-ba51992d9a94 req-3716531f-3464-4951-9bb2-6a18e432a9de tempest-TestInstancesWithCinderVolumes-52000996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:25 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-40ee45aa-bb4d-4ddd-98e6-9bd7abe8e5c6 tempest-VolumesSnapshotTestJSON-349969979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c05433f1-22ac-4f91-961b-59210aeda6c2" returned: 0 in 0.501s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-40ee45aa-bb4d-4ddd-98e6-9bd7abe8e5c6 tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c05433f1-22ac-4f91-961b-59210aeda6c2 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:25 devstack sudo[97718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c05433f1-22ac-4f91-961b-59210aeda6c2
Nov 06 17:14:25 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:26 devstack sudo[97711]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8224e363-c491-4a44-bb6b-b9e8974493d1 1073741824" returned: 0 in 0.523s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:26 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-40ee45aa-bb4d-4ddd-98e6-9bd7abe8e5c6 tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c05433f1-22ac-4f91-961b-59210aeda6c2" returned: 0 in 0.321s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:26 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-40ee45aa-bb4d-4ddd-98e6-9bd7abe8e5c6 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-quobyte-c05433f1-22ac-4f91-961b-59210aeda6c2" released by "delete_volume" :: held 0.919s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8224e363-c491-4a44-bb6b-b9e8974493d1 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:26 devstack sudo[97726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8224e363-c491-4a44-bb6b-b9e8974493d1
Nov 06 17:14:26 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:26 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-40ee45aa-bb4d-4ddd-98e6-9bd7abe8e5c6 tempest-VolumesSnapshotTestJSON-349969979 None] Created reservations ['671948ba-f55c-4a90-a686-957192af5f32', '8789c610-09a5-450d-a2ed-a549d2b19df1', 'acd8e978-b130-49e5-aad3-001868280206', '7747277d-81d3-4f26-a2da-872b282a863b'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:14:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-40ee45aa-bb4d-4ddd-98e6-9bd7abe8e5c6 tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-40ee45aa-bb4d-4ddd-98e6-9bd7abe8e5c6 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:26 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-40ee45aa-bb4d-4ddd-98e6-9bd7abe8e5c6 tempest-VolumesSnapshotTestJSON-349969979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:14:26 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-40ee45aa-bb4d-4ddd-98e6-9bd7abe8e5c6 tempest-VolumesSnapshotTestJSON-349969979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:14:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-40ee45aa-bb4d-4ddd-98e6-9bd7abe8e5c6 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-40ee45aa-bb4d-4ddd-98e6-9bd7abe8e5c6 tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:26 devstack sudo[97728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:14:26 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:26 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8224e363-c491-4a44-bb6b-b9e8974493d1" returned: 0 in 0.484s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:26 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:14:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-6ada4e37-869b-43bc-9484-ba51992d9a94 req-3716531f-3464-4951-9bb2-6a18e432a9de tempest-TestInstancesWithCinderVolumes-52000996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.924s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-6ada4e37-869b-43bc-9484-ba51992d9a94 req-3716531f-3464-4951-9bb2-6a18e432a9de tempest-TestInstancesWithCinderVolumes-52000996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:26 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-40ee45aa-bb4d-4ddd-98e6-9bd7abe8e5c6 tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.311s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:26 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-40ee45aa-bb4d-4ddd-98e6-9bd7abe8e5c6 tempest-VolumesSnapshotTestJSON-349969979 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:14:26 devstack cinder-volume[86856]: DEBUG cinder.volume.volume_utils [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Attempting download of 420ae2ee-253a-40a6-ad62-b130f2314d4a ((None, [{'url': 'file:///opt/stack/data/glance/images/420ae2ee-253a-40a6-ad62-b130f2314d4a', 'metadata': {}}])) to volume 8224e363-c491-4a44-bb6b-b9e8974493d1. {{(pid=86856) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 06 17:14:26 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-40ee45aa-bb4d-4ddd-98e6-9bd7abe8e5c6 tempest-VolumesSnapshotTestJSON-349969979 None] Deleted volume successfully.
Nov 06 17:14:26 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-40ee45aa-bb4d-4ddd-98e6-9bd7abe8e5c6 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-c05433f1-22ac-4f91-961b-59210aeda6c2-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:26 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-6ada4e37-869b-43bc-9484-ba51992d9a94 req-3716531f-3464-4951-9bb2-6a18e432a9de tempest-TestInstancesWithCinderVolumes-52000996 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316', 'name': 'volume-b3a70268-1141-4755-9650-fd29871330f2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ce85d111-fe60-4983-8ef5-caef064b5f9e', 'enforce_multipath': True} {{(pid=86856) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 17:14:26 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc036a6-0e27-466d-9f9f-ec5b5927150f]: (4, 'raw') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:14:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_420ae2ee-253a-40a6-ad62-b130f2314d4a_6i72tdqp {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:26 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-6ada4e37-869b-43bc-9484-ba51992d9a94 req-3716531f-3464-4951-9bb2-6a18e432a9de tempest-TestInstancesWithCinderVolumes-52000996 None] attachment_update completed successfully.
Nov 06 17:14:26 devstack sudo[97732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_420ae2ee-253a-40a6-ad62-b130f2314d4a_6i72tdqp
Nov 06 17:14:26 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:27 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e5a26ee-9906-4851-8acc-986e68d04dae tempest-CinderUnicodeTest-1889886783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:14:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7e5a26ee-9906-4851-8acc-986e68d04dae tempest-CinderUnicodeTest-1889886783 None] Flow 'volume_create_manager' (3735818c-0ee3-4736-ab3f-54d248a437cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:14:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7e5a26ee-9906-4851-8acc-986e68d04dae tempest-CinderUnicodeTest-1889886783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8482958d-474b-4d15-94a6-0e4a7b32128e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7e5a26ee-9906-4851-8acc-986e68d04dae tempest-CinderUnicodeTest-1889886783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8482958d-474b-4d15-94a6-0e4a7b32128e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:14:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-845188804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b863de2d13342be901657bacc76c5b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:14:27Z,use_quota=True,user_id='8efea1b4cb954ffe9124d05e2eb4028f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:27 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7e5a26ee-9906-4851-8acc-986e68d04dae tempest-CinderUnicodeTest-1889886783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6de3f6b-a40a-47a9-b1fc-81f314917867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7e5a26ee-9906-4851-8acc-986e68d04dae tempest-CinderUnicodeTest-1889886783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6de3f6b-a40a-47a9-b1fc-81f314917867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7e5a26ee-9906-4851-8acc-986e68d04dae tempest-CinderUnicodeTest-1889886783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61215727-f17c-4493-9484-ac868a40746a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7e5a26ee-9906-4851-8acc-986e68d04dae tempest-CinderUnicodeTest-1889886783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61215727-f17c-4493-9484-ac868a40746a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69', 'volume_name': 'volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7e5a26ee-9906-4851-8acc-986e68d04dae tempest-CinderUnicodeTest-1889886783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4c470e8-c8ab-446c-b323-afe4ba5d5f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7e5a26ee-9906-4851-8acc-986e68d04dae tempest-CinderUnicodeTest-1889886783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4c470e8-c8ab-446c-b323-afe4ba5d5f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7e5a26ee-9906-4851-8acc-986e68d04dae tempest-CinderUnicodeTest-1889886783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51870409-3078-4180-85d6-31c00fb8a3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:27 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-7e5a26ee-9906-4851-8acc-986e68d04dae tempest-CinderUnicodeTest-1889886783 None] Volume 6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69', 'volume_size': 1}
Nov 06 17:14:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7e5a26ee-9906-4851-8acc-986e68d04dae tempest-CinderUnicodeTest-1889886783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7e5a26ee-9906-4851-8acc-986e68d04dae tempest-CinderUnicodeTest-1889886783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:27 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7e5a26ee-9906-4851-8acc-986e68d04dae tempest-CinderUnicodeTest-1889886783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:14:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-845188804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b863de2d13342be901657bacc76c5b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:14:27Z,use_quota=True,user_id='8efea1b4cb954ffe9124d05e2eb4028f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:14:27 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-7e5a26ee-9906-4851-8acc-986e68d04dae tempest-CinderUnicodeTest-1889886783 None] Creating volume 6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:14:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7e5a26ee-9906-4851-8acc-986e68d04dae tempest-CinderUnicodeTest-1889886783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7e5a26ee-9906-4851-8acc-986e68d04dae tempest-CinderUnicodeTest-1889886783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:27 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7e5a26ee-9906-4851-8acc-986e68d04dae tempest-CinderUnicodeTest-1889886783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:14:27 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7e5a26ee-9906-4851-8acc-986e68d04dae tempest-CinderUnicodeTest-1889886783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:14:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7e5a26ee-9906-4851-8acc-986e68d04dae tempest-CinderUnicodeTest-1889886783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:27 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7e5a26ee-9906-4851-8acc-986e68d04dae tempest-CinderUnicodeTest-1889886783 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:14:27 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-7e5a26ee-9906-4851-8acc-986e68d04dae tempest-CinderUnicodeTest-1889886783 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:14:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7e5a26ee-9906-4851-8acc-986e68d04dae tempest-CinderUnicodeTest-1889886783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_420ae2ee-253a-40a6-ad62-b130f2314d4a_6i72tdqp" returned: 0 in 0.550s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_420ae2ee-253a-40a6-ad62-b130f2314d4a_6i72tdqp {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:27 devstack sudo[97737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69 1073741824
Nov 06 17:14:27 devstack sudo[97737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:27 devstack sudo[97738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_420ae2ee-253a-40a6-ad62-b130f2314d4a_6i72tdqp
Nov 06 17:14:27 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:27 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d778b08b-b637-4f54-8098-bc619366b516 tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "cinder-63b6d6a5-de20-4f56-8414-3ee5305d551e-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:27 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d778b08b-b637-4f54-8098-bc619366b516 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-63b6d6a5-de20-4f56-8414-3ee5305d551e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:27 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d778b08b-b637-4f54-8098-bc619366b516 tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "cinder-quobyte-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:27 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d778b08b-b637-4f54-8098-bc619366b516 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-quobyte-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:27 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d778b08b-b637-4f54-8098-bc619366b516 tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "cinder-quobyte-63b6d6a5-de20-4f56-8414-3ee5305d551e" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:27 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d778b08b-b637-4f54-8098-bc619366b516 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-quobyte-63b6d6a5-de20-4f56-8414-3ee5305d551e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:27 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-d778b08b-b637-4f54-8098-bc619366b516 tempest-VolumesSnapshotTestJSON-349969979 None] Deleting offline snapshot 63b6d6a5-de20-4f56-8414-3ee5305d551e of volume 726a33a5-1e4c-4d35-9527-3ea7dfe5bb55 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:14:27 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-d778b08b-b637-4f54-8098-bc619366b516 tempest-VolumesSnapshotTestJSON-349969979 None] snapshot_file for this snap is: volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55.63b6d6a5-de20-4f56-8414-3ee5305d551e {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:14:27 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf076db3-c462-4e5f-98aa-9447d5308da9]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:14:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d778b08b-b637-4f54-8098-bc619366b516 tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55.63b6d6a5-de20-4f56-8414-3ee5305d551e {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:27 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_420ae2ee-253a-40a6-ad62-b130f2314d4a_6i72tdqp" returned: 1 in 0.437s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_420ae2ee-253a-40a6-ad62-b130f2314d4a_6i72tdqp' failed. Not Retrying. {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 17:14:27 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d1535a-d522-4adb-8cc5-91a50cf4dd41]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:14:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_4wii2vxadevstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:27 devstack sudo[97744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55.63b6d6a5-de20-4f56-8414-3ee5305d551e
Nov 06 17:14:27 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:27 devstack sudo[97748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_4wii2vxadevstack@QuobyteHD
Nov 06 17:14:27 devstack sudo[97737]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:27 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7e5a26ee-9906-4851-8acc-986e68d04dae tempest-CinderUnicodeTest-1889886783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69 1073741824" returned: 0 in 0.637s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7e5a26ee-9906-4851-8acc-986e68d04dae tempest-CinderUnicodeTest-1889886783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:28 devstack sudo[97751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69
Nov 06 17:14:28 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:28 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d778b08b-b637-4f54-8098-bc619366b516 tempest-VolumesSnapshotTestJSON-349969979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55.63b6d6a5-de20-4f56-8414-3ee5305d551e" returned: 0 in 0.571s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:28 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-d778b08b-b637-4f54-8098-bc619366b516 tempest-VolumesSnapshotTestJSON-349969979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:14:28 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9b044c-a0ee-4a97-b027-d5864a15042c]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:14:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d778b08b-b637-4f54-8098-bc619366b516 tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:28 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_4wii2vxadevstack@QuobyteHD" returned: 0 in 0.523s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:28 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] 420ae2ee-253a-40a6-ad62-b130f2314d4a was qcow2, converting to qcow2 {{(pid=86856) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 06 17:14:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_4wii2vxadevstack@QuobyteHD /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8224e363-c491-4a44-bb6b-b9e8974493d1 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:28 devstack sudo[97764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_4wii2vxadevstack@QuobyteHD /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8224e363-c491-4a44-bb6b-b9e8974493d1
Nov 06 17:14:28 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:28 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7e5a26ee-9906-4851-8acc-986e68d04dae tempest-CinderUnicodeTest-1889886783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69" returned: 0 in 0.374s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:28 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7e5a26ee-9906-4851-8acc-986e68d04dae tempest-CinderUnicodeTest-1889886783 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:14:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7e5a26ee-9906-4851-8acc-986e68d04dae tempest-CinderUnicodeTest-1889886783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:28 devstack sudo[97759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55
Nov 06 17:14:28 devstack sudo[97759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:28 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7e5a26ee-9906-4851-8acc-986e68d04dae tempest-CinderUnicodeTest-1889886783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51870409-3078-4180-85d6-31c00fb8a3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:28 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7e5a26ee-9906-4851-8acc-986e68d04dae tempest-CinderUnicodeTest-1889886783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae36a491-e185-4726-bc63-4255f24a4579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:28 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-7e5a26ee-9906-4851-8acc-986e68d04dae tempest-CinderUnicodeTest-1889886783 None] Volume volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69 (6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69): created successfully
Nov 06 17:14:28 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7e5a26ee-9906-4851-8acc-986e68d04dae tempest-CinderUnicodeTest-1889886783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae36a491-e185-4726-bc63-4255f24a4579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:28 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-7e5a26ee-9906-4851-8acc-986e68d04dae tempest-CinderUnicodeTest-1889886783 None] Flow 'volume_create_manager' (3735818c-0ee3-4736-ab3f-54d248a437cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:14:28 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-7e5a26ee-9906-4851-8acc-986e68d04dae tempest-CinderUnicodeTest-1889886783 None] Created volume successfully.
Nov 06 17:14:28 devstack sudo[97759]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d778b08b-b637-4f54-8098-bc619366b516 tempest-VolumesSnapshotTestJSON-349969979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55" returned: 0 in 0.631s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d778b08b-b637-4f54-8098-bc619366b516 tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55.63b6d6a5-de20-4f56-8414-3ee5305d551e {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:28 devstack sudo[97878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55.63b6d6a5-de20-4f56-8414-3ee5305d551e
Nov 06 17:14:28 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:29 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d778b08b-b637-4f54-8098-bc619366b516 tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55.63b6d6a5-de20-4f56-8414-3ee5305d551e" returned: 0 in 0.739s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d778b08b-b637-4f54-8098-bc619366b516 tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55.63b6d6a5-de20-4f56-8414-3ee5305d551e {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:29 devstack sudo[98231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55.63b6d6a5-de20-4f56-8414-3ee5305d551e
Nov 06 17:14:29 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5064dae4-d521-4dc0-a33f-a8f1dff2abb4 tempest-CinderUnicodeTest-1889886783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5064dae4-d521-4dc0-a33f-a8f1dff2abb4 tempest-CinderUnicodeTest-1889886783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:30 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-5064dae4-d521-4dc0-a33f-a8f1dff2abb4 tempest-CinderUnicodeTest-1889886783 None] Creating offline snapshot 4d830267-261e-4734-9aae-f82f71028167 of volume 6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69 {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:14:30 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fcc2a7-3f70-42be-92d8-d45439131d5b]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:14:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5064dae4-d521-4dc0-a33f-a8f1dff2abb4 tempest-CinderUnicodeTest-1889886783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:30 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d778b08b-b637-4f54-8098-bc619366b516 tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55.63b6d6a5-de20-4f56-8414-3ee5305d551e" returned: 0 in 0.531s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:30 devstack sudo[98256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69
Nov 06 17:14:30 devstack sudo[98256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:30 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d778b08b-b637-4f54-8098-bc619366b516 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-quobyte-63b6d6a5-de20-4f56-8414-3ee5305d551e" released by "_delete_snapshot" :: held 2.701s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:30 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d778b08b-b637-4f54-8098-bc619366b516 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-quobyte-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55" released by "delete_snapshot" :: held 2.738s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:30 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-d778b08b-b637-4f54-8098-bc619366b516 tempest-VolumesSnapshotTestJSON-349969979 None] Created reservations ['7b1d6bb4-5a0d-4073-865d-74017af64968', '06628cd5-7430-4151-bb63-00c19afb4f07', '152c8e8e-6a2e-4f3d-ade2-713606f53c96', '636f5847-f094-4b35-984f-a1b541bec272'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:14:30 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-d778b08b-b637-4f54-8098-bc619366b516 tempest-VolumesSnapshotTestJSON-349969979 None] Delete snapshot completed successfully.
Nov 06 17:14:30 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d778b08b-b637-4f54-8098-bc619366b516 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-63b6d6a5-de20-4f56-8414-3ee5305d551e-delete_snapshot" released by "delete_snapshot" :: held 3.086s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:30 devstack sudo[98256]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5064dae4-d521-4dc0-a33f-a8f1dff2abb4 tempest-CinderUnicodeTest-1889886783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69" returned: 0 in 0.670s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5064dae4-d521-4dc0-a33f-a8f1dff2abb4 tempest-CinderUnicodeTest-1889886783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69.4d830267-261e-4734-9aae-f82f71028167 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:30 devstack sudo[98271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69.4d830267-261e-4734-9aae-f82f71028167 1G
Nov 06 17:14:30 devstack sudo[98271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:30 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-82ec1a74-0aea-4818-b373-141d38743133 tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "cinder-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:30 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-82ec1a74-0aea-4818-b373-141d38743133 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:30 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-82ec1a74-0aea-4818-b373-141d38743133 tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "cinder-quobyte-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:30 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-82ec1a74-0aea-4818-b373-141d38743133 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-quobyte-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55" acquired by "delete_volume" :: waited 0.024s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:31 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8bbcf6-dec7-4fdf-8dce-bcfb13ba550b]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:14:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-82ec1a74-0aea-4818-b373-141d38743133 tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:31 devstack sudo[98274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55
Nov 06 17:14:31 devstack sudo[98274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:31 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_4wii2vxadevstack@QuobyteHD /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8224e363-c491-4a44-bb6b-b9e8974493d1" returned: 0 in 2.978s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:31 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_4wii2vxadevstack@QuobyteHD, size 112.00 MB, duration 2.98 sec, destination /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8224e363-c491-4a44-bb6b-b9e8974493d1 {{(pid=86856) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 17:14:31 devstack cinder-volume[86856]: INFO cinder.image.image_utils [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Converted 112.00 MB image at 37.54 MB/s
Nov 06 17:14:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8224e363-c491-4a44-bb6b-b9e8974493d1 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:31 devstack sudo[98283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8224e363-c491-4a44-bb6b-b9e8974493d1 1G
Nov 06 17:14:31 devstack sudo[98283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:31 devstack sudo[98271]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5064dae4-d521-4dc0-a33f-a8f1dff2abb4 tempest-CinderUnicodeTest-1889886783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69.4d830267-261e-4734-9aae-f82f71028167 1G" returned: 0 in 0.715s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5064dae4-d521-4dc0-a33f-a8f1dff2abb4 tempest-CinderUnicodeTest-1889886783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69.4d830267-261e-4734-9aae-f82f71028167 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:31 devstack sudo[98285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69.4d830267-261e-4734-9aae-f82f71028167
Nov 06 17:14:31 devstack sudo[98285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:31 devstack sudo[98274]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-82ec1a74-0aea-4818-b373-141d38743133 tempest-VolumesSnapshotTestJSON-349969979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55" returned: 0 in 0.753s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-82ec1a74-0aea-4818-b373-141d38743133 tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:31 devstack sudo[98293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55
Nov 06 17:14:31 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:31 devstack sudo[98283]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8224e363-c491-4a44-bb6b-b9e8974493d1 1G" returned: 0 in 0.591s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:31 devstack cinder-volume[86856]: DEBUG cinder.volume.volume_utils [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Downloaded image 420ae2ee-253a-40a6-ad62-b130f2314d4a ((None, [{'url': 'file:///opt/stack/data/glance/images/420ae2ee-253a-40a6-ad62-b130f2314d4a', 'metadata': {}}])) to volume 8224e363-c491-4a44-bb6b-b9e8974493d1 successfully. {{(pid=86856) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 06 17:14:31 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Temporary image 420ae2ee-253a-40a6-ad62-b130f2314d4a for user f8538f1b84ba4958b1f532c455a030d1 is deleted. {{(pid=86856) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 06 17:14:31 devstack cinder-volume[86856]: DEBUG cinder.volume.volume_utils [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Marking volume 8224e363-c491-4a44-bb6b-b9e8974493d1 as bootable. {{(pid=86856) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 06 17:14:31 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Copying metadata from image 420ae2ee-253a-40a6-ad62-b130f2314d4a to 8224e363-c491-4a44-bb6b-b9e8974493d1. {{(pid=86856) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 06 17:14:31 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Creating volume glance metadata for volume 8224e363-c491-4a44-bb6b-b9e8974493d1 backed by image 420ae2ee-253a-40a6-ad62-b130f2314d4a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '420ae2ee-253a-40a6-ad62-b130f2314d4a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86856) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 06 17:14:31 devstack sudo[98285]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5064dae4-d521-4dc0-a33f-a8f1dff2abb4 tempest-CinderUnicodeTest-1889886783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69.4d830267-261e-4734-9aae-f82f71028167" returned: 0 in 0.490s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:32 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-5064dae4-d521-4dc0-a33f-a8f1dff2abb4 tempest-CinderUnicodeTest-1889886783 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69.4d830267-261e-4734-9aae-f82f71028167 is being set with open permissions: ugo+rw
Nov 06 17:14:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5064dae4-d521-4dc0-a33f-a8f1dff2abb4 tempest-CinderUnicodeTest-1889886783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69.4d830267-261e-4734-9aae-f82f71028167 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:32 devstack sudo[98299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69.4d830267-261e-4734-9aae-f82f71028167
Nov 06 17:14:32 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bf45d18-0d04-4046-b276-e7efb0cfa64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8224e363-c491-4a44-bb6b-b9e8974493d1', 'volume_size': 1, 'image_id': '420ae2ee-253a-40a6-ad62-b130f2314d4a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/420ae2ee-253a-40a6-ad62-b130f2314d4a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '805e2cf12fa14002ae5dfa994733f868', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '420ae2ee-253a-40a6-ad62-b130f2314d4a', 'created_at': datetime.datetime(2026, 11, 6, 15, 57, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 15, 57, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/420ae2ee-253a-40a6-ad62-b130f2314d4a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x71da66e9fdd0>}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e4576fc-3a2a-4221-a96b-ffa28fbd9e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:32 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-82ec1a74-0aea-4818-b373-141d38743133 tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55" returned: 0 in 0.365s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:32 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-82ec1a74-0aea-4818-b373-141d38743133 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-quobyte-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55" released by "delete_volume" :: held 1.229s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:32 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Volume volume-8224e363-c491-4a44-bb6b-b9e8974493d1 (8224e363-c491-4a44-bb6b-b9e8974493d1): created successfully
Nov 06 17:14:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e4576fc-3a2a-4221-a96b-ffa28fbd9e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Flow 'volume_create_manager' (49dd97e5-4ec6-4204-a65f-6a005626ee8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:14:32 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-00b45b48-a93b-45fe-ab88-f14da8a1fed0 tempest-VolumesGetTest-776201853 None] Created volume successfully.
Nov 06 17:14:32 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-82ec1a74-0aea-4818-b373-141d38743133 tempest-VolumesSnapshotTestJSON-349969979 None] Created reservations ['1a5a70a2-5b0f-4150-9dd1-63417f33aa93', '218ea1fe-d232-4ab0-97d9-aee0f35bc376', 'a833dc98-d71e-46e0-9b36-73e6b14efee7', '61b8ca28-91d9-47e9-b3af-940da887357f'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:14:32 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5064dae4-d521-4dc0-a33f-a8f1dff2abb4 tempest-CinderUnicodeTest-1889886783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69.4d830267-261e-4734-9aae-f82f71028167" returned: 0 in 0.357s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-82ec1a74-0aea-4818-b373-141d38743133 tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-82ec1a74-0aea-4818-b373-141d38743133 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:32 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-82ec1a74-0aea-4818-b373-141d38743133 tempest-VolumesSnapshotTestJSON-349969979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:14:32 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-82ec1a74-0aea-4818-b373-141d38743133 tempest-VolumesSnapshotTestJSON-349969979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:14:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-82ec1a74-0aea-4818-b373-141d38743133 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-82ec1a74-0aea-4818-b373-141d38743133 tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:32 devstack sudo[98303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:14:32 devstack sudo[98303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5064dae4-d521-4dc0-a33f-a8f1dff2abb4 tempest-CinderUnicodeTest-1889886783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:32 devstack sudo[98305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69.info
Nov 06 17:14:32 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:32 devstack sudo[98303]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-82ec1a74-0aea-4818-b373-141d38743133 tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.335s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:32 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-82ec1a74-0aea-4818-b373-141d38743133 tempest-VolumesSnapshotTestJSON-349969979 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:14:32 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-82ec1a74-0aea-4818-b373-141d38743133 tempest-VolumesSnapshotTestJSON-349969979 None] Deleted volume successfully.
Nov 06 17:14:32 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:32 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-82ec1a74-0aea-4818-b373-141d38743133 tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-726a33a5-1e4c-4d35-9527-3ea7dfe5bb55-delete_volume" released by "delete_volume" :: held 1.896s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5064dae4-d521-4dc0-a33f-a8f1dff2abb4 tempest-CinderUnicodeTest-1889886783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69.info" returned: 0 in 0.332s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:32 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-5064dae4-d521-4dc0-a33f-a8f1dff2abb4 tempest-CinderUnicodeTest-1889886783 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69.info is being set with open permissions: ugo+rw
Nov 06 17:14:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5064dae4-d521-4dc0-a33f-a8f1dff2abb4 tempest-CinderUnicodeTest-1889886783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:32 devstack sudo[98309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69.info
Nov 06 17:14:32 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:33 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5064dae4-d521-4dc0-a33f-a8f1dff2abb4 tempest-CinderUnicodeTest-1889886783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69.info" returned: 0 in 0.502s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5064dae4-d521-4dc0-a33f-a8f1dff2abb4 tempest-CinderUnicodeTest-1889886783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.283s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:33 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f9acb271-5668-4375-a9aa-1cd0ddd1c10a tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "cinder-01361e88-13cd-4903-a59e-4ca0cd5c8f85-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:33 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f9acb271-5668-4375-a9aa-1cd0ddd1c10a tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-01361e88-13cd-4903-a59e-4ca0cd5c8f85-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:33 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-5064dae4-d521-4dc0-a33f-a8f1dff2abb4 tempest-CinderUnicodeTest-1889886783 None] Create snapshot completed successfully
Nov 06 17:14:33 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f9acb271-5668-4375-a9aa-1cd0ddd1c10a tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "cinder-quobyte-01361e88-13cd-4903-a59e-4ca0cd5c8f85" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:33 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f9acb271-5668-4375-a9aa-1cd0ddd1c10a tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-quobyte-01361e88-13cd-4903-a59e-4ca0cd5c8f85" acquired by "delete_volume" :: waited 0.016s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:33 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[5726248c-4529-4212-865f-9b129122c781]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:14:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f9acb271-5668-4375-a9aa-1cd0ddd1c10a tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:33 devstack sudo[98312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85
Nov 06 17:14:33 devstack sudo[98312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:34 devstack sudo[98312]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f9acb271-5668-4375-a9aa-1cd0ddd1c10a tempest-VolumesSnapshotTestJSON-349969979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85" returned: 0 in 0.625s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f9acb271-5668-4375-a9aa-1cd0ddd1c10a tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:34 devstack sudo[98317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85
Nov 06 17:14:34 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:34 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-81d3ac9b-8c59-4c64-9a68-c76ea34b971c tempest-VolumesGetTest-776201853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:14:34 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-81d3ac9b-8c59-4c64-9a68-c76ea34b971c tempest-VolumesGetTest-776201853 None] Flow 'volume_create_manager' (3ec97d19-4d43-4696-af43-0d41e64187bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:14:34 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-81d3ac9b-8c59-4c64-9a68-c76ea34b971c tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f23f5448-8e93-4666-abb4-00328a91e8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:34 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-81d3ac9b-8c59-4c64-9a68-c76ea34b971c tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f23f5448-8e93-4666-abb4-00328a91e8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:14:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-12359093',display_name='tempest-VolumesGetTest-Volume-1001537094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d321176-2dd2-446f-96ba-ba2d61ae8d5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5791703ccd54989903afbe71d00e5b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:14:34Z,use_quota=True,user_id='f8538f1b84ba4958b1f532c455a030d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:34 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-81d3ac9b-8c59-4c64-9a68-c76ea34b971c tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c54f3a0-ead7-4bbf-9e40-95718326e2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:34 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-81d3ac9b-8c59-4c64-9a68-c76ea34b971c tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c54f3a0-ead7-4bbf-9e40-95718326e2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:34 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-81d3ac9b-8c59-4c64-9a68-c76ea34b971c tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2861fb3f-4640-4c13-a3b3-7a9152343249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:34 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-81d3ac9b-8c59-4c64-9a68-c76ea34b971c tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2861fb3f-4640-4c13-a3b3-7a9152343249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d321176-2dd2-446f-96ba-ba2d61ae8d5d', 'volume_name': 'volume-1d321176-2dd2-446f-96ba-ba2d61ae8d5d', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:34 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-81d3ac9b-8c59-4c64-9a68-c76ea34b971c tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde5d550-41db-42db-bc7d-38f959f0b083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:34 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-81d3ac9b-8c59-4c64-9a68-c76ea34b971c tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde5d550-41db-42db-bc7d-38f959f0b083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:34 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-81d3ac9b-8c59-4c64-9a68-c76ea34b971c tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dd9e8be-c45b-4cb0-8981-dcee12f8b42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:34 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-81d3ac9b-8c59-4c64-9a68-c76ea34b971c tempest-VolumesGetTest-776201853 None] Volume 1d321176-2dd2-446f-96ba-ba2d61ae8d5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d321176-2dd2-446f-96ba-ba2d61ae8d5d', 'volume_size': 1}
Nov 06 17:14:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-81d3ac9b-8c59-4c64-9a68-c76ea34b971c tempest-VolumesGetTest-776201853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-81d3ac9b-8c59-4c64-9a68-c76ea34b971c tempest-VolumesGetTest-776201853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-81d3ac9b-8c59-4c64-9a68-c76ea34b971c tempest-VolumesGetTest-776201853 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:14:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-12359093',display_name='tempest-VolumesGetTest-Volume-1001537094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d321176-2dd2-446f-96ba-ba2d61ae8d5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5791703ccd54989903afbe71d00e5b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:14:34Z,use_quota=True,user_id='f8538f1b84ba4958b1f532c455a030d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:14:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-81d3ac9b-8c59-4c64-9a68-c76ea34b971c tempest-VolumesGetTest-776201853 None] Creating volume 1d321176-2dd2-446f-96ba-ba2d61ae8d5d {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:14:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-81d3ac9b-8c59-4c64-9a68-c76ea34b971c tempest-VolumesGetTest-776201853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-81d3ac9b-8c59-4c64-9a68-c76ea34b971c tempest-VolumesGetTest-776201853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-81d3ac9b-8c59-4c64-9a68-c76ea34b971c tempest-VolumesGetTest-776201853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:14:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-81d3ac9b-8c59-4c64-9a68-c76ea34b971c tempest-VolumesGetTest-776201853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:14:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-81d3ac9b-8c59-4c64-9a68-c76ea34b971c tempest-VolumesGetTest-776201853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-81d3ac9b-8c59-4c64-9a68-c76ea34b971c tempest-VolumesGetTest-776201853 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:14:34 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-81d3ac9b-8c59-4c64-9a68-c76ea34b971c tempest-VolumesGetTest-776201853 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:14:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-81d3ac9b-8c59-4c64-9a68-c76ea34b971c tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d321176-2dd2-446f-96ba-ba2d61ae8d5d 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:34 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ab704874-b3a8-4ddf-a3e5-c033ef05959a tempest-CinderUnicodeTest-1889886783 None] Acquiring lock "cinder-4d830267-261e-4734-9aae-f82f71028167-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:34 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ab704874-b3a8-4ddf-a3e5-c033ef05959a tempest-CinderUnicodeTest-1889886783 None] Lock "cinder-4d830267-261e-4734-9aae-f82f71028167-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:34 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ab704874-b3a8-4ddf-a3e5-c033ef05959a tempest-CinderUnicodeTest-1889886783 None] Acquiring lock "cinder-quobyte-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:34 devstack sudo[98319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d321176-2dd2-446f-96ba-ba2d61ae8d5d 1073741824
Nov 06 17:14:34 devstack sudo[98319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:34 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ab704874-b3a8-4ddf-a3e5-c033ef05959a tempest-CinderUnicodeTest-1889886783 None] Lock "cinder-quobyte-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:34 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ab704874-b3a8-4ddf-a3e5-c033ef05959a tempest-CinderUnicodeTest-1889886783 None] Acquiring lock "cinder-quobyte-4d830267-261e-4734-9aae-f82f71028167" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:34 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ab704874-b3a8-4ddf-a3e5-c033ef05959a tempest-CinderUnicodeTest-1889886783 None] Lock "cinder-quobyte-4d830267-261e-4734-9aae-f82f71028167" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-ab704874-b3a8-4ddf-a3e5-c033ef05959a tempest-CinderUnicodeTest-1889886783 None] Deleting offline snapshot 4d830267-261e-4734-9aae-f82f71028167 of volume 6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:14:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-ab704874-b3a8-4ddf-a3e5-c033ef05959a tempest-CinderUnicodeTest-1889886783 None] snapshot_file for this snap is: volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69.4d830267-261e-4734-9aae-f82f71028167 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:14:34 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a23ca8-3bb1-48e3-8464-9fcaaa0d1a4b]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:14:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab704874-b3a8-4ddf-a3e5-c033ef05959a tempest-CinderUnicodeTest-1889886783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69.4d830267-261e-4734-9aae-f82f71028167 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:34 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f9acb271-5668-4375-a9aa-1cd0ddd1c10a tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-01361e88-13cd-4903-a59e-4ca0cd5c8f85" returned: 0 in 0.624s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:34 devstack sudo[98322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69.4d830267-261e-4734-9aae-f82f71028167
Nov 06 17:14:34 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:34 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f9acb271-5668-4375-a9aa-1cd0ddd1c10a tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-quobyte-01361e88-13cd-4903-a59e-4ca0cd5c8f85" released by "delete_volume" :: held 1.344s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:34 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-f9acb271-5668-4375-a9aa-1cd0ddd1c10a tempest-VolumesSnapshotTestJSON-349969979 None] Created reservations ['e8e5f4c5-d0ee-441c-95ea-cd97dc027073', 'ec3180db-e638-4758-adde-c00937fe6d59', '8ebfc426-ff61-4b31-9b23-c0642aff4297', '56fb3a4c-a8fd-4c46-86fa-cdc0999f457c'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:14:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f9acb271-5668-4375-a9aa-1cd0ddd1c10a tempest-VolumesSnapshotTestJSON-349969979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f9acb271-5668-4375-a9aa-1cd0ddd1c10a tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-f9acb271-5668-4375-a9aa-1cd0ddd1c10a tempest-VolumesSnapshotTestJSON-349969979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:14:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-f9acb271-5668-4375-a9aa-1cd0ddd1c10a tempest-VolumesSnapshotTestJSON-349969979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:14:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f9acb271-5668-4375-a9aa-1cd0ddd1c10a tempest-VolumesSnapshotTestJSON-349969979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f9acb271-5668-4375-a9aa-1cd0ddd1c10a tempest-VolumesSnapshotTestJSON-349969979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:35 devstack sudo[98319]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-81d3ac9b-8c59-4c64-9a68-c76ea34b971c tempest-VolumesGetTest-776201853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d321176-2dd2-446f-96ba-ba2d61ae8d5d 1073741824" returned: 0 in 0.789s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:35 devstack sudo[98331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:14:35 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-81d3ac9b-8c59-4c64-9a68-c76ea34b971c tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d321176-2dd2-446f-96ba-ba2d61ae8d5d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:35 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab704874-b3a8-4ddf-a3e5-c033ef05959a tempest-CinderUnicodeTest-1889886783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69.4d830267-261e-4734-9aae-f82f71028167" returned: 0 in 0.689s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-ab704874-b3a8-4ddf-a3e5-c033ef05959a tempest-CinderUnicodeTest-1889886783 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:14:35 devstack sudo[98334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d321176-2dd2-446f-96ba-ba2d61ae8d5d
Nov 06 17:14:35 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:35 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6500328-61ec-4d7b-8a95-7b4fafea82ac]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:14:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab704874-b3a8-4ddf-a3e5-c033ef05959a tempest-CinderUnicodeTest-1889886783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:35 devstack sudo[98336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69
Nov 06 17:14:35 devstack sudo[98336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:35 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f9acb271-5668-4375-a9aa-1cd0ddd1c10a tempest-VolumesSnapshotTestJSON-349969979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.628s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:35 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-f9acb271-5668-4375-a9aa-1cd0ddd1c10a tempest-VolumesSnapshotTestJSON-349969979 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:14:35 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-f9acb271-5668-4375-a9aa-1cd0ddd1c10a tempest-VolumesSnapshotTestJSON-349969979 None] Deleted volume successfully.
Nov 06 17:14:35 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f9acb271-5668-4375-a9aa-1cd0ddd1c10a tempest-VolumesSnapshotTestJSON-349969979 None] Lock "cinder-01361e88-13cd-4903-a59e-4ca0cd5c8f85-delete_volume" released by "delete_volume" :: held 2.420s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:35 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-81d3ac9b-8c59-4c64-9a68-c76ea34b971c tempest-VolumesGetTest-776201853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d321176-2dd2-446f-96ba-ba2d61ae8d5d" returned: 0 in 0.602s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-81d3ac9b-8c59-4c64-9a68-c76ea34b971c tempest-VolumesGetTest-776201853 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:14:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-81d3ac9b-8c59-4c64-9a68-c76ea34b971c tempest-VolumesGetTest-776201853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:35 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-81d3ac9b-8c59-4c64-9a68-c76ea34b971c tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dd9e8be-c45b-4cb0-8981-dcee12f8b42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d321176-2dd2-446f-96ba-ba2d61ae8d5d', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:35 devstack sudo[98336]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:35 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-81d3ac9b-8c59-4c64-9a68-c76ea34b971c tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d3672c9-5414-44be-a255-0bf02d1ef776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab704874-b3a8-4ddf-a3e5-c033ef05959a tempest-CinderUnicodeTest-1889886783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69" returned: 0 in 0.556s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab704874-b3a8-4ddf-a3e5-c033ef05959a tempest-CinderUnicodeTest-1889886783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69.4d830267-261e-4734-9aae-f82f71028167 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:35 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-81d3ac9b-8c59-4c64-9a68-c76ea34b971c tempest-VolumesGetTest-776201853 None] Volume volume-1d321176-2dd2-446f-96ba-ba2d61ae8d5d (1d321176-2dd2-446f-96ba-ba2d61ae8d5d): created successfully
Nov 06 17:14:35 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-81d3ac9b-8c59-4c64-9a68-c76ea34b971c tempest-VolumesGetTest-776201853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d3672c9-5414-44be-a255-0bf02d1ef776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:36 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-81d3ac9b-8c59-4c64-9a68-c76ea34b971c tempest-VolumesGetTest-776201853 None] Flow 'volume_create_manager' (3ec97d19-4d43-4696-af43-0d41e64187bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:14:36 devstack sudo[98344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69.4d830267-261e-4734-9aae-f82f71028167
Nov 06 17:14:36 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:36 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-81d3ac9b-8c59-4c64-9a68-c76ea34b971c tempest-VolumesGetTest-776201853 None] Created volume successfully.
Nov 06 17:14:36 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-00a94d49-8e29-45e4-977d-d1092f0c7b5e tempest-VolumesGetTest-776201853 None] Acquiring lock "cinder-1d321176-2dd2-446f-96ba-ba2d61ae8d5d-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:36 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-00a94d49-8e29-45e4-977d-d1092f0c7b5e tempest-VolumesGetTest-776201853 None] Lock "cinder-1d321176-2dd2-446f-96ba-ba2d61ae8d5d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:36 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab704874-b3a8-4ddf-a3e5-c033ef05959a tempest-CinderUnicodeTest-1889886783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69.4d830267-261e-4734-9aae-f82f71028167" returned: 0 in 0.773s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab704874-b3a8-4ddf-a3e5-c033ef05959a tempest-CinderUnicodeTest-1889886783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69.4d830267-261e-4734-9aae-f82f71028167 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:36 devstack sudo[98350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69.4d830267-261e-4734-9aae-f82f71028167
Nov 06 17:14:36 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-00a94d49-8e29-45e4-977d-d1092f0c7b5e tempest-VolumesGetTest-776201853 None] Acquiring lock "cinder-quobyte-1d321176-2dd2-446f-96ba-ba2d61ae8d5d" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:36 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:36 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-00a94d49-8e29-45e4-977d-d1092f0c7b5e tempest-VolumesGetTest-776201853 None] Lock "cinder-quobyte-1d321176-2dd2-446f-96ba-ba2d61ae8d5d" acquired by "delete_volume" :: waited 0.024s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:36 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b1ce2b-33a8-42ce-9ef6-9ca8d045c241]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:14:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-00a94d49-8e29-45e4-977d-d1092f0c7b5e tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d321176-2dd2-446f-96ba-ba2d61ae8d5d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:37 devstack sudo[98352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d321176-2dd2-446f-96ba-ba2d61ae8d5d
Nov 06 17:14:37 devstack sudo[98352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:37 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab704874-b3a8-4ddf-a3e5-c033ef05959a tempest-CinderUnicodeTest-1889886783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69.4d830267-261e-4734-9aae-f82f71028167" returned: 0 in 0.394s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ab704874-b3a8-4ddf-a3e5-c033ef05959a tempest-CinderUnicodeTest-1889886783 None] Lock "cinder-quobyte-4d830267-261e-4734-9aae-f82f71028167" released by "_delete_snapshot" :: held 2.668s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ab704874-b3a8-4ddf-a3e5-c033ef05959a tempest-CinderUnicodeTest-1889886783 None] Lock "cinder-quobyte-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69" released by "delete_snapshot" :: held 2.739s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:37 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-ab704874-b3a8-4ddf-a3e5-c033ef05959a tempest-CinderUnicodeTest-1889886783 None] Created reservations ['c1e39579-b7d7-484d-81c1-61c97d8f48f0', 'b869a110-79a4-422e-939e-2c7e83e9f438', '4c7f38db-bb63-4cff-99eb-af3658bdadef', 'da82c22e-41bd-4864-994b-cf18dfd7caa9'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:14:37 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-ab704874-b3a8-4ddf-a3e5-c033ef05959a tempest-CinderUnicodeTest-1889886783 None] Delete snapshot completed successfully.
Nov 06 17:14:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ab704874-b3a8-4ddf-a3e5-c033ef05959a tempest-CinderUnicodeTest-1889886783 None] Lock "cinder-4d830267-261e-4734-9aae-f82f71028167-delete_snapshot" released by "delete_snapshot" :: held 3.049s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:37 devstack sudo[98352]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-00a94d49-8e29-45e4-977d-d1092f0c7b5e tempest-VolumesGetTest-776201853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d321176-2dd2-446f-96ba-ba2d61ae8d5d" returned: 0 in 0.710s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-00a94d49-8e29-45e4-977d-d1092f0c7b5e tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d321176-2dd2-446f-96ba-ba2d61ae8d5d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:37 devstack sudo[98358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d321176-2dd2-446f-96ba-ba2d61ae8d5d
Nov 06 17:14:37 devstack sudo[98358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bdd3370c-f0c4-4eea-9d65-b75a04df4d9c tempest-CinderUnicodeTest-1889886783 None] Acquiring lock "cinder-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bdd3370c-f0c4-4eea-9d65-b75a04df4d9c tempest-CinderUnicodeTest-1889886783 None] Lock "cinder-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bdd3370c-f0c4-4eea-9d65-b75a04df4d9c tempest-CinderUnicodeTest-1889886783 None] Acquiring lock "cinder-quobyte-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bdd3370c-f0c4-4eea-9d65-b75a04df4d9c tempest-CinderUnicodeTest-1889886783 None] Lock "cinder-quobyte-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69" acquired by "delete_volume" :: waited 0.041s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:38 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[019925f0-8013-4251-9b34-c2c1ca5a2812]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:14:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bdd3370c-f0c4-4eea-9d65-b75a04df4d9c tempest-CinderUnicodeTest-1889886783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:38 devstack sudo[98358]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-00a94d49-8e29-45e4-977d-d1092f0c7b5e tempest-VolumesGetTest-776201853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d321176-2dd2-446f-96ba-ba2d61ae8d5d" returned: 0 in 0.526s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:38 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-00a94d49-8e29-45e4-977d-d1092f0c7b5e tempest-VolumesGetTest-776201853 None] Lock "cinder-quobyte-1d321176-2dd2-446f-96ba-ba2d61ae8d5d" released by "delete_volume" :: held 1.335s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:38 devstack sudo[98361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69
Nov 06 17:14:38 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:38 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-00a94d49-8e29-45e4-977d-d1092f0c7b5e tempest-VolumesGetTest-776201853 None] Created reservations ['83e2376f-0a56-48e8-882a-84a01c47cc0b', '573c0049-1a61-4d13-b08a-77c1ec900c2c', 'ff8a788d-2fdd-4799-b09d-a53a891b6d68', '08558461-795e-4668-a4a9-f8981b444d12'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:14:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-00a94d49-8e29-45e4-977d-d1092f0c7b5e tempest-VolumesGetTest-776201853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-00a94d49-8e29-45e4-977d-d1092f0c7b5e tempest-VolumesGetTest-776201853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:38 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-00a94d49-8e29-45e4-977d-d1092f0c7b5e tempest-VolumesGetTest-776201853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:14:38 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-00a94d49-8e29-45e4-977d-d1092f0c7b5e tempest-VolumesGetTest-776201853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:14:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-00a94d49-8e29-45e4-977d-d1092f0c7b5e tempest-VolumesGetTest-776201853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-00a94d49-8e29-45e4-977d-d1092f0c7b5e tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:38 devstack sudo[98363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:14:38 devstack sudo[98363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:38 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bdd3370c-f0c4-4eea-9d65-b75a04df4d9c tempest-CinderUnicodeTest-1889886783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69" returned: 0 in 0.693s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bdd3370c-f0c4-4eea-9d65-b75a04df4d9c tempest-CinderUnicodeTest-1889886783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:38 devstack sudo[98363]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-00a94d49-8e29-45e4-977d-d1092f0c7b5e tempest-VolumesGetTest-776201853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.377s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:38 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-00a94d49-8e29-45e4-977d-d1092f0c7b5e tempest-VolumesGetTest-776201853 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:14:38 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-00a94d49-8e29-45e4-977d-d1092f0c7b5e tempest-VolumesGetTest-776201853 None] Deleted volume successfully.
Nov 06 17:14:38 devstack sudo[98369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69
Nov 06 17:14:38 devstack sudo[98369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:38 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-00a94d49-8e29-45e4-977d-d1092f0c7b5e tempest-VolumesGetTest-776201853 None] Lock "cinder-1d321176-2dd2-446f-96ba-ba2d61ae8d5d-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:39 devstack sudo[98369]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bdd3370c-f0c4-4eea-9d65-b75a04df4d9c tempest-CinderUnicodeTest-1889886783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69" returned: 0 in 0.543s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d8283f60-8739-490c-af92-7a2beaeac9e7 tempest-VolumesGetTest-776201853 None] Acquiring lock "cinder-8224e363-c491-4a44-bb6b-b9e8974493d1-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bdd3370c-f0c4-4eea-9d65-b75a04df4d9c tempest-CinderUnicodeTest-1889886783 None] Lock "cinder-quobyte-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69" released by "delete_volume" :: held 1.372s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d8283f60-8739-490c-af92-7a2beaeac9e7 tempest-VolumesGetTest-776201853 None] Lock "cinder-8224e363-c491-4a44-bb6b-b9e8974493d1-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d8283f60-8739-490c-af92-7a2beaeac9e7 tempest-VolumesGetTest-776201853 None] Acquiring lock "cinder-quobyte-8224e363-c491-4a44-bb6b-b9e8974493d1" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:39 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-bdd3370c-f0c4-4eea-9d65-b75a04df4d9c tempest-CinderUnicodeTest-1889886783 None] Created reservations ['6dfb76ba-0594-40d1-94ea-fa0447f9a1b7', '522cdde0-2326-4ffb-99ce-71f69bf08deb', '4aa336b0-641e-456b-b24f-b45e1b05b9a9', 'be7ff321-9003-48c3-85bb-e4a0fb0056b9'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:14:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d8283f60-8739-490c-af92-7a2beaeac9e7 tempest-VolumesGetTest-776201853 None] Lock "cinder-quobyte-8224e363-c491-4a44-bb6b-b9e8974493d1" acquired by "delete_volume" :: waited 0.050s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:39 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[250017aa-2e24-4b00-b1ff-c495bbd88f2e]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:14:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d8283f60-8739-490c-af92-7a2beaeac9e7 tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8224e363-c491-4a44-bb6b-b9e8974493d1 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bdd3370c-f0c4-4eea-9d65-b75a04df4d9c tempest-CinderUnicodeTest-1889886783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bdd3370c-f0c4-4eea-9d65-b75a04df4d9c tempest-CinderUnicodeTest-1889886783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:39 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bdd3370c-f0c4-4eea-9d65-b75a04df4d9c tempest-CinderUnicodeTest-1889886783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:14:39 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bdd3370c-f0c4-4eea-9d65-b75a04df4d9c tempest-CinderUnicodeTest-1889886783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:14:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bdd3370c-f0c4-4eea-9d65-b75a04df4d9c tempest-CinderUnicodeTest-1889886783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bdd3370c-f0c4-4eea-9d65-b75a04df4d9c tempest-CinderUnicodeTest-1889886783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:39 devstack sudo[98374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:14:39 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:39 devstack sudo[98373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8224e363-c491-4a44-bb6b-b9e8974493d1
Nov 06 17:14:39 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:40 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d8283f60-8739-490c-af92-7a2beaeac9e7 tempest-VolumesGetTest-776201853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8224e363-c491-4a44-bb6b-b9e8974493d1" returned: 0 in 0.544s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d8283f60-8739-490c-af92-7a2beaeac9e7 tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8224e363-c491-4a44-bb6b-b9e8974493d1 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:40 devstack sudo[98381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8224e363-c491-4a44-bb6b-b9e8974493d1
Nov 06 17:14:40 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:40 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bdd3370c-f0c4-4eea-9d65-b75a04df4d9c tempest-CinderUnicodeTest-1889886783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.574s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:40 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-bdd3370c-f0c4-4eea-9d65-b75a04df4d9c tempest-CinderUnicodeTest-1889886783 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:14:40 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-3a1cd548-0a01-48c5-aec2-28b3885095ac tempest-CinderUnicodeTest-1889886783 None] Acquiring lock "cinder-2aa7242d-35bb-4ca4-b33c-81516d1fa81a-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:40 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-bdd3370c-f0c4-4eea-9d65-b75a04df4d9c tempest-CinderUnicodeTest-1889886783 None] Deleted volume successfully.
Nov 06 17:14:40 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-3a1cd548-0a01-48c5-aec2-28b3885095ac tempest-CinderUnicodeTest-1889886783 None] Lock "cinder-2aa7242d-35bb-4ca4-b33c-81516d1fa81a-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:40 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bdd3370c-f0c4-4eea-9d65-b75a04df4d9c tempest-CinderUnicodeTest-1889886783 None] Lock "cinder-6eb6ccf2-7791-40d9-8a3b-fe7c4493ec69-delete_volume" released by "delete_volume" :: held 2.500s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:40 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-3a1cd548-0a01-48c5-aec2-28b3885095ac tempest-CinderUnicodeTest-1889886783 None] Acquiring lock "cinder-quobyte-2aa7242d-35bb-4ca4-b33c-81516d1fa81a" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:40 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-3a1cd548-0a01-48c5-aec2-28b3885095ac tempest-CinderUnicodeTest-1889886783 None] Lock "cinder-quobyte-2aa7242d-35bb-4ca4-b33c-81516d1fa81a" acquired by "delete_volume" :: waited 0.022s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:40 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f85dbe0-9a8f-433d-91a7-57502d63b711]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:14:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3a1cd548-0a01-48c5-aec2-28b3885095ac tempest-CinderUnicodeTest-1889886783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2aa7242d-35bb-4ca4-b33c-81516d1fa81a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:40 devstack sudo[98383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2aa7242d-35bb-4ca4-b33c-81516d1fa81a
Nov 06 17:14:40 devstack sudo[98383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:40 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d8283f60-8739-490c-af92-7a2beaeac9e7 tempest-VolumesGetTest-776201853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8224e363-c491-4a44-bb6b-b9e8974493d1" returned: 0 in 0.533s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:40 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d8283f60-8739-490c-af92-7a2beaeac9e7 tempest-VolumesGetTest-776201853 None] Lock "cinder-quobyte-8224e363-c491-4a44-bb6b-b9e8974493d1" released by "delete_volume" :: held 1.138s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:40 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-d8283f60-8739-490c-af92-7a2beaeac9e7 tempest-VolumesGetTest-776201853 None] Created reservations ['ca819ceb-7d8b-4088-b52d-9b4e5842d54b', '3e599039-86b1-40d8-ba7e-647646e47186', '615e0978-0cc6-40bc-804b-870f67c8e292', 'f160af7c-ee13-4fb8-b363-231e500be123'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:14:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d8283f60-8739-490c-af92-7a2beaeac9e7 tempest-VolumesGetTest-776201853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d8283f60-8739-490c-af92-7a2beaeac9e7 tempest-VolumesGetTest-776201853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:40 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d8283f60-8739-490c-af92-7a2beaeac9e7 tempest-VolumesGetTest-776201853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:14:40 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d8283f60-8739-490c-af92-7a2beaeac9e7 tempest-VolumesGetTest-776201853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:14:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d8283f60-8739-490c-af92-7a2beaeac9e7 tempest-VolumesGetTest-776201853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d8283f60-8739-490c-af92-7a2beaeac9e7 tempest-VolumesGetTest-776201853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:40 devstack sudo[98387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:14:40 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:40 devstack sudo[98383]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3a1cd548-0a01-48c5-aec2-28b3885095ac tempest-CinderUnicodeTest-1889886783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2aa7242d-35bb-4ca4-b33c-81516d1fa81a" returned: 0 in 0.547s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3a1cd548-0a01-48c5-aec2-28b3885095ac tempest-CinderUnicodeTest-1889886783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2aa7242d-35bb-4ca4-b33c-81516d1fa81a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:40 devstack sudo[98392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2aa7242d-35bb-4ca4-b33c-81516d1fa81a
Nov 06 17:14:40 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:41 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d8283f60-8739-490c-af92-7a2beaeac9e7 tempest-VolumesGetTest-776201853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.535s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:41 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-d8283f60-8739-490c-af92-7a2beaeac9e7 tempest-VolumesGetTest-776201853 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:14:41 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-d8283f60-8739-490c-af92-7a2beaeac9e7 tempest-VolumesGetTest-776201853 None] Deleted volume successfully.
Nov 06 17:14:41 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3a1cd548-0a01-48c5-aec2-28b3885095ac tempest-CinderUnicodeTest-1889886783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2aa7242d-35bb-4ca4-b33c-81516d1fa81a" returned: 0 in 0.469s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:41 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d8283f60-8739-490c-af92-7a2beaeac9e7 tempest-VolumesGetTest-776201853 None] Lock "cinder-8224e363-c491-4a44-bb6b-b9e8974493d1-delete_volume" released by "delete_volume" :: held 2.074s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:41 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-3a1cd548-0a01-48c5-aec2-28b3885095ac tempest-CinderUnicodeTest-1889886783 None] Lock "cinder-quobyte-2aa7242d-35bb-4ca4-b33c-81516d1fa81a" released by "delete_volume" :: held 1.084s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:41 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-3a1cd548-0a01-48c5-aec2-28b3885095ac tempest-CinderUnicodeTest-1889886783 None] Created reservations ['0bf765cc-eb0d-4ac0-9e78-2e1088830aad', '89d4cb2d-3f9e-4293-8bf8-819ed69f3c50', '4834fac1-0d8d-4610-811d-eef466b21deb', '97767d13-1442-40a0-a68c-bf860d8b5b47'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:14:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3a1cd548-0a01-48c5-aec2-28b3885095ac tempest-CinderUnicodeTest-1889886783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3a1cd548-0a01-48c5-aec2-28b3885095ac tempest-CinderUnicodeTest-1889886783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:41 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3a1cd548-0a01-48c5-aec2-28b3885095ac tempest-CinderUnicodeTest-1889886783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:14:41 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3a1cd548-0a01-48c5-aec2-28b3885095ac tempest-CinderUnicodeTest-1889886783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:14:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3a1cd548-0a01-48c5-aec2-28b3885095ac tempest-CinderUnicodeTest-1889886783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3a1cd548-0a01-48c5-aec2-28b3885095ac tempest-CinderUnicodeTest-1889886783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:41 devstack sudo[98397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:14:41 devstack sudo[98397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:41 devstack sudo[98397]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3a1cd548-0a01-48c5-aec2-28b3885095ac tempest-CinderUnicodeTest-1889886783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.268s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:41 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-3a1cd548-0a01-48c5-aec2-28b3885095ac tempest-CinderUnicodeTest-1889886783 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:14:41 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-3a1cd548-0a01-48c5-aec2-28b3885095ac tempest-CinderUnicodeTest-1889886783 None] Deleted volume successfully.
Nov 06 17:14:41 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-3a1cd548-0a01-48c5-aec2-28b3885095ac tempest-CinderUnicodeTest-1889886783 None] Lock "cinder-2aa7242d-35bb-4ca4-b33c-81516d1fa81a-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:42 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:14:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:14:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:14:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:42 devstack sudo[98401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:14:42 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:43 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.580s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:43 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:14:43 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager._thread_info {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:14:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread count: 28 {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 17:14:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread info: [<_MainThread(MainThread, started 125183137599616)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125183027608256)>, <Thread(Thread-3 (stat_writer), started daemon 125183025243776)>, <Thread(Rabbit-heartbeat, started daemon 125183023512896)>, <Thread(Thread-5 (_runner), started daemon 125183023357120)>, <Thread(Thread-7 (_runner), started daemon 125183021306496)>, <Thread(fd_logger, started daemon 125183018711616)>, <Thread(privsep_reader, started daemon 125183017484224)>, <Thread(tpool_thread_0, started daemon 125183013742272)>, <Thread(tpool_thread_1, started daemon 125183005349568)>, <Thread(tpool_thread_2, started daemon 125182996956864)>, <Thread(tpool_thread_3, started daemon 125182988564160)>, <Thread(tpool_thread_4, started daemon 125182980171456)>, <Thread(tpool_thread_5, started daemon 125182971778752)>, <Thread(tpool_thread_6, started daemon 125182963386048)>, <Thread(tpool_thread_7, started daemon 125182954993344)>, <Thread(tpool_thread_8, started daemon 125182946600640)>, <Thread(tpool_thread_9, started daemon 125182938207936)>, <Thread(tpool_thread_10, started daemon 125182929815232)>, <Thread(tpool_thread_11, started daemon 125182921422528)>, <Thread(tpool_thread_12, started daemon 125182913013440)>, <Thread(tpool_thread_13, started daemon 125182904604352)>, <Thread(tpool_thread_14, started daemon 125182896195264)>, <Thread(tpool_thread_15, started daemon 125182887786176)>, <Thread(tpool_thread_16, started daemon 125182879377088)>, <Thread(tpool_thread_17, started daemon 125182870968000)>, <Thread(tpool_thread_18, started daemon 125182862558912)>, <Thread(tpool_thread_19, started daemon 125182854149824)>] {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 17:14:49 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe6bb3d8-8665-4539-a1d4-ec648b366959 tempest-ProjectReaderTests-1745254395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:14:49 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fe6bb3d8-8665-4539-a1d4-ec648b366959 tempest-ProjectReaderTests-1745254395 None] Flow 'volume_create_manager' (1b0669ff-1207-4ec9-89da-aba2453d481f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:14:49 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fe6bb3d8-8665-4539-a1d4-ec648b366959 tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a16cc672-0186-4c26-8f9c-57ca28cece82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:49 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fe6bb3d8-8665-4539-a1d4-ec648b366959 tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a16cc672-0186-4c26-8f9c-57ca28cece82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2025716920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46d389bb-f169-47c1-8d6e-bb18bb81e1ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c0f5a62190e44369694746801ab8b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:14:50Z,use_quota=True,user_id='4ab0a997305b4fb9bc9c97dc5e3d21ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:49 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fe6bb3d8-8665-4539-a1d4-ec648b366959 tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dabe5408-deae-4f4e-9ce4-7e9fbc6d862e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:49 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fe6bb3d8-8665-4539-a1d4-ec648b366959 tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dabe5408-deae-4f4e-9ce4-7e9fbc6d862e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:49 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fe6bb3d8-8665-4539-a1d4-ec648b366959 tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5edfc8d3-6b39-4230-95d4-0bdfbd550b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:49 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fe6bb3d8-8665-4539-a1d4-ec648b366959 tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5edfc8d3-6b39-4230-95d4-0bdfbd550b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46d389bb-f169-47c1-8d6e-bb18bb81e1ff', 'volume_name': 'volume-46d389bb-f169-47c1-8d6e-bb18bb81e1ff', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:49 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fe6bb3d8-8665-4539-a1d4-ec648b366959 tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (642b10fd-03af-427e-a7d1-2da833d068cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:49 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fe6bb3d8-8665-4539-a1d4-ec648b366959 tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (642b10fd-03af-427e-a7d1-2da833d068cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:49 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fe6bb3d8-8665-4539-a1d4-ec648b366959 tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1312d79-7919-430e-bc88-922b31dc61f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:49 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-fe6bb3d8-8665-4539-a1d4-ec648b366959 tempest-ProjectReaderTests-1745254395 None] Volume 46d389bb-f169-47c1-8d6e-bb18bb81e1ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46d389bb-f169-47c1-8d6e-bb18bb81e1ff', 'volume_size': 1}
Nov 06 17:14:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-fe6bb3d8-8665-4539-a1d4-ec648b366959 tempest-ProjectReaderTests-1745254395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-fe6bb3d8-8665-4539-a1d4-ec648b366959 tempest-ProjectReaderTests-1745254395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:49 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-fe6bb3d8-8665-4539-a1d4-ec648b366959 tempest-ProjectReaderTests-1745254395 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2025716920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46d389bb-f169-47c1-8d6e-bb18bb81e1ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c0f5a62190e44369694746801ab8b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:14:50Z,use_quota=True,user_id='4ab0a997305b4fb9bc9c97dc5e3d21ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:14:49 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-fe6bb3d8-8665-4539-a1d4-ec648b366959 tempest-ProjectReaderTests-1745254395 None] Creating volume 46d389bb-f169-47c1-8d6e-bb18bb81e1ff {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:14:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-fe6bb3d8-8665-4539-a1d4-ec648b366959 tempest-ProjectReaderTests-1745254395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-fe6bb3d8-8665-4539-a1d4-ec648b366959 tempest-ProjectReaderTests-1745254395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:49 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-fe6bb3d8-8665-4539-a1d4-ec648b366959 tempest-ProjectReaderTests-1745254395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:14:49 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-fe6bb3d8-8665-4539-a1d4-ec648b366959 tempest-ProjectReaderTests-1745254395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:14:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-fe6bb3d8-8665-4539-a1d4-ec648b366959 tempest-ProjectReaderTests-1745254395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:49 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-fe6bb3d8-8665-4539-a1d4-ec648b366959 tempest-ProjectReaderTests-1745254395 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:14:49 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-fe6bb3d8-8665-4539-a1d4-ec648b366959 tempest-ProjectReaderTests-1745254395 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:14:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fe6bb3d8-8665-4539-a1d4-ec648b366959 tempest-ProjectReaderTests-1745254395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-46d389bb-f169-47c1-8d6e-bb18bb81e1ff 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:49 devstack sudo[98488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-46d389bb-f169-47c1-8d6e-bb18bb81e1ff 1073741824
Nov 06 17:14:49 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:49 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-af5d489e-13e9-4c2a-9b0f-bcc8072ccad0 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:14:49 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-af5d489e-13e9-4c2a-9b0f-bcc8072ccad0 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Flow 'volume_create_manager' (13333282-b26c-450b-a51d-afab59bae337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:14:49 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-af5d489e-13e9-4c2a-9b0f-bcc8072ccad0 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d019260-1f2f-44b5-9e5c-c63cfb2cf62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:49 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-af5d489e-13e9-4c2a-9b0f-bcc8072ccad0 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d019260-1f2f-44b5-9e5c-c63cfb2cf62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-56081009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa2e610e-096b-429d-8e46-fb0dee65290a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db7763eb803140009d0f2d2398147d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:14:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:14:50Z,use_quota=True,user_id='227364b1d30741f3ab52fee9f93b0861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:49 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-af5d489e-13e9-4c2a-9b0f-bcc8072ccad0 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f42d498-daa8-43ae-aa2e-5d7a6d7382a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:49 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-af5d489e-13e9-4c2a-9b0f-bcc8072ccad0 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f42d498-daa8-43ae-aa2e-5d7a6d7382a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:49 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-af5d489e-13e9-4c2a-9b0f-bcc8072ccad0 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd5866a-2e4b-4306-91ea-bd9f6fd3807d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:49 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-af5d489e-13e9-4c2a-9b0f-bcc8072ccad0 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd5866a-2e4b-4306-91ea-bd9f6fd3807d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa2e610e-096b-429d-8e46-fb0dee65290a', 'volume_name': 'volume-fa2e610e-096b-429d-8e46-fb0dee65290a', 'volume_size': 2}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:49 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-af5d489e-13e9-4c2a-9b0f-bcc8072ccad0 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f1a7adb-d02f-4852-b4be-f27dd55d5cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:49 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-af5d489e-13e9-4c2a-9b0f-bcc8072ccad0 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f1a7adb-d02f-4852-b4be-f27dd55d5cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:49 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-af5d489e-13e9-4c2a-9b0f-bcc8072ccad0 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (102f0739-cb4a-49c8-a965-8cf4d2fa697c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:49 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-af5d489e-13e9-4c2a-9b0f-bcc8072ccad0 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Volume fa2e610e-096b-429d-8e46-fb0dee65290a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa2e610e-096b-429d-8e46-fb0dee65290a', 'volume_size': 2}
Nov 06 17:14:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-af5d489e-13e9-4c2a-9b0f-bcc8072ccad0 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:50 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fe6bb3d8-8665-4539-a1d4-ec648b366959 tempest-ProjectReaderTests-1745254395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-46d389bb-f169-47c1-8d6e-bb18bb81e1ff 1073741824" returned: 0 in 0.553s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fe6bb3d8-8665-4539-a1d4-ec648b366959 tempest-ProjectReaderTests-1745254395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-46d389bb-f169-47c1-8d6e-bb18bb81e1ff {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:50 devstack sudo[98494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-46d389bb-f169-47c1-8d6e-bb18bb81e1ff
Nov 06 17:14:50 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:50 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fe6bb3d8-8665-4539-a1d4-ec648b366959 tempest-ProjectReaderTests-1745254395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-46d389bb-f169-47c1-8d6e-bb18bb81e1ff" returned: 0 in 0.273s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-fe6bb3d8-8665-4539-a1d4-ec648b366959 tempest-ProjectReaderTests-1745254395 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:14:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-fe6bb3d8-8665-4539-a1d4-ec648b366959 tempest-ProjectReaderTests-1745254395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-af5d489e-13e9-4c2a-9b0f-bcc8072ccad0 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.608s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-af5d489e-13e9-4c2a-9b0f-bcc8072ccad0 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-56081009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa2e610e-096b-429d-8e46-fb0dee65290a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db7763eb803140009d0f2d2398147d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:14:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:14:50Z,use_quota=True,user_id='227364b1d30741f3ab52fee9f93b0861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:14:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-af5d489e-13e9-4c2a-9b0f-bcc8072ccad0 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Creating volume fa2e610e-096b-429d-8e46-fb0dee65290a {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:14:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-af5d489e-13e9-4c2a-9b0f-bcc8072ccad0 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-af5d489e-13e9-4c2a-9b0f-bcc8072ccad0 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-af5d489e-13e9-4c2a-9b0f-bcc8072ccad0 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:14:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-af5d489e-13e9-4c2a-9b0f-bcc8072ccad0 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:14:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-af5d489e-13e9-4c2a-9b0f-bcc8072ccad0 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-af5d489e-13e9-4c2a-9b0f-bcc8072ccad0 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:14:50 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-af5d489e-13e9-4c2a-9b0f-bcc8072ccad0 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:14:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-af5d489e-13e9-4c2a-9b0f-bcc8072ccad0 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a 2147483648 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:50 devstack sudo[98497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a 2147483648
Nov 06 17:14:50 devstack sudo[98497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fe6bb3d8-8665-4539-a1d4-ec648b366959 tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1312d79-7919-430e-bc88-922b31dc61f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46d389bb-f169-47c1-8d6e-bb18bb81e1ff', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fe6bb3d8-8665-4539-a1d4-ec648b366959 tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8533b2e6-e011-4a80-9e94-ee1e0d20d9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:50 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-fe6bb3d8-8665-4539-a1d4-ec648b366959 tempest-ProjectReaderTests-1745254395 None] Volume volume-46d389bb-f169-47c1-8d6e-bb18bb81e1ff (46d389bb-f169-47c1-8d6e-bb18bb81e1ff): created successfully
Nov 06 17:14:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fe6bb3d8-8665-4539-a1d4-ec648b366959 tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8533b2e6-e011-4a80-9e94-ee1e0d20d9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fe6bb3d8-8665-4539-a1d4-ec648b366959 tempest-ProjectReaderTests-1745254395 None] Flow 'volume_create_manager' (1b0669ff-1207-4ec9-89da-aba2453d481f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:14:50 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-fe6bb3d8-8665-4539-a1d4-ec648b366959 tempest-ProjectReaderTests-1745254395 None] Created volume successfully.
Nov 06 17:14:51 devstack sudo[98497]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-af5d489e-13e9-4c2a-9b0f-bcc8072ccad0 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a 2147483648" returned: 0 in 0.493s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-af5d489e-13e9-4c2a-9b0f-bcc8072ccad0 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:51 devstack sudo[98503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a
Nov 06 17:14:51 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:51 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-af5d489e-13e9-4c2a-9b0f-bcc8072ccad0 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a" returned: 0 in 0.256s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:51 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-af5d489e-13e9-4c2a-9b0f-bcc8072ccad0 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:14:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-af5d489e-13e9-4c2a-9b0f-bcc8072ccad0 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-af5d489e-13e9-4c2a-9b0f-bcc8072ccad0 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (102f0739-cb4a-49c8-a965-8cf4d2fa697c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa2e610e-096b-429d-8e46-fb0dee65290a', 'volume_size': 2}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-af5d489e-13e9-4c2a-9b0f-bcc8072ccad0 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (713a6805-23f1-486a-b1d8-8fdf2d976520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:51 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-af5d489e-13e9-4c2a-9b0f-bcc8072ccad0 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Volume volume-fa2e610e-096b-429d-8e46-fb0dee65290a (fa2e610e-096b-429d-8e46-fb0dee65290a): created successfully
Nov 06 17:14:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-af5d489e-13e9-4c2a-9b0f-bcc8072ccad0 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (713a6805-23f1-486a-b1d8-8fdf2d976520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-af5d489e-13e9-4c2a-9b0f-bcc8072ccad0 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Flow 'volume_create_manager' (13333282-b26c-450b-a51d-afab59bae337) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:14:51 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-af5d489e-13e9-4c2a-9b0f-bcc8072ccad0 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Created volume successfully.
Nov 06 17:14:51 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f6aa1192-b8c0-4725-b131-2abd317c187d tempest-ProjectReaderTests-1745254395 None] Acquiring lock "cinder-46d389bb-f169-47c1-8d6e-bb18bb81e1ff-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:51 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f6aa1192-b8c0-4725-b131-2abd317c187d tempest-ProjectReaderTests-1745254395 None] Lock "cinder-46d389bb-f169-47c1-8d6e-bb18bb81e1ff-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:51 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f6aa1192-b8c0-4725-b131-2abd317c187d tempest-ProjectReaderTests-1745254395 None] Acquiring lock "cinder-quobyte-46d389bb-f169-47c1-8d6e-bb18bb81e1ff" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:51 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f6aa1192-b8c0-4725-b131-2abd317c187d tempest-ProjectReaderTests-1745254395 None] Lock "cinder-quobyte-46d389bb-f169-47c1-8d6e-bb18bb81e1ff" acquired by "delete_volume" :: waited 0.018s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:51 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[0181c00c-cd02-4027-b46e-882c9575a1ff]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:14:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f6aa1192-b8c0-4725-b131-2abd317c187d tempest-ProjectReaderTests-1745254395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-46d389bb-f169-47c1-8d6e-bb18bb81e1ff {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:52 devstack sudo[98507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-46d389bb-f169-47c1-8d6e-bb18bb81e1ff
Nov 06 17:14:52 devstack sudo[98507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6e524b15-9b1d-4d7e-8e2c-fd6a1418682d tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6e524b15-9b1d-4d7e-8e2c-fd6a1418682d tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:52 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-6e524b15-9b1d-4d7e-8e2c-fd6a1418682d tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Creating offline snapshot a9a73e43-15dc-4c0e-96fd-150e5ef4e0f0 of volume fa2e610e-096b-429d-8e46-fb0dee65290a {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:14:52 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[41393c24-983e-494f-81d0-bbb6b0d3d674]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:14:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6e524b15-9b1d-4d7e-8e2c-fd6a1418682d tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:52 devstack sudo[98509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a
Nov 06 17:14:52 devstack sudo[98509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:52 devstack sudo[98507]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f6aa1192-b8c0-4725-b131-2abd317c187d tempest-ProjectReaderTests-1745254395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-46d389bb-f169-47c1-8d6e-bb18bb81e1ff" returned: 0 in 0.414s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f6aa1192-b8c0-4725-b131-2abd317c187d tempest-ProjectReaderTests-1745254395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-46d389bb-f169-47c1-8d6e-bb18bb81e1ff {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:52 devstack sudo[98514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-46d389bb-f169-47c1-8d6e-bb18bb81e1ff
Nov 06 17:14:52 devstack sudo[98514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:52 devstack sudo[98514]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f6aa1192-b8c0-4725-b131-2abd317c187d tempest-ProjectReaderTests-1745254395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-46d389bb-f169-47c1-8d6e-bb18bb81e1ff" returned: 0 in 0.253s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:52 devstack sudo[98509]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6e524b15-9b1d-4d7e-8e2c-fd6a1418682d tempest-VolumesSnapshotNegativeTestJSON-792792114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a" returned: 0 in 0.399s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6e524b15-9b1d-4d7e-8e2c-fd6a1418682d tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a.a9a73e43-15dc-4c0e-96fd-150e5ef4e0f0 2G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:52 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f6aa1192-b8c0-4725-b131-2abd317c187d tempest-ProjectReaderTests-1745254395 None] Lock "cinder-quobyte-46d389bb-f169-47c1-8d6e-bb18bb81e1ff" released by "delete_volume" :: held 0.736s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:52 devstack sudo[98521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a.a9a73e43-15dc-4c0e-96fd-150e5ef4e0f0 2G
Nov 06 17:14:52 devstack sudo[98521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:52 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-f6aa1192-b8c0-4725-b131-2abd317c187d tempest-ProjectReaderTests-1745254395 None] Created reservations ['6693afe9-9560-4709-9233-ff783038b404', 'f39edea4-6497-49b5-bf28-ca7efdc0c62f', 'c0026d06-a354-46d2-9fef-6e01eae23c11', '784988b3-de64-49d1-9f01-d17f44c680f2'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:14:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f6aa1192-b8c0-4725-b131-2abd317c187d tempest-ProjectReaderTests-1745254395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f6aa1192-b8c0-4725-b131-2abd317c187d tempest-ProjectReaderTests-1745254395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:52 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-f6aa1192-b8c0-4725-b131-2abd317c187d tempest-ProjectReaderTests-1745254395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:14:52 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-f6aa1192-b8c0-4725-b131-2abd317c187d tempest-ProjectReaderTests-1745254395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:14:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f6aa1192-b8c0-4725-b131-2abd317c187d tempest-ProjectReaderTests-1745254395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f6aa1192-b8c0-4725-b131-2abd317c187d tempest-ProjectReaderTests-1745254395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:52 devstack sudo[98523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:14:52 devstack sudo[98523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:53 devstack sudo[98523]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f6aa1192-b8c0-4725-b131-2abd317c187d tempest-ProjectReaderTests-1745254395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.314s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:53 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-f6aa1192-b8c0-4725-b131-2abd317c187d tempest-ProjectReaderTests-1745254395 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:14:53 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-f6aa1192-b8c0-4725-b131-2abd317c187d tempest-ProjectReaderTests-1745254395 None] Deleted volume successfully.
Nov 06 17:14:53 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f6aa1192-b8c0-4725-b131-2abd317c187d tempest-ProjectReaderTests-1745254395 None] Lock "cinder-46d389bb-f169-47c1-8d6e-bb18bb81e1ff-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:53 devstack sudo[98521]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6e524b15-9b1d-4d7e-8e2c-fd6a1418682d tempest-VolumesSnapshotNegativeTestJSON-792792114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a.a9a73e43-15dc-4c0e-96fd-150e5ef4e0f0 2G" returned: 0 in 0.740s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6e524b15-9b1d-4d7e-8e2c-fd6a1418682d tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa2e610e-096b-429d-8e46-fb0dee65290a -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a.a9a73e43-15dc-4c0e-96fd-150e5ef4e0f0 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:53 devstack sudo[98530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa2e610e-096b-429d-8e46-fb0dee65290a -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a.a9a73e43-15dc-4c0e-96fd-150e5ef4e0f0
Nov 06 17:14:53 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:53 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-b024ff12-2165-4964-8629-e78dd6bbd974 tempest-ProjectReaderTests-1745254395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:14:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b024ff12-2165-4964-8629-e78dd6bbd974 tempest-ProjectReaderTests-1745254395 None] Flow 'volume_create_manager' (6cc740b7-1741-4b0f-bfd5-540b3cb52646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:14:53 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b024ff12-2165-4964-8629-e78dd6bbd974 tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f2e810c-7d81-4bd6-8b57-bfc92b3ca24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6e524b15-9b1d-4d7e-8e2c-fd6a1418682d tempest-VolumesSnapshotNegativeTestJSON-792792114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa2e610e-096b-429d-8e46-fb0dee65290a -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a.a9a73e43-15dc-4c0e-96fd-150e5ef4e0f0" returned: 0 in 0.403s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:53 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-6e524b15-9b1d-4d7e-8e2c-fd6a1418682d tempest-VolumesSnapshotNegativeTestJSON-792792114 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a.a9a73e43-15dc-4c0e-96fd-150e5ef4e0f0 is being set with open permissions: ugo+rw
Nov 06 17:14:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6e524b15-9b1d-4d7e-8e2c-fd6a1418682d tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a.a9a73e43-15dc-4c0e-96fd-150e5ef4e0f0 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:53 devstack sudo[98536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a.a9a73e43-15dc-4c0e-96fd-150e5ef4e0f0
Nov 06 17:14:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b024ff12-2165-4964-8629-e78dd6bbd974 tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f2e810c-7d81-4bd6-8b57-bfc92b3ca24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1480546507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8af1275f-2487-46bd-9104-9a004626a00c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c0f5a62190e44369694746801ab8b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:14:54Z,use_quota=True,user_id='4ab0a997305b4fb9bc9c97dc5e3d21ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:53 devstack sudo[98536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b024ff12-2165-4964-8629-e78dd6bbd974 tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d46236-fe13-4196-8c4d-7184a605db9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b024ff12-2165-4964-8629-e78dd6bbd974 tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d46236-fe13-4196-8c4d-7184a605db9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b024ff12-2165-4964-8629-e78dd6bbd974 tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f4ce582-e372-447b-9765-ba3c677fe92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b024ff12-2165-4964-8629-e78dd6bbd974 tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f4ce582-e372-447b-9765-ba3c677fe92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8af1275f-2487-46bd-9104-9a004626a00c', 'volume_name': 'volume-8af1275f-2487-46bd-9104-9a004626a00c', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b024ff12-2165-4964-8629-e78dd6bbd974 tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8961d0b1-ac2a-4efc-b453-09588d0b9735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b024ff12-2165-4964-8629-e78dd6bbd974 tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8961d0b1-ac2a-4efc-b453-09588d0b9735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b024ff12-2165-4964-8629-e78dd6bbd974 tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70483a6-b466-4dbd-99e7-a627774e9d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:53 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-b024ff12-2165-4964-8629-e78dd6bbd974 tempest-ProjectReaderTests-1745254395 None] Volume 8af1275f-2487-46bd-9104-9a004626a00c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8af1275f-2487-46bd-9104-9a004626a00c', 'volume_size': 1}
Nov 06 17:14:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b024ff12-2165-4964-8629-e78dd6bbd974 tempest-ProjectReaderTests-1745254395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:53 devstack sudo[98536]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6e524b15-9b1d-4d7e-8e2c-fd6a1418682d tempest-VolumesSnapshotNegativeTestJSON-792792114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a.a9a73e43-15dc-4c0e-96fd-150e5ef4e0f0" returned: 0 in 0.245s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6e524b15-9b1d-4d7e-8e2c-fd6a1418682d tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:54 devstack sudo[98539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a.info
Nov 06 17:14:54 devstack sudo[98539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:54 devstack sudo[98539]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6e524b15-9b1d-4d7e-8e2c-fd6a1418682d tempest-VolumesSnapshotNegativeTestJSON-792792114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a.info" returned: 0 in 0.309s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:54 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-6e524b15-9b1d-4d7e-8e2c-fd6a1418682d tempest-VolumesSnapshotNegativeTestJSON-792792114 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a.info is being set with open permissions: ugo+rw
Nov 06 17:14:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6e524b15-9b1d-4d7e-8e2c-fd6a1418682d tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:54 devstack sudo[98542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a.info
Nov 06 17:14:54 devstack sudo[98542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:54 devstack sudo[98542]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6e524b15-9b1d-4d7e-8e2c-fd6a1418682d tempest-VolumesSnapshotNegativeTestJSON-792792114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a.info" returned: 0 in 0.260s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6e524b15-9b1d-4d7e-8e2c-fd6a1418682d tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.472s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b024ff12-2165-4964-8629-e78dd6bbd974 tempest-ProjectReaderTests-1745254395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.819s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-b024ff12-2165-4964-8629-e78dd6bbd974 tempest-ProjectReaderTests-1745254395 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1480546507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8af1275f-2487-46bd-9104-9a004626a00c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c0f5a62190e44369694746801ab8b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:14:54Z,use_quota=True,user_id='4ab0a997305b4fb9bc9c97dc5e3d21ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:14:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-b024ff12-2165-4964-8629-e78dd6bbd974 tempest-ProjectReaderTests-1745254395 None] Creating volume 8af1275f-2487-46bd-9104-9a004626a00c {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:14:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b024ff12-2165-4964-8629-e78dd6bbd974 tempest-ProjectReaderTests-1745254395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b024ff12-2165-4964-8629-e78dd6bbd974 tempest-ProjectReaderTests-1745254395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-b024ff12-2165-4964-8629-e78dd6bbd974 tempest-ProjectReaderTests-1745254395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:14:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-b024ff12-2165-4964-8629-e78dd6bbd974 tempest-ProjectReaderTests-1745254395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:14:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b024ff12-2165-4964-8629-e78dd6bbd974 tempest-ProjectReaderTests-1745254395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-b024ff12-2165-4964-8629-e78dd6bbd974 tempest-ProjectReaderTests-1745254395 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:14:54 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-b024ff12-2165-4964-8629-e78dd6bbd974 tempest-ProjectReaderTests-1745254395 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:14:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b024ff12-2165-4964-8629-e78dd6bbd974 tempest-ProjectReaderTests-1745254395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8af1275f-2487-46bd-9104-9a004626a00c 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:54 devstack sudo[98545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8af1275f-2487-46bd-9104-9a004626a00c 1073741824
Nov 06 17:14:54 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:54 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-6e524b15-9b1d-4d7e-8e2c-fd6a1418682d tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Create snapshot completed successfully
Nov 06 17:14:55 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b024ff12-2165-4964-8629-e78dd6bbd974 tempest-ProjectReaderTests-1745254395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8af1275f-2487-46bd-9104-9a004626a00c 1073741824" returned: 0 in 0.476s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b024ff12-2165-4964-8629-e78dd6bbd974 tempest-ProjectReaderTests-1745254395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8af1275f-2487-46bd-9104-9a004626a00c {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:55 devstack sudo[98551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8af1275f-2487-46bd-9104-9a004626a00c
Nov 06 17:14:55 devstack sudo[98551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:55 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1126b141-9560-4048-a7b9-085d07055eb9 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Acquiring lock "cinder-a9a73e43-15dc-4c0e-96fd-150e5ef4e0f0-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:55 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1126b141-9560-4048-a7b9-085d07055eb9 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Lock "cinder-a9a73e43-15dc-4c0e-96fd-150e5ef4e0f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:55 devstack sudo[98551]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:55 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1126b141-9560-4048-a7b9-085d07055eb9 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Acquiring lock "cinder-quobyte-fa2e610e-096b-429d-8e46-fb0dee65290a" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b024ff12-2165-4964-8629-e78dd6bbd974 tempest-ProjectReaderTests-1745254395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8af1275f-2487-46bd-9104-9a004626a00c" returned: 0 in 0.357s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:55 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-b024ff12-2165-4964-8629-e78dd6bbd974 tempest-ProjectReaderTests-1745254395 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:14:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b024ff12-2165-4964-8629-e78dd6bbd974 tempest-ProjectReaderTests-1745254395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b024ff12-2165-4964-8629-e78dd6bbd974 tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70483a6-b466-4dbd-99e7-a627774e9d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8af1275f-2487-46bd-9104-9a004626a00c', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b024ff12-2165-4964-8629-e78dd6bbd974 tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2250ac1f-aab2-4df5-82f1-5a62e6ac18ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:55 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1126b141-9560-4048-a7b9-085d07055eb9 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Lock "cinder-quobyte-fa2e610e-096b-429d-8e46-fb0dee65290a" acquired by "delete_snapshot" :: waited 0.050s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:55 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1126b141-9560-4048-a7b9-085d07055eb9 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Acquiring lock "cinder-quobyte-a9a73e43-15dc-4c0e-96fd-150e5ef4e0f0" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:55 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-b024ff12-2165-4964-8629-e78dd6bbd974 tempest-ProjectReaderTests-1745254395 None] Volume volume-8af1275f-2487-46bd-9104-9a004626a00c (8af1275f-2487-46bd-9104-9a004626a00c): created successfully
Nov 06 17:14:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b024ff12-2165-4964-8629-e78dd6bbd974 tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2250ac1f-aab2-4df5-82f1-5a62e6ac18ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b024ff12-2165-4964-8629-e78dd6bbd974 tempest-ProjectReaderTests-1745254395 None] Flow 'volume_create_manager' (6cc740b7-1741-4b0f-bfd5-540b3cb52646) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:14:55 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1126b141-9560-4048-a7b9-085d07055eb9 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Lock "cinder-quobyte-a9a73e43-15dc-4c0e-96fd-150e5ef4e0f0" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:55 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-1126b141-9560-4048-a7b9-085d07055eb9 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Deleting offline snapshot a9a73e43-15dc-4c0e-96fd-150e5ef4e0f0 of volume fa2e610e-096b-429d-8e46-fb0dee65290a {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:14:55 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-1126b141-9560-4048-a7b9-085d07055eb9 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] snapshot_file for this snap is: volume-fa2e610e-096b-429d-8e46-fb0dee65290a.a9a73e43-15dc-4c0e-96fd-150e5ef4e0f0 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:14:55 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-b024ff12-2165-4964-8629-e78dd6bbd974 tempest-ProjectReaderTests-1745254395 None] Created volume successfully.
Nov 06 17:14:55 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee151546-2db3-4b3d-8800-8e090af28226]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:14:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1126b141-9560-4048-a7b9-085d07055eb9 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a.a9a73e43-15dc-4c0e-96fd-150e5ef4e0f0 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:55 devstack sudo[98554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a.a9a73e43-15dc-4c0e-96fd-150e5ef4e0f0
Nov 06 17:14:55 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:55 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-2159b021-ee15-4267-bc8a-8f8970b03b11 tempest-ProjectReaderTests-1745254395 None] Acquiring lock "cinder-8af1275f-2487-46bd-9104-9a004626a00c-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:55 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-2159b021-ee15-4267-bc8a-8f8970b03b11 tempest-ProjectReaderTests-1745254395 None] Lock "cinder-8af1275f-2487-46bd-9104-9a004626a00c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:55 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-2159b021-ee15-4267-bc8a-8f8970b03b11 tempest-ProjectReaderTests-1745254395 None] Acquiring lock "cinder-quobyte-8af1275f-2487-46bd-9104-9a004626a00c" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:55 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-2159b021-ee15-4267-bc8a-8f8970b03b11 tempest-ProjectReaderTests-1745254395 None] Lock "cinder-quobyte-8af1275f-2487-46bd-9104-9a004626a00c" acquired by "delete_volume" :: waited 0.016s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:56 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[8351684e-7294-4837-a6e0-2ca5471d547d]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:14:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2159b021-ee15-4267-bc8a-8f8970b03b11 tempest-ProjectReaderTests-1745254395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8af1275f-2487-46bd-9104-9a004626a00c {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:56 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1126b141-9560-4048-a7b9-085d07055eb9 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a.a9a73e43-15dc-4c0e-96fd-150e5ef4e0f0" returned: 0 in 0.471s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:56 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-1126b141-9560-4048-a7b9-085d07055eb9 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa2e610e-096b-429d-8e46-fb0dee65290a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:14:56 devstack sudo[98559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8af1275f-2487-46bd-9104-9a004626a00c
Nov 06 17:14:56 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a25ebb1-7bda-4858-8774-db2b3758e67e]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:14:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1126b141-9560-4048-a7b9-085d07055eb9 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:56 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:56 devstack sudo[98562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a
Nov 06 17:14:56 devstack sudo[98562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:56 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2159b021-ee15-4267-bc8a-8f8970b03b11 tempest-ProjectReaderTests-1745254395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8af1275f-2487-46bd-9104-9a004626a00c" returned: 0 in 0.564s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2159b021-ee15-4267-bc8a-8f8970b03b11 tempest-ProjectReaderTests-1745254395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8af1275f-2487-46bd-9104-9a004626a00c {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:56 devstack sudo[98562]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1126b141-9560-4048-a7b9-085d07055eb9 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a" returned: 0 in 0.454s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1126b141-9560-4048-a7b9-085d07055eb9 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a.a9a73e43-15dc-4c0e-96fd-150e5ef4e0f0 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:56 devstack sudo[98570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8af1275f-2487-46bd-9104-9a004626a00c
Nov 06 17:14:56 devstack sudo[98570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:56 devstack sudo[98571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a.a9a73e43-15dc-4c0e-96fd-150e5ef4e0f0
Nov 06 17:14:56 devstack sudo[98571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:56 devstack sudo[98570]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2159b021-ee15-4267-bc8a-8f8970b03b11 tempest-ProjectReaderTests-1745254395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8af1275f-2487-46bd-9104-9a004626a00c" returned: 0 in 0.305s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:56 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-2159b021-ee15-4267-bc8a-8f8970b03b11 tempest-ProjectReaderTests-1745254395 None] Lock "cinder-quobyte-8af1275f-2487-46bd-9104-9a004626a00c" released by "delete_volume" :: held 0.935s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:57 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-2159b021-ee15-4267-bc8a-8f8970b03b11 tempest-ProjectReaderTests-1745254395 None] Created reservations ['b11a9cbd-9ac0-47bc-9e69-4938c0d53f64', '32e2953a-e2f2-4c2e-8234-9980b88b523c', 'a07d115e-9386-4d16-90a1-b4077b4c39f6', '27be2d4c-617f-479f-bf5c-a9edd6a7ce78'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:14:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2159b021-ee15-4267-bc8a-8f8970b03b11 tempest-ProjectReaderTests-1745254395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2159b021-ee15-4267-bc8a-8f8970b03b11 tempest-ProjectReaderTests-1745254395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:57 devstack sudo[98571]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:57 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-2159b021-ee15-4267-bc8a-8f8970b03b11 tempest-ProjectReaderTests-1745254395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:14:57 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-2159b021-ee15-4267-bc8a-8f8970b03b11 tempest-ProjectReaderTests-1745254395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:14:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2159b021-ee15-4267-bc8a-8f8970b03b11 tempest-ProjectReaderTests-1745254395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2159b021-ee15-4267-bc8a-8f8970b03b11 tempest-ProjectReaderTests-1745254395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1126b141-9560-4048-a7b9-085d07055eb9 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a.a9a73e43-15dc-4c0e-96fd-150e5ef4e0f0" returned: 0 in 0.540s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1126b141-9560-4048-a7b9-085d07055eb9 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a.a9a73e43-15dc-4c0e-96fd-150e5ef4e0f0 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:57 devstack sudo[98579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:14:57 devstack sudo[98579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:57 devstack sudo[98580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a.a9a73e43-15dc-4c0e-96fd-150e5ef4e0f0
Nov 06 17:14:57 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:57 devstack sudo[98579]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2159b021-ee15-4267-bc8a-8f8970b03b11 tempest-ProjectReaderTests-1745254395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.276s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:57 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-2159b021-ee15-4267-bc8a-8f8970b03b11 tempest-ProjectReaderTests-1745254395 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:14:57 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-2159b021-ee15-4267-bc8a-8f8970b03b11 tempest-ProjectReaderTests-1745254395 None] Deleted volume successfully.
Nov 06 17:14:57 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1126b141-9560-4048-a7b9-085d07055eb9 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a.a9a73e43-15dc-4c0e-96fd-150e5ef4e0f0" returned: 0 in 0.301s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:57 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-2159b021-ee15-4267-bc8a-8f8970b03b11 tempest-ProjectReaderTests-1745254395 None] Lock "cinder-8af1275f-2487-46bd-9104-9a004626a00c-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:57 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1126b141-9560-4048-a7b9-085d07055eb9 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Lock "cinder-quobyte-a9a73e43-15dc-4c0e-96fd-150e5ef4e0f0" released by "_delete_snapshot" :: held 1.958s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:57 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1126b141-9560-4048-a7b9-085d07055eb9 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Lock "cinder-quobyte-fa2e610e-096b-429d-8e46-fb0dee65290a" released by "delete_snapshot" :: held 2.013s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:57 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-1126b141-9560-4048-a7b9-085d07055eb9 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Created reservations ['25fd6c35-9745-4723-b4f1-5b6f82b8d812', '3b3e4046-12ac-4703-b68c-f70d4ce9aac1', '9b9ed000-abe3-47db-813b-5dec91b156de', '382f3797-11ef-4d62-880d-d2f8a6566798'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:14:57 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-1126b141-9560-4048-a7b9-085d07055eb9 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Delete snapshot completed successfully.
Nov 06 17:14:57 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1126b141-9560-4048-a7b9-085d07055eb9 tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Lock "cinder-a9a73e43-15dc-4c0e-96fd-150e5ef4e0f0-delete_snapshot" released by "delete_snapshot" :: held 2.258s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:58 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccde6578-d29f-497e-9da2-d906a27888be tempest-ProjectReaderTests-1745254395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:14:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ccde6578-d29f-497e-9da2-d906a27888be tempest-ProjectReaderTests-1745254395 None] Flow 'volume_create_manager' (a9cd835c-c544-434a-abb2-1a37ecab5038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:14:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ccde6578-d29f-497e-9da2-d906a27888be tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdcf05be-3936-4714-89ea-82eda13347f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ccde6578-d29f-497e-9da2-d906a27888be tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdcf05be-3936-4714-89ea-82eda13347f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-122779916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe9e721-08cf-4eff-899f-845bd58f61cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c0f5a62190e44369694746801ab8b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:14:59Z,use_quota=True,user_id='4ab0a997305b4fb9bc9c97dc5e3d21ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ccde6578-d29f-497e-9da2-d906a27888be tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30ab02b7-09d1-4788-aced-5eb41756dc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ccde6578-d29f-497e-9da2-d906a27888be tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30ab02b7-09d1-4788-aced-5eb41756dc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ccde6578-d29f-497e-9da2-d906a27888be tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d3674dd-6a53-4749-bb03-31a49d981244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ccde6578-d29f-497e-9da2-d906a27888be tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d3674dd-6a53-4749-bb03-31a49d981244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fe9e721-08cf-4eff-899f-845bd58f61cb', 'volume_name': 'volume-8fe9e721-08cf-4eff-899f-845bd58f61cb', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ccde6578-d29f-497e-9da2-d906a27888be tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fea91ff5-218f-4918-bcae-d67c2de10cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ccde6578-d29f-497e-9da2-d906a27888be tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fea91ff5-218f-4918-bcae-d67c2de10cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ccde6578-d29f-497e-9da2-d906a27888be tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (601bebd8-714e-4252-bab8-389d3d64a7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:58 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-ccde6578-d29f-497e-9da2-d906a27888be tempest-ProjectReaderTests-1745254395 None] Volume 8fe9e721-08cf-4eff-899f-845bd58f61cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fe9e721-08cf-4eff-899f-845bd58f61cb', 'volume_size': 1}
Nov 06 17:14:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ccde6578-d29f-497e-9da2-d906a27888be tempest-ProjectReaderTests-1745254395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ccde6578-d29f-497e-9da2-d906a27888be tempest-ProjectReaderTests-1745254395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:58 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ccde6578-d29f-497e-9da2-d906a27888be tempest-ProjectReaderTests-1745254395 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-122779916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe9e721-08cf-4eff-899f-845bd58f61cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c0f5a62190e44369694746801ab8b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:14:59Z,use_quota=True,user_id='4ab0a997305b4fb9bc9c97dc5e3d21ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:14:58 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-ccde6578-d29f-497e-9da2-d906a27888be tempest-ProjectReaderTests-1745254395 None] Creating volume 8fe9e721-08cf-4eff-899f-845bd58f61cb {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:14:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ccde6578-d29f-497e-9da2-d906a27888be tempest-ProjectReaderTests-1745254395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:14:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ccde6578-d29f-497e-9da2-d906a27888be tempest-ProjectReaderTests-1745254395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:14:58 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ccde6578-d29f-497e-9da2-d906a27888be tempest-ProjectReaderTests-1745254395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:14:58 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ccde6578-d29f-497e-9da2-d906a27888be tempest-ProjectReaderTests-1745254395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:14:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ccde6578-d29f-497e-9da2-d906a27888be tempest-ProjectReaderTests-1745254395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:58 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ccde6578-d29f-497e-9da2-d906a27888be tempest-ProjectReaderTests-1745254395 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:14:58 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-ccde6578-d29f-497e-9da2-d906a27888be tempest-ProjectReaderTests-1745254395 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:14:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ccde6578-d29f-497e-9da2-d906a27888be tempest-ProjectReaderTests-1745254395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8fe9e721-08cf-4eff-899f-845bd58f61cb 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:58 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c1d5e3b2-05a5-41cc-8ff5-920388c74e9c tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Acquiring lock "cinder-fa2e610e-096b-429d-8e46-fb0dee65290a-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:58 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c1d5e3b2-05a5-41cc-8ff5-920388c74e9c tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Lock "cinder-fa2e610e-096b-429d-8e46-fb0dee65290a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:58 devstack sudo[98592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8fe9e721-08cf-4eff-899f-845bd58f61cb 1073741824
Nov 06 17:14:58 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:59 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c1d5e3b2-05a5-41cc-8ff5-920388c74e9c tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Acquiring lock "cinder-quobyte-fa2e610e-096b-429d-8e46-fb0dee65290a" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:14:59 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c1d5e3b2-05a5-41cc-8ff5-920388c74e9c tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Lock "cinder-quobyte-fa2e610e-096b-429d-8e46-fb0dee65290a" acquired by "delete_volume" :: waited 0.023s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:14:59 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[4516cff7-72d2-41ff-93e5-3d404169f304]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:14:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c1d5e3b2-05a5-41cc-8ff5-920388c74e9c tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:59 devstack sudo[98594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a
Nov 06 17:14:59 devstack sudo[98594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:59 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ccde6578-d29f-497e-9da2-d906a27888be tempest-ProjectReaderTests-1745254395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8fe9e721-08cf-4eff-899f-845bd58f61cb 1073741824" returned: 0 in 0.570s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ccde6578-d29f-497e-9da2-d906a27888be tempest-ProjectReaderTests-1745254395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8fe9e721-08cf-4eff-899f-845bd58f61cb {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:59 devstack sudo[98603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8fe9e721-08cf-4eff-899f-845bd58f61cb
Nov 06 17:14:59 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:59 devstack sudo[98594]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c1d5e3b2-05a5-41cc-8ff5-920388c74e9c tempest-VolumesSnapshotNegativeTestJSON-792792114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a" returned: 0 in 0.455s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c1d5e3b2-05a5-41cc-8ff5-920388c74e9c tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:14:59 devstack sudo[98605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a
Nov 06 17:14:59 devstack sudo[98605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:14:59 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ccde6578-d29f-497e-9da2-d906a27888be tempest-ProjectReaderTests-1745254395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8fe9e721-08cf-4eff-899f-845bd58f61cb" returned: 0 in 0.304s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:59 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ccde6578-d29f-497e-9da2-d906a27888be tempest-ProjectReaderTests-1745254395 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:14:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ccde6578-d29f-497e-9da2-d906a27888be tempest-ProjectReaderTests-1745254395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:14:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ccde6578-d29f-497e-9da2-d906a27888be tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (601bebd8-714e-4252-bab8-389d3d64a7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fe9e721-08cf-4eff-899f-845bd58f61cb', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:59 devstack sudo[98605]: pam_unix(sudo:session): session closed for user root
Nov 06 17:14:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ccde6578-d29f-497e-9da2-d906a27888be tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c669de65-46c6-4845-87b5-15a87eec53ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:14:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c1d5e3b2-05a5-41cc-8ff5-920388c74e9c tempest-VolumesSnapshotNegativeTestJSON-792792114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-fa2e610e-096b-429d-8e46-fb0dee65290a" returned: 0 in 0.269s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:14:59 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c1d5e3b2-05a5-41cc-8ff5-920388c74e9c tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Lock "cinder-quobyte-fa2e610e-096b-429d-8e46-fb0dee65290a" released by "delete_volume" :: held 0.845s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:14:59 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-ccde6578-d29f-497e-9da2-d906a27888be tempest-ProjectReaderTests-1745254395 None] Volume volume-8fe9e721-08cf-4eff-899f-845bd58f61cb (8fe9e721-08cf-4eff-899f-845bd58f61cb): created successfully
Nov 06 17:14:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ccde6578-d29f-497e-9da2-d906a27888be tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c669de65-46c6-4845-87b5-15a87eec53ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:14:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ccde6578-d29f-497e-9da2-d906a27888be tempest-ProjectReaderTests-1745254395 None] Flow 'volume_create_manager' (a9cd835c-c544-434a-abb2-1a37ecab5038) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:14:59 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-ccde6578-d29f-497e-9da2-d906a27888be tempest-ProjectReaderTests-1745254395 None] Created volume successfully.
Nov 06 17:14:59 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-c1d5e3b2-05a5-41cc-8ff5-920388c74e9c tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Created reservations ['122a7ce9-3273-410f-a419-18436b2ded7d', '0c2835b4-39f3-4b00-bec0-1e064f48d5fe', '28c2b212-758b-444f-9092-5fca4b502c3b', '87be4e49-7e15-45c0-82c6-3877e7ed27d6'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:15:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c1d5e3b2-05a5-41cc-8ff5-920388c74e9c tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:15:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c1d5e3b2-05a5-41cc-8ff5-920388c74e9c tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:15:00 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c1d5e3b2-05a5-41cc-8ff5-920388c74e9c tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:15:00 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c1d5e3b2-05a5-41cc-8ff5-920388c74e9c tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:15:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c1d5e3b2-05a5-41cc-8ff5-920388c74e9c tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:15:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c1d5e3b2-05a5-41cc-8ff5-920388c74e9c tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:15:00 devstack sudo[98609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:15:00 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:15:00 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root
Nov 06 17:15:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c1d5e3b2-05a5-41cc-8ff5-920388c74e9c tempest-VolumesSnapshotNegativeTestJSON-792792114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.293s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:15:00 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-c1d5e3b2-05a5-41cc-8ff5-920388c74e9c tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:15:00 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-c1d5e3b2-05a5-41cc-8ff5-920388c74e9c tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Deleted volume successfully.
Nov 06 17:15:00 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c1d5e3b2-05a5-41cc-8ff5-920388c74e9c tempest-VolumesSnapshotNegativeTestJSON-792792114 None] Lock "cinder-fa2e610e-096b-429d-8e46-fb0dee65290a-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:15:00 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e06db08e-22a0-4552-82be-079f8bccea6a tempest-ProjectReaderTests-1745254395 None] Acquiring lock "cinder-8fe9e721-08cf-4eff-899f-845bd58f61cb-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:15:00 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e06db08e-22a0-4552-82be-079f8bccea6a tempest-ProjectReaderTests-1745254395 None] Lock "cinder-8fe9e721-08cf-4eff-899f-845bd58f61cb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:15:00 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e06db08e-22a0-4552-82be-079f8bccea6a tempest-ProjectReaderTests-1745254395 None] Acquiring lock "cinder-quobyte-8fe9e721-08cf-4eff-899f-845bd58f61cb" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:15:00 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e06db08e-22a0-4552-82be-079f8bccea6a tempest-ProjectReaderTests-1745254395 None] Lock "cinder-quobyte-8fe9e721-08cf-4eff-899f-845bd58f61cb" acquired by "delete_volume" :: waited 0.026s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:15:01 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd67562-2fc1-447d-b935-b346b81c3f31]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:15:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e06db08e-22a0-4552-82be-079f8bccea6a tempest-ProjectReaderTests-1745254395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8fe9e721-08cf-4eff-899f-845bd58f61cb {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:15:01 devstack sudo[98612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8fe9e721-08cf-4eff-899f-845bd58f61cb
Nov 06 17:15:01 devstack sudo[98612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:15:01 devstack sudo[98612]: pam_unix(sudo:session): session closed for user root
Nov 06 17:15:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e06db08e-22a0-4552-82be-079f8bccea6a tempest-ProjectReaderTests-1745254395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8fe9e721-08cf-4eff-899f-845bd58f61cb" returned: 0 in 0.473s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:15:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e06db08e-22a0-4552-82be-079f8bccea6a tempest-ProjectReaderTests-1745254395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8fe9e721-08cf-4eff-899f-845bd58f61cb {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:15:01 devstack sudo[98621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8fe9e721-08cf-4eff-899f-845bd58f61cb
Nov 06 17:15:01 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:15:01 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root
Nov 06 17:15:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e06db08e-22a0-4552-82be-079f8bccea6a tempest-ProjectReaderTests-1745254395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8fe9e721-08cf-4eff-899f-845bd58f61cb" returned: 0 in 0.285s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:15:01 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e06db08e-22a0-4552-82be-079f8bccea6a tempest-ProjectReaderTests-1745254395 None] Lock "cinder-quobyte-8fe9e721-08cf-4eff-899f-845bd58f61cb" released by "delete_volume" :: held 0.820s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:15:01 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-e06db08e-22a0-4552-82be-079f8bccea6a tempest-ProjectReaderTests-1745254395 None] Created reservations ['81cbd28b-5462-4752-835e-8e44b75f4f84', '20196955-fae4-416a-88c2-3f406e69df35', '364ab9bf-81be-4c9a-866a-7eaa5038c8a3', 'f9cf85b2-ed5b-4905-80b0-9e8cf7110094'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:15:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e06db08e-22a0-4552-82be-079f8bccea6a tempest-ProjectReaderTests-1745254395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:15:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e06db08e-22a0-4552-82be-079f8bccea6a tempest-ProjectReaderTests-1745254395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:15:01 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e06db08e-22a0-4552-82be-079f8bccea6a tempest-ProjectReaderTests-1745254395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:15:01 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e06db08e-22a0-4552-82be-079f8bccea6a tempest-ProjectReaderTests-1745254395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:15:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e06db08e-22a0-4552-82be-079f8bccea6a tempest-ProjectReaderTests-1745254395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:15:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e06db08e-22a0-4552-82be-079f8bccea6a tempest-ProjectReaderTests-1745254395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:15:01 devstack sudo[98624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:15:01 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:15:02 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root
Nov 06 17:15:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e06db08e-22a0-4552-82be-079f8bccea6a tempest-ProjectReaderTests-1745254395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.325s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:15:02 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-e06db08e-22a0-4552-82be-079f8bccea6a tempest-ProjectReaderTests-1745254395 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:15:02 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-e06db08e-22a0-4552-82be-079f8bccea6a tempest-ProjectReaderTests-1745254395 None] Deleted volume successfully.
Nov 06 17:15:02 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e06db08e-22a0-4552-82be-079f8bccea6a tempest-ProjectReaderTests-1745254395 None] Lock "cinder-8fe9e721-08cf-4eff-899f-845bd58f61cb-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:15:02 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d12df31-2aa5-4c16-819e-224734d4653f tempest-ProjectReaderTests-1745254395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:15:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5d12df31-2aa5-4c16-819e-224734d4653f tempest-ProjectReaderTests-1745254395 None] Flow 'volume_create_manager' (f91c8d4a-b22e-4d3c-b217-40b75edc058a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:15:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5d12df31-2aa5-4c16-819e-224734d4653f tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76f35efe-bc7a-4f04-8a3f-5d12376f2874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:15:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5d12df31-2aa5-4c16-819e-224734d4653f tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76f35efe-bc7a-4f04-8a3f-5d12376f2874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-250396369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa70a05a-57a6-4072-96ee-d113ad61ea36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c0f5a62190e44369694746801ab8b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:15:03Z,use_quota=True,user_id='4ab0a997305b4fb9bc9c97dc5e3d21ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:15:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5d12df31-2aa5-4c16-819e-224734d4653f tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39107c46-2187-46e5-ad9a-06b8f1cf7826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:15:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5d12df31-2aa5-4c16-819e-224734d4653f tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39107c46-2187-46e5-ad9a-06b8f1cf7826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:15:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5d12df31-2aa5-4c16-819e-224734d4653f tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c469ee0-8cad-4210-9359-bba2bd8acc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:15:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5d12df31-2aa5-4c16-819e-224734d4653f tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c469ee0-8cad-4210-9359-bba2bd8acc0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa70a05a-57a6-4072-96ee-d113ad61ea36', 'volume_name': 'volume-aa70a05a-57a6-4072-96ee-d113ad61ea36', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:15:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5d12df31-2aa5-4c16-819e-224734d4653f tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af6bcb16-887b-4403-99b6-acd1c773ed56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:15:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5d12df31-2aa5-4c16-819e-224734d4653f tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af6bcb16-887b-4403-99b6-acd1c773ed56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:15:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5d12df31-2aa5-4c16-819e-224734d4653f tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcdf6aeb-4804-4e41-b171-6a99d69cb3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:15:02 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-5d12df31-2aa5-4c16-819e-224734d4653f tempest-ProjectReaderTests-1745254395 None] Volume aa70a05a-57a6-4072-96ee-d113ad61ea36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa70a05a-57a6-4072-96ee-d113ad61ea36', 'volume_size': 1}
Nov 06 17:15:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5d12df31-2aa5-4c16-819e-224734d4653f tempest-ProjectReaderTests-1745254395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:15:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5d12df31-2aa5-4c16-819e-224734d4653f tempest-ProjectReaderTests-1745254395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:15:02 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5d12df31-2aa5-4c16-819e-224734d4653f tempest-ProjectReaderTests-1745254395 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-250396369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa70a05a-57a6-4072-96ee-d113ad61ea36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c0f5a62190e44369694746801ab8b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:15:03Z,use_quota=True,user_id='4ab0a997305b4fb9bc9c97dc5e3d21ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:15:02 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-5d12df31-2aa5-4c16-819e-224734d4653f tempest-ProjectReaderTests-1745254395 None] Creating volume aa70a05a-57a6-4072-96ee-d113ad61ea36 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:15:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5d12df31-2aa5-4c16-819e-224734d4653f tempest-ProjectReaderTests-1745254395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:15:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5d12df31-2aa5-4c16-819e-224734d4653f tempest-ProjectReaderTests-1745254395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:15:02 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5d12df31-2aa5-4c16-819e-224734d4653f tempest-ProjectReaderTests-1745254395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:15:02 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5d12df31-2aa5-4c16-819e-224734d4653f tempest-ProjectReaderTests-1745254395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:15:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5d12df31-2aa5-4c16-819e-224734d4653f tempest-ProjectReaderTests-1745254395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:15:02 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5d12df31-2aa5-4c16-819e-224734d4653f tempest-ProjectReaderTests-1745254395 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:15:02 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-5d12df31-2aa5-4c16-819e-224734d4653f tempest-ProjectReaderTests-1745254395 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:15:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d12df31-2aa5-4c16-819e-224734d4653f tempest-ProjectReaderTests-1745254395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-aa70a05a-57a6-4072-96ee-d113ad61ea36 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:15:02 devstack sudo[98629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-aa70a05a-57a6-4072-96ee-d113ad61ea36 1073741824
Nov 06 17:15:02 devstack sudo[98629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:15:03 devstack sudo[98629]: pam_unix(sudo:session): session closed for user root
Nov 06 17:15:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d12df31-2aa5-4c16-819e-224734d4653f tempest-ProjectReaderTests-1745254395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-aa70a05a-57a6-4072-96ee-d113ad61ea36 1073741824" returned: 0 in 0.652s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:15:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d12df31-2aa5-4c16-819e-224734d4653f tempest-ProjectReaderTests-1745254395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-aa70a05a-57a6-4072-96ee-d113ad61ea36 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:15:03 devstack sudo[98639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-aa70a05a-57a6-4072-96ee-d113ad61ea36
Nov 06 17:15:03 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:15:03 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root
Nov 06 17:15:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d12df31-2aa5-4c16-819e-224734d4653f tempest-ProjectReaderTests-1745254395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-aa70a05a-57a6-4072-96ee-d113ad61ea36" returned: 0 in 0.308s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:15:03 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5d12df31-2aa5-4c16-819e-224734d4653f tempest-ProjectReaderTests-1745254395 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:15:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5d12df31-2aa5-4c16-819e-224734d4653f tempest-ProjectReaderTests-1745254395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:15:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5d12df31-2aa5-4c16-819e-224734d4653f tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcdf6aeb-4804-4e41-b171-6a99d69cb3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa70a05a-57a6-4072-96ee-d113ad61ea36', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:15:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5d12df31-2aa5-4c16-819e-224734d4653f tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b03bd9-0ab9-479b-93c7-e3c9fee86dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:15:03 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-5d12df31-2aa5-4c16-819e-224734d4653f tempest-ProjectReaderTests-1745254395 None] Volume volume-aa70a05a-57a6-4072-96ee-d113ad61ea36 (aa70a05a-57a6-4072-96ee-d113ad61ea36): created successfully
Nov 06 17:15:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5d12df31-2aa5-4c16-819e-224734d4653f tempest-ProjectReaderTests-1745254395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b03bd9-0ab9-479b-93c7-e3c9fee86dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:15:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5d12df31-2aa5-4c16-819e-224734d4653f tempest-ProjectReaderTests-1745254395 None] Flow 'volume_create_manager' (f91c8d4a-b22e-4d3c-b217-40b75edc058a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:15:04 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-5d12df31-2aa5-4c16-819e-224734d4653f tempest-ProjectReaderTests-1745254395 None] Created volume successfully.
Nov 06 17:15:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-d78e901b-907b-49a6-87a0-6f55a0071ac7 req-01dbab2b-310d-4409-a5a2-10208fdb9999 tempest-TestInstancesWithCinderVolumes-52000996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:15:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-d78e901b-907b-49a6-87a0-6f55a0071ac7 req-01dbab2b-310d-4409-a5a2-10208fdb9999 tempest-TestInstancesWithCinderVolumes-52000996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:15:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-d78e901b-907b-49a6-87a0-6f55a0071ac7 req-01dbab2b-310d-4409-a5a2-10208fdb9999 tempest-TestInstancesWithCinderVolumes-52000996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:15:04 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-d78e901b-907b-49a6-87a0-6f55a0071ac7 req-01dbab2b-310d-4409-a5a2-10208fdb9999 tempest-TestInstancesWithCinderVolumes-52000996 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316', 'name': 'volume-bec8c9fe-9276-4d89-848f-52cef29e59bb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '76621346-afd5-4b76-9480-6941288899b1', 'enforce_multipath': True} {{(pid=86856) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 17:15:04 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-d78e901b-907b-49a6-87a0-6f55a0071ac7 req-01dbab2b-310d-4409-a5a2-10208fdb9999 tempest-TestInstancesWithCinderVolumes-52000996 None] attachment_update completed successfully.
Nov 06 17:15:04 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c10444d4-a75c-47e3-8688-4eee3cccc529 tempest-ProjectReaderTests-1745254395 None] Acquiring lock "cinder-aa70a05a-57a6-4072-96ee-d113ad61ea36-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:15:04 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c10444d4-a75c-47e3-8688-4eee3cccc529 tempest-ProjectReaderTests-1745254395 None] Lock "cinder-aa70a05a-57a6-4072-96ee-d113ad61ea36-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:15:05 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c10444d4-a75c-47e3-8688-4eee3cccc529 tempest-ProjectReaderTests-1745254395 None] Acquiring lock "cinder-quobyte-aa70a05a-57a6-4072-96ee-d113ad61ea36" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:15:05 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c10444d4-a75c-47e3-8688-4eee3cccc529 tempest-ProjectReaderTests-1745254395 None] Lock "cinder-quobyte-aa70a05a-57a6-4072-96ee-d113ad61ea36" acquired by "delete_volume" :: waited 0.045s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:15:05 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23438f9-2ef7-48db-8ce1-748c57a0c362]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:15:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c10444d4-a75c-47e3-8688-4eee3cccc529 tempest-ProjectReaderTests-1745254395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-aa70a05a-57a6-4072-96ee-d113ad61ea36 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:15:05 devstack sudo[98652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-aa70a05a-57a6-4072-96ee-d113ad61ea36
Nov 06 17:15:05 devstack sudo[98652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:15:05 devstack sudo[98652]: pam_unix(sudo:session): session closed for user root
Nov 06 17:15:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c10444d4-a75c-47e3-8688-4eee3cccc529 tempest-ProjectReaderTests-1745254395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-aa70a05a-57a6-4072-96ee-d113ad61ea36" returned: 0 in 0.457s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:15:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c10444d4-a75c-47e3-8688-4eee3cccc529 tempest-ProjectReaderTests-1745254395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-aa70a05a-57a6-4072-96ee-d113ad61ea36 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:15:05 devstack sudo[98658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-aa70a05a-57a6-4072-96ee-d113ad61ea36
Nov 06 17:15:05 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:15:05 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root
Nov 06 17:15:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c10444d4-a75c-47e3-8688-4eee3cccc529 tempest-ProjectReaderTests-1745254395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-aa70a05a-57a6-4072-96ee-d113ad61ea36" returned: 0 in 0.275s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:15:05 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c10444d4-a75c-47e3-8688-4eee3cccc529 tempest-ProjectReaderTests-1745254395 None] Lock "cinder-quobyte-aa70a05a-57a6-4072-96ee-d113ad61ea36" released by "delete_volume" :: held 0.854s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:15:05 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-c10444d4-a75c-47e3-8688-4eee3cccc529 tempest-ProjectReaderTests-1745254395 None] Created reservations ['e6a30f8d-a8ca-4349-bd3e-f3a6fce9c4b0', '3de33c5e-9317-4988-a595-c7c5b72cfb44', '3b028d66-fcaf-4b4f-9b8d-329fcb51ba15', '0939f683-11d9-4b34-a4ad-aacf76530a9b'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:15:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c10444d4-a75c-47e3-8688-4eee3cccc529 tempest-ProjectReaderTests-1745254395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:15:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c10444d4-a75c-47e3-8688-4eee3cccc529 tempest-ProjectReaderTests-1745254395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:15:06 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c10444d4-a75c-47e3-8688-4eee3cccc529 tempest-ProjectReaderTests-1745254395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:15:06 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c10444d4-a75c-47e3-8688-4eee3cccc529 tempest-ProjectReaderTests-1745254395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:15:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c10444d4-a75c-47e3-8688-4eee3cccc529 tempest-ProjectReaderTests-1745254395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:15:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c10444d4-a75c-47e3-8688-4eee3cccc529 tempest-ProjectReaderTests-1745254395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:15:06 devstack sudo[98661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:15:06 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:15:06 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root
Nov 06 17:15:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c10444d4-a75c-47e3-8688-4eee3cccc529 tempest-ProjectReaderTests-1745254395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.538s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:15:06 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-c10444d4-a75c-47e3-8688-4eee3cccc529 tempest-ProjectReaderTests-1745254395 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:15:06 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-c10444d4-a75c-47e3-8688-4eee3cccc529 tempest-ProjectReaderTests-1745254395 None] Deleted volume successfully.
Nov 06 17:15:06 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c10444d4-a75c-47e3-8688-4eee3cccc529 tempest-ProjectReaderTests-1745254395 None] Lock "cinder-aa70a05a-57a6-4072-96ee-d113ad61ea36-delete_volume" released by "delete_volume" :: held 1.896s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:15:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-5156372f-0c9e-4945-a259-1972fa17f068 req-3613dad8-a1fc-4132-9b27-ac19d59042cb tempest-TestInstancesWithCinderVolumes-52000996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:15:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-5156372f-0c9e-4945-a259-1972fa17f068 req-3613dad8-a1fc-4132-9b27-ac19d59042cb tempest-TestInstancesWithCinderVolumes-52000996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:15:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-5156372f-0c9e-4945-a259-1972fa17f068 req-3613dad8-a1fc-4132-9b27-ac19d59042cb tempest-TestInstancesWithCinderVolumes-52000996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:15:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-5156372f-0c9e-4945-a259-1972fa17f068 req-3613dad8-a1fc-4132-9b27-ac19d59042cb tempest-TestInstancesWithCinderVolumes-52000996 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316', 'name': 'volume-c84613a1-b87a-4613-ab2f-4860fcbd6102', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4c45eb87-ad22-4c78-aa0b-200b1dbb35b8', 'enforce_multipath': True} {{(pid=86856) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 17:15:08 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-5156372f-0c9e-4945-a259-1972fa17f068 req-3613dad8-a1fc-4132-9b27-ac19d59042cb tempest-TestInstancesWithCinderVolumes-52000996 None] attachment_update completed successfully.
Nov 06 17:15:14 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=162,cinder:INSERT=59,cinder:UPDATE=177,cinder:DELETE=16 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:15:14 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:UPDATE=204,cinder:DELETE=15,cinder:SELECT=162,cinder:INSERT=53 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:15:14 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-abd5ab12-d1e7-4d70-be4a-3ae1b6f3a1c5 req-5d3500dc-d228-4d8b-bc89-72e7676ae2d5 tempest-TestInstancesWithCinderVolumes-52000996 None] Terminate volume connection completed successfully.
Nov 06 17:15:14 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-abd5ab12-d1e7-4d70-be4a-3ae1b6f3a1c5 req-5d3500dc-d228-4d8b-bc89-72e7676ae2d5 tempest-TestInstancesWithCinderVolumes-52000996 None] Deleting attachment 76621346-afd5-4b76-9480-6941288899b1. {{(pid=86856) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 17:15:14 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-db493465-f85a-483e-91b8-18ba9fc50a81 tempest-TestInstancesWithCinderVolumes-52000996 None] Acquiring lock "cinder-bec8c9fe-9276-4d89-848f-52cef29e59bb-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:15:14 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-db493465-f85a-483e-91b8-18ba9fc50a81 tempest-TestInstancesWithCinderVolumes-52000996 None] Lock "cinder-bec8c9fe-9276-4d89-848f-52cef29e59bb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:15:14 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-db493465-f85a-483e-91b8-18ba9fc50a81 tempest-TestInstancesWithCinderVolumes-52000996 None] Acquiring lock "cinder-quobyte-bec8c9fe-9276-4d89-848f-52cef29e59bb" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:15:14 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-db493465-f85a-483e-91b8-18ba9fc50a81 tempest-TestInstancesWithCinderVolumes-52000996 None] Lock "cinder-quobyte-bec8c9fe-9276-4d89-848f-52cef29e59bb" acquired by "delete_volume" :: waited 0.017s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:15:14 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc3b9dc-7a0d-448b-abf3-51a64d5529ee]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:15:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-db493465-f85a-483e-91b8-18ba9fc50a81 tempest-TestInstancesWithCinderVolumes-52000996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bec8c9fe-9276-4d89-848f-52cef29e59bb {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:15:15 devstack sudo[98719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bec8c9fe-9276-4d89-848f-52cef29e59bb
Nov 06 17:15:15 devstack sudo[98719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:15:15 devstack sudo[98719]: pam_unix(sudo:session): session closed for user root
Nov 06 17:15:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-db493465-f85a-483e-91b8-18ba9fc50a81 tempest-TestInstancesWithCinderVolumes-52000996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bec8c9fe-9276-4d89-848f-52cef29e59bb" returned: 0 in 0.532s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:15:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-db493465-f85a-483e-91b8-18ba9fc50a81 tempest-TestInstancesWithCinderVolumes-52000996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bec8c9fe-9276-4d89-848f-52cef29e59bb {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:15:15 devstack sudo[98726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bec8c9fe-9276-4d89-848f-52cef29e59bb
Nov 06 17:15:15 devstack sudo[98726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:15:15 devstack sudo[98726]: pam_unix(sudo:session): session closed for user root
Nov 06 17:15:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-db493465-f85a-483e-91b8-18ba9fc50a81 tempest-TestInstancesWithCinderVolumes-52000996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bec8c9fe-9276-4d89-848f-52cef29e59bb" returned: 0 in 0.420s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:15:15 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8bfe194-a0d8-4dde-bbad-b6322a76ef92 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:15:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a8bfe194-a0d8-4dde-bbad-b6322a76ef92 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Flow 'volume_create_manager' (dca77cbe-6517-4c22-8bc8-e8e66f1d29c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a8bfe194-a0d8-4dde-bbad-b6322a76ef92 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7320d2d-0d83-4cd9-8ab9-ebfe3b163726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-db493465-f85a-483e-91b8-18ba9fc50a81 tempest-TestInstancesWithCinderVolumes-52000996 None] Lock "cinder-quobyte-bec8c9fe-9276-4d89-848f-52cef29e59bb" released by "delete_volume" :: held 1.117s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a8bfe194-a0d8-4dde-bbad-b6322a76ef92 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7320d2d-0d83-4cd9-8ab9-ebfe3b163726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1446096320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e76ba89-7aad-4f36-bec3-3025d8e9b052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4193d663c5ec403b9f43c655387f789e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:15:16Z,use_quota=True,user_id='e7dee6a08ced4c1982efe182b1048bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a8bfe194-a0d8-4dde-bbad-b6322a76ef92 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85f882f8-0d24-45e1-becc-1ad4c1574f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a8bfe194-a0d8-4dde-bbad-b6322a76ef92 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85f882f8-0d24-45e1-becc-1ad4c1574f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a8bfe194-a0d8-4dde-bbad-b6322a76ef92 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37722b25-ac79-4c1a-a345-6cefa058eb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a8bfe194-a0d8-4dde-bbad-b6322a76ef92 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37722b25-ac79-4c1a-a345-6cefa058eb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e76ba89-7aad-4f36-bec3-3025d8e9b052', 'volume_name': 'volume-4e76ba89-7aad-4f36-bec3-3025d8e9b052', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a8bfe194-a0d8-4dde-bbad-b6322a76ef92 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b815e5aa-2be4-4999-9b37-72088591aa84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a8bfe194-a0d8-4dde-bbad-b6322a76ef92 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b815e5aa-2be4-4999-9b37-72088591aa84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a8bfe194-a0d8-4dde-bbad-b6322a76ef92 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db2db145-0ff0-4b1d-ab48-68a109c74f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:15:16 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-a8bfe194-a0d8-4dde-bbad-b6322a76ef92 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Volume 4e76ba89-7aad-4f36-bec3-3025d8e9b052: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e76ba89-7aad-4f36-bec3-3025d8e9b052', 'volume_size': 1}
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a8bfe194-a0d8-4dde-bbad-b6322a76ef92 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a8bfe194-a0d8-4dde-bbad-b6322a76ef92 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a8bfe194-a0d8-4dde-bbad-b6322a76ef92 tempest-TestServerVolumeAttachmentScenario-1965196702 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1446096320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e76ba89-7aad-4f36-bec3-3025d8e9b052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4193d663c5ec403b9f43c655387f789e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:15:16Z,use_quota=True,user_id='e7dee6a08ced4c1982efe182b1048bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-a8bfe194-a0d8-4dde-bbad-b6322a76ef92 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Creating volume 4e76ba89-7aad-4f36-bec3-3025d8e9b052 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a8bfe194-a0d8-4dde-bbad-b6322a76ef92 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a8bfe194-a0d8-4dde-bbad-b6322a76ef92 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a8bfe194-a0d8-4dde-bbad-b6322a76ef92 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a8bfe194-a0d8-4dde-bbad-b6322a76ef92 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a8bfe194-a0d8-4dde-bbad-b6322a76ef92 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a8bfe194-a0d8-4dde-bbad-b6322a76ef92 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:15:16 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-a8bfe194-a0d8-4dde-bbad-b6322a76ef92 tempest-TestServerVolumeAttachmentScenario-1965196702 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a8bfe194-a0d8-4dde-bbad-b6322a76ef92 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-4e76ba89-7aad-4f36-bec3-3025d8e9b052 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:15:16 devstack sudo[98729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-4e76ba89-7aad-4f36-bec3-3025d8e9b052 1073741824
Nov 06 17:15:16 devstack sudo[98729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:15:16 devstack cinder-volume[86856]: WARNING cinder.quota [None req-db493465-f85a-483e-91b8-18ba9fc50a81 tempest-TestInstancesWithCinderVolumes-52000996 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-534093499-1766047005 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-534093499-1766047005, it is now deprecated. Please use the default quota class for default quota.
Nov 06 17:15:16 devstack cinder-volume[86856]: WARNING cinder.quota [None req-db493465-f85a-483e-91b8-18ba9fc50a81 tempest-TestInstancesWithCinderVolumes-52000996 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-534093499-1766047005 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-534093499-1766047005, it is now deprecated. Please use the default quota class for default quota.
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-db493465-f85a-483e-91b8-18ba9fc50a81 tempest-TestInstancesWithCinderVolumes-52000996 None] Created reservations ['5c89f5fa-22d1-4871-8efd-f2816c74c62e', '2d692f03-f1e7-4d92-9c02-57bbe3ac4c68', '41346d4e-28dc-43fb-97b7-c0d7caed4680', '95c9acf4-7bd0-4089-a184-35bf9570d525'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-db493465-f85a-483e-91b8-18ba9fc50a81 tempest-TestInstancesWithCinderVolumes-52000996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-db493465-f85a-483e-91b8-18ba9fc50a81 tempest-TestInstancesWithCinderVolumes-52000996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-db493465-f85a-483e-91b8-18ba9fc50a81 tempest-TestInstancesWithCinderVolumes-52000996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-db493465-f85a-483e-91b8-18ba9fc50a81 tempest-TestInstancesWithCinderVolumes-52000996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-db493465-f85a-483e-91b8-18ba9fc50a81 tempest-TestInstancesWithCinderVolumes-52000996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-db493465-f85a-483e-91b8-18ba9fc50a81 tempest-TestInstancesWithCinderVolumes-52000996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:15:16 devstack sudo[98733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:15:16 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-919070bb-6a15-475f-bb5f-53263ed33859 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-919070bb-6a15-475f-bb5f-53263ed33859 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Flow 'volume_create_manager' (17afe57d-783e-4d4b-abdb-b71de54bbb0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-919070bb-6a15-475f-bb5f-53263ed33859 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (048c4a6a-8762-4630-9e9b-dc0d96069e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-919070bb-6a15-475f-bb5f-53263ed33859 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (048c4a6a-8762-4630-9e9b-dc0d96069e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-630033100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5693360-b11a-470c-a193-b4f5646f0496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4193d663c5ec403b9f43c655387f789e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:15:16Z,use_quota=True,user_id='e7dee6a08ced4c1982efe182b1048bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-919070bb-6a15-475f-bb5f-53263ed33859 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e102cae-9a69-4bba-b747-b2d852e1cbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-919070bb-6a15-475f-bb5f-53263ed33859 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e102cae-9a69-4bba-b747-b2d852e1cbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-919070bb-6a15-475f-bb5f-53263ed33859 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (264d3697-3d30-4766-8297-dcccb33291cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-919070bb-6a15-475f-bb5f-53263ed33859 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (264d3697-3d30-4766-8297-dcccb33291cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5693360-b11a-470c-a193-b4f5646f0496', 'volume_name': 'volume-f5693360-b11a-470c-a193-b4f5646f0496', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-919070bb-6a15-475f-bb5f-53263ed33859 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35efa3b0-697c-4c57-9644-9f62a06c50a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-919070bb-6a15-475f-bb5f-53263ed33859 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35efa3b0-697c-4c57-9644-9f62a06c50a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-919070bb-6a15-475f-bb5f-53263ed33859 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02dbb55e-54dd-4289-be5d-822227991d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:15:16 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-919070bb-6a15-475f-bb5f-53263ed33859 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Volume f5693360-b11a-470c-a193-b4f5646f0496: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5693360-b11a-470c-a193-b4f5646f0496', 'volume_size': 1}
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-919070bb-6a15-475f-bb5f-53263ed33859 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:15:16 devstack sudo[98729]: pam_unix(sudo:session): session closed for user root
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a8bfe194-a0d8-4dde-bbad-b6322a76ef92 tempest-TestServerVolumeAttachmentScenario-1965196702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-4e76ba89-7aad-4f36-bec3-3025d8e9b052 1073741824" returned: 0 in 0.670s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a8bfe194-a0d8-4dde-bbad-b6322a76ef92 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-4e76ba89-7aad-4f36-bec3-3025d8e9b052 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:15:16 devstack sudo[98738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-4e76ba89-7aad-4f36-bec3-3025d8e9b052
Nov 06 17:15:16 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:15:16 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-db493465-f85a-483e-91b8-18ba9fc50a81 tempest-TestInstancesWithCinderVolumes-52000996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.541s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:15:16 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-db493465-f85a-483e-91b8-18ba9fc50a81 tempest-TestInstancesWithCinderVolumes-52000996 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:15:16 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-db493465-f85a-483e-91b8-18ba9fc50a81 tempest-TestInstancesWithCinderVolumes-52000996 None] Deleted volume successfully.
Nov 06 17:15:17 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-db493465-f85a-483e-91b8-18ba9fc50a81 tempest-TestInstancesWithCinderVolumes-52000996 None] Lock "cinder-bec8c9fe-9276-4d89-848f-52cef29e59bb-delete_volume" released by "delete_volume" :: held 2.153s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:15:17 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root
Nov 06 17:15:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a8bfe194-a0d8-4dde-bbad-b6322a76ef92 tempest-TestServerVolumeAttachmentScenario-1965196702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-4e76ba89-7aad-4f36-bec3-3025d8e9b052" returned: 0 in 0.364s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:15:17 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a8bfe194-a0d8-4dde-bbad-b6322a76ef92 tempest-TestServerVolumeAttachmentScenario-1965196702 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:15:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a8bfe194-a0d8-4dde-bbad-b6322a76ef92 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:15:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-919070bb-6a15-475f-bb5f-53263ed33859 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.585s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:15:17 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-919070bb-6a15-475f-bb5f-53263ed33859 tempest-TestServerVolumeAttachmentScenario-1965196702 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-630033100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5693360-b11a-470c-a193-b4f5646f0496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4193d663c5ec403b9f43c655387f789e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:15:16Z,use_quota=True,user_id='e7dee6a08ced4c1982efe182b1048bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:15:17 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-919070bb-6a15-475f-bb5f-53263ed33859 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Creating volume f5693360-b11a-470c-a193-b4f5646f0496 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:15:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-919070bb-6a15-475f-bb5f-53263ed33859 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:15:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-919070bb-6a15-475f-bb5f-53263ed33859 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:15:17 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-919070bb-6a15-475f-bb5f-53263ed33859 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:15:17 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-919070bb-6a15-475f-bb5f-53263ed33859 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:15:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-919070bb-6a15-475f-bb5f-53263ed33859 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:15:17 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-919070bb-6a15-475f-bb5f-53263ed33859 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:15:17 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-919070bb-6a15-475f-bb5f-53263ed33859 tempest-TestServerVolumeAttachmentScenario-1965196702 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:15:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-919070bb-6a15-475f-bb5f-53263ed33859 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f5693360-b11a-470c-a193-b4f5646f0496 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:15:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a8bfe194-a0d8-4dde-bbad-b6322a76ef92 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db2db145-0ff0-4b1d-ab48-68a109c74f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e76ba89-7aad-4f36-bec3-3025d8e9b052', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:15:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a8bfe194-a0d8-4dde-bbad-b6322a76ef92 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41303f81-1a95-442a-936d-59196def18ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:15:17 devstack sudo[98741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f5693360-b11a-470c-a193-b4f5646f0496 1073741824
Nov 06 17:15:17 devstack sudo[98741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:15:17 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-a8bfe194-a0d8-4dde-bbad-b6322a76ef92 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Volume volume-4e76ba89-7aad-4f36-bec3-3025d8e9b052 (4e76ba89-7aad-4f36-bec3-3025d8e9b052): created successfully
Nov 06 17:15:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a8bfe194-a0d8-4dde-bbad-b6322a76ef92 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41303f81-1a95-442a-936d-59196def18ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:15:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a8bfe194-a0d8-4dde-bbad-b6322a76ef92 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Flow 'volume_create_manager' (dca77cbe-6517-4c22-8bc8-e8e66f1d29c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:15:17 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-a8bfe194-a0d8-4dde-bbad-b6322a76ef92 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Created volume successfully.
Nov 06 17:15:17 devstack sudo[98741]: pam_unix(sudo:session): session closed for user root
Nov 06 17:15:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-919070bb-6a15-475f-bb5f-53263ed33859 tempest-TestServerVolumeAttachmentScenario-1965196702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f5693360-b11a-470c-a193-b4f5646f0496 1073741824" returned: 0 in 0.664s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:15:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-919070bb-6a15-475f-bb5f-53263ed33859 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f5693360-b11a-470c-a193-b4f5646f0496 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:15:18 devstack sudo[98752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f5693360-b11a-470c-a193-b4f5646f0496
Nov 06 17:15:18 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:15:18 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root
Nov 06 17:15:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-919070bb-6a15-475f-bb5f-53263ed33859 tempest-TestServerVolumeAttachmentScenario-1965196702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f5693360-b11a-470c-a193-b4f5646f0496" returned: 0 in 0.407s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:15:18 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-919070bb-6a15-475f-bb5f-53263ed33859 tempest-TestServerVolumeAttachmentScenario-1965196702 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:15:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-919070bb-6a15-475f-bb5f-53263ed33859 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:15:18 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-919070bb-6a15-475f-bb5f-53263ed33859 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02dbb55e-54dd-4289-be5d-822227991d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5693360-b11a-470c-a193-b4f5646f0496', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:15:18 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-919070bb-6a15-475f-bb5f-53263ed33859 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ecb3d67-eab8-4e21-952f-6c819557cc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:15:18 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-919070bb-6a15-475f-bb5f-53263ed33859 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Volume volume-f5693360-b11a-470c-a193-b4f5646f0496 (f5693360-b11a-470c-a193-b4f5646f0496): created successfully
Nov 06 17:15:18 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-919070bb-6a15-475f-bb5f-53263ed33859 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ecb3d67-eab8-4e21-952f-6c819557cc31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:15:18 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-919070bb-6a15-475f-bb5f-53263ed33859 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Flow 'volume_create_manager' (17afe57d-783e-4d4b-abdb-b71de54bbb0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:15:18 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-919070bb-6a15-475f-bb5f-53263ed33859 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Created volume successfully.
Nov 06 17:15:19 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-8458df6a-b97b-4421-ac21-d7a6b901db67 req-b97e12ac-05fb-4752-9fd0-5bba8061da94 tempest-TestInstancesWithCinderVolumes-52000996 None] Terminate volume connection completed successfully.
Nov 06 17:15:19 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-8458df6a-b97b-4421-ac21-d7a6b901db67 req-b97e12ac-05fb-4752-9fd0-5bba8061da94 tempest-TestInstancesWithCinderVolumes-52000996 None] Deleting attachment 4c45eb87-ad22-4c78-aa0b-200b1dbb35b8. {{(pid=86856) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 17:15:20 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9571d188-363a-4e28-ab18-d2e017a4578f tempest-TestInstancesWithCinderVolumes-52000996 None] Acquiring lock "cinder-c84613a1-b87a-4613-ab2f-4860fcbd6102-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:15:20 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9571d188-363a-4e28-ab18-d2e017a4578f tempest-TestInstancesWithCinderVolumes-52000996 None] Lock "cinder-c84613a1-b87a-4613-ab2f-4860fcbd6102-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:15:20 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9571d188-363a-4e28-ab18-d2e017a4578f tempest-TestInstancesWithCinderVolumes-52000996 None] Acquiring lock "cinder-quobyte-c84613a1-b87a-4613-ab2f-4860fcbd6102" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:15:20 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9571d188-363a-4e28-ab18-d2e017a4578f tempest-TestInstancesWithCinderVolumes-52000996 None] Lock "cinder-quobyte-c84613a1-b87a-4613-ab2f-4860fcbd6102" acquired by "delete_volume" :: waited 0.037s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:15:20 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[4601cdfb-0b80-4622-8cc5-3670167ea65e]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:15:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9571d188-363a-4e28-ab18-d2e017a4578f tempest-TestInstancesWithCinderVolumes-52000996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c84613a1-b87a-4613-ab2f-4860fcbd6102 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:15:20 devstack sudo[98774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c84613a1-b87a-4613-ab2f-4860fcbd6102
Nov 06 17:15:20 devstack sudo[98774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:15:21 devstack sudo[98774]: pam_unix(sudo:session): session closed for user root
Nov 06 17:15:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9571d188-363a-4e28-ab18-d2e017a4578f tempest-TestInstancesWithCinderVolumes-52000996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c84613a1-b87a-4613-ab2f-4860fcbd6102" returned: 0 in 0.616s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:15:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9571d188-363a-4e28-ab18-d2e017a4578f tempest-TestInstancesWithCinderVolumes-52000996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c84613a1-b87a-4613-ab2f-4860fcbd6102 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:15:21 devstack sudo[98779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c84613a1-b87a-4613-ab2f-4860fcbd6102
Nov 06 17:15:21 devstack sudo[98779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:15:21 devstack sudo[98779]: pam_unix(sudo:session): session closed for user root
Nov 06 17:15:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9571d188-363a-4e28-ab18-d2e017a4578f tempest-TestInstancesWithCinderVolumes-52000996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c84613a1-b87a-4613-ab2f-4860fcbd6102" returned: 0 in 0.340s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:15:21 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9571d188-363a-4e28-ab18-d2e017a4578f tempest-TestInstancesWithCinderVolumes-52000996 None] Lock "cinder-quobyte-c84613a1-b87a-4613-ab2f-4860fcbd6102" released by "delete_volume" :: held 1.035s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:15:21 devstack cinder-volume[86856]: WARNING cinder.quota [None req-9571d188-363a-4e28-ab18-d2e017a4578f tempest-TestInstancesWithCinderVolumes-52000996 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-315275737-50818802 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-315275737-50818802, it is now deprecated. Please use the default quota class for default quota.
Nov 06 17:15:21 devstack cinder-volume[86856]: WARNING cinder.quota [None req-9571d188-363a-4e28-ab18-d2e017a4578f tempest-TestInstancesWithCinderVolumes-52000996 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-315275737-50818802 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-315275737-50818802, it is now deprecated. Please use the default quota class for default quota.
Nov 06 17:15:21 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-9571d188-363a-4e28-ab18-d2e017a4578f tempest-TestInstancesWithCinderVolumes-52000996 None] Created reservations ['26a336ef-2ae6-4fca-bd98-cd96ac4f16c7', '31b3107e-d853-4ada-a3da-a48dff69d815', '83aa5a8d-f81f-4f5f-bbad-67696ee2bb12', '122796f4-efdb-483a-b8ec-f52856f43814'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:15:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9571d188-363a-4e28-ab18-d2e017a4578f tempest-TestInstancesWithCinderVolumes-52000996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:15:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9571d188-363a-4e28-ab18-d2e017a4578f tempest-TestInstancesWithCinderVolumes-52000996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:15:21 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-9571d188-363a-4e28-ab18-d2e017a4578f tempest-TestInstancesWithCinderVolumes-52000996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:15:21 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-9571d188-363a-4e28-ab18-d2e017a4578f tempest-TestInstancesWithCinderVolumes-52000996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:15:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9571d188-363a-4e28-ab18-d2e017a4578f tempest-TestInstancesWithCinderVolumes-52000996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:15:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9571d188-363a-4e28-ab18-d2e017a4578f tempest-TestInstancesWithCinderVolumes-52000996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:15:21 devstack sudo[98783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:15:21 devstack sudo[98783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:15:22 devstack sudo[98783]: pam_unix(sudo:session): session closed for user root
Nov 06 17:15:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9571d188-363a-4e28-ab18-d2e017a4578f tempest-TestInstancesWithCinderVolumes-52000996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.438s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:15:22 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-9571d188-363a-4e28-ab18-d2e017a4578f tempest-TestInstancesWithCinderVolumes-52000996 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:15:22 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-9571d188-363a-4e28-ab18-d2e017a4578f tempest-TestInstancesWithCinderVolumes-52000996 None] Deleted volume successfully.
Nov 06 17:15:22 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9571d188-363a-4e28-ab18-d2e017a4578f tempest-TestInstancesWithCinderVolumes-52000996 None] Lock "cinder-c84613a1-b87a-4613-ab2f-4860fcbd6102-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:15:26 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-a29bfa17-6a72-4e5b-95d9-fe29f8c3e451 req-ce7161af-9c9d-4e75-9a16-2fda75fa1668 tempest-TestInstancesWithCinderVolumes-52000996 None] Terminate volume connection completed successfully.
Nov 06 17:15:26 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-a29bfa17-6a72-4e5b-95d9-fe29f8c3e451 req-ce7161af-9c9d-4e75-9a16-2fda75fa1668 tempest-TestInstancesWithCinderVolumes-52000996 None] Deleting attachment ce85d111-fe60-4983-8ef5-caef064b5f9e. {{(pid=86856) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 17:15:29 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-be4f0991-b2db-4c0e-97b5-d85b344ee61c tempest-TestInstancesWithCinderVolumes-52000996 None] Acquiring lock "cinder-b3a70268-1141-4755-9650-fd29871330f2-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:15:29 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-be4f0991-b2db-4c0e-97b5-d85b344ee61c tempest-TestInstancesWithCinderVolumes-52000996 None] Lock "cinder-b3a70268-1141-4755-9650-fd29871330f2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:15:29 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-be4f0991-b2db-4c0e-97b5-d85b344ee61c tempest-TestInstancesWithCinderVolumes-52000996 None] Acquiring lock "cinder-quobyte-b3a70268-1141-4755-9650-fd29871330f2" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:15:29 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-be4f0991-b2db-4c0e-97b5-d85b344ee61c tempest-TestInstancesWithCinderVolumes-52000996 None] Lock "cinder-quobyte-b3a70268-1141-4755-9650-fd29871330f2" acquired by "delete_volume" :: waited 0.022s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:15:29 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff78ebde-9af7-4be8-9106-fde2125f2fc6]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:15:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-be4f0991-b2db-4c0e-97b5-d85b344ee61c tempest-TestInstancesWithCinderVolumes-52000996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b3a70268-1141-4755-9650-fd29871330f2 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:15:29 devstack sudo[98898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b3a70268-1141-4755-9650-fd29871330f2
Nov 06 17:15:29 devstack sudo[98898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:15:29 devstack sudo[98898]: pam_unix(sudo:session): session closed for user root
Nov 06 17:15:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-be4f0991-b2db-4c0e-97b5-d85b344ee61c tempest-TestInstancesWithCinderVolumes-52000996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b3a70268-1141-4755-9650-fd29871330f2" returned: 0 in 0.496s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:15:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-be4f0991-b2db-4c0e-97b5-d85b344ee61c tempest-TestInstancesWithCinderVolumes-52000996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b3a70268-1141-4755-9650-fd29871330f2 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:15:29 devstack sudo[98905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b3a70268-1141-4755-9650-fd29871330f2
Nov 06 17:15:29 devstack sudo[98905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:15:30 devstack sudo[98905]: pam_unix(sudo:session): session closed for user root
Nov 06 17:15:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-be4f0991-b2db-4c0e-97b5-d85b344ee61c tempest-TestInstancesWithCinderVolumes-52000996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b3a70268-1141-4755-9650-fd29871330f2" returned: 0 in 0.316s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:15:30 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-be4f0991-b2db-4c0e-97b5-d85b344ee61c tempest-TestInstancesWithCinderVolumes-52000996 None] Lock "cinder-quobyte-b3a70268-1141-4755-9650-fd29871330f2" released by "delete_volume" :: held 0.892s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:15:30 devstack cinder-volume[86856]: WARNING cinder.quota [None req-be4f0991-b2db-4c0e-97b5-d85b344ee61c tempest-TestInstancesWithCinderVolumes-52000996 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1659420826-134809075 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1659420826-134809075, it is now deprecated. Please use the default quota class for default quota.
Nov 06 17:15:30 devstack cinder-volume[86856]: WARNING cinder.quota [None req-be4f0991-b2db-4c0e-97b5-d85b344ee61c tempest-TestInstancesWithCinderVolumes-52000996 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1659420826-134809075 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1659420826-134809075, it is now deprecated. Please use the default quota class for default quota.
Nov 06 17:15:30 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-be4f0991-b2db-4c0e-97b5-d85b344ee61c tempest-TestInstancesWithCinderVolumes-52000996 None] Created reservations ['db5eef3e-71a3-411a-bce9-fc7cea6e880a', '74285022-1e05-4006-8d09-b5bb680475f3', '137f5d47-c5cb-41ea-87e4-97c3ddf41134', '4bba7721-2276-41b9-887f-b93cc0b99866'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:15:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-be4f0991-b2db-4c0e-97b5-d85b344ee61c tempest-TestInstancesWithCinderVolumes-52000996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:15:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-be4f0991-b2db-4c0e-97b5-d85b344ee61c tempest-TestInstancesWithCinderVolumes-52000996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:15:30 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-be4f0991-b2db-4c0e-97b5-d85b344ee61c tempest-TestInstancesWithCinderVolumes-52000996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:15:30 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-be4f0991-b2db-4c0e-97b5-d85b344ee61c tempest-TestInstancesWithCinderVolumes-52000996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:15:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-be4f0991-b2db-4c0e-97b5-d85b344ee61c tempest-TestInstancesWithCinderVolumes-52000996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:15:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-be4f0991-b2db-4c0e-97b5-d85b344ee61c tempest-TestInstancesWithCinderVolumes-52000996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:15:30 devstack sudo[98909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:15:30 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:15:30 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root
Nov 06 17:15:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-be4f0991-b2db-4c0e-97b5-d85b344ee61c tempest-TestInstancesWithCinderVolumes-52000996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.314s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:15:30 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-be4f0991-b2db-4c0e-97b5-d85b344ee61c tempest-TestInstancesWithCinderVolumes-52000996 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:15:30 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-be4f0991-b2db-4c0e-97b5-d85b344ee61c tempest-TestInstancesWithCinderVolumes-52000996 None] Deleted volume successfully.
Nov 06 17:15:30 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-be4f0991-b2db-4c0e-97b5-d85b344ee61c tempest-TestInstancesWithCinderVolumes-52000996 None] Lock "cinder-b3a70268-1141-4755-9650-fd29871330f2-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:15:42 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:15:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:15:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:15:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:15:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:15:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:15:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:15:42 devstack sudo[98959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:15:42 devstack sudo[98959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:15:43 devstack sudo[98959]: pam_unix(sudo:session): session closed for user root
Nov 06 17:15:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.758s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:15:43 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:15:43 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager._thread_info {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:15:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread count: 28 {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 17:15:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread info: [<_MainThread(MainThread, started 125183137599616)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125183027608256)>, <Thread(Thread-3 (stat_writer), started daemon 125183025243776)>, <Thread(Rabbit-heartbeat, started daemon 125183023512896)>, <Thread(Thread-5 (_runner), started daemon 125183023357120)>, <Thread(Thread-7 (_runner), started daemon 125183021306496)>, <Thread(fd_logger, started daemon 125183018711616)>, <Thread(privsep_reader, started daemon 125183017484224)>, <Thread(tpool_thread_0, started daemon 125183013742272)>, <Thread(tpool_thread_1, started daemon 125183005349568)>, <Thread(tpool_thread_2, started daemon 125182996956864)>, <Thread(tpool_thread_3, started daemon 125182988564160)>, <Thread(tpool_thread_4, started daemon 125182980171456)>, <Thread(tpool_thread_5, started daemon 125182971778752)>, <Thread(tpool_thread_6, started daemon 125182963386048)>, <Thread(tpool_thread_7, started daemon 125182954993344)>, <Thread(tpool_thread_8, started daemon 125182946600640)>, <Thread(tpool_thread_9, started daemon 125182938207936)>, <Thread(tpool_thread_10, started daemon 125182929815232)>, <Thread(tpool_thread_11, started daemon 125182921422528)>, <Thread(tpool_thread_12, started daemon 125182913013440)>, <Thread(tpool_thread_13, started daemon 125182904604352)>, <Thread(tpool_thread_14, started daemon 125182896195264)>, <Thread(tpool_thread_15, started daemon 125182887786176)>, <Thread(tpool_thread_16, started daemon 125182879377088)>, <Thread(tpool_thread_17, started daemon 125182870968000)>, <Thread(tpool_thread_18, started daemon 125182862558912)>, <Thread(tpool_thread_19, started daemon 125182854149824)>] {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 17:15:44 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=23,cinder:UPDATE=33,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:15:44 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:UPDATE=28,cinder:SELECT=20,cinder:INSERT=7,cinder:DELETE=4 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:15:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-1b4bc2b8-5be6-4d2a-9ddd-d06aa53e4bd4 req-4b417745-5e64-4b90-b05c-f515ff499285 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:15:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-1b4bc2b8-5be6-4d2a-9ddd-d06aa53e4bd4 req-4b417745-5e64-4b90-b05c-f515ff499285 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:15:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-1b4bc2b8-5be6-4d2a-9ddd-d06aa53e4bd4 req-4b417745-5e64-4b90-b05c-f515ff499285 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:15:56 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-1b4bc2b8-5be6-4d2a-9ddd-d06aa53e4bd4 req-4b417745-5e64-4b90-b05c-f515ff499285 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316', 'name': 'volume-4e76ba89-7aad-4f36-bec3-3025d8e9b052', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd3ab84bc-e5ae-4551-9578-1b6aa1738cd9', 'enforce_multipath': True} {{(pid=86856) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 17:15:56 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-1b4bc2b8-5be6-4d2a-9ddd-d06aa53e4bd4 req-4b417745-5e64-4b90-b05c-f515ff499285 tempest-TestServerVolumeAttachmentScenario-1965196702 None] attachment_update completed successfully.
Nov 06 17:16:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-fe798ae3-33c4-45df-9ff1-8e98dc1a1775 req-b8980a54-0982-4cb0-8617-60a257af4948 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:16:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-fe798ae3-33c4-45df-9ff1-8e98dc1a1775 req-b8980a54-0982-4cb0-8617-60a257af4948 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:16:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-fe798ae3-33c4-45df-9ff1-8e98dc1a1775 req-b8980a54-0982-4cb0-8617-60a257af4948 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:16:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-fe798ae3-33c4-45df-9ff1-8e98dc1a1775 req-b8980a54-0982-4cb0-8617-60a257af4948 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316', 'name': 'volume-f5693360-b11a-470c-a193-b4f5646f0496', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '81041ad5-12c0-423a-ac68-576af590019e', 'enforce_multipath': True} {{(pid=86856) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 17:16:02 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-fe798ae3-33c4-45df-9ff1-8e98dc1a1775 req-b8980a54-0982-4cb0-8617-60a257af4948 tempest-TestServerVolumeAttachmentScenario-1965196702 None] attachment_update completed successfully.
Nov 06 17:16:03 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-ed8406a1-3c3b-496c-b254-1dbdb7731150 req-e1e455ec-2f11-464b-9da3-30bab57a0409 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Terminate volume connection completed successfully.
Nov 06 17:16:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-ed8406a1-3c3b-496c-b254-1dbdb7731150 req-e1e455ec-2f11-464b-9da3-30bab57a0409 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Deleting attachment 81041ad5-12c0-423a-ac68-576af590019e. {{(pid=86856) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 17:16:05 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-7a94e528-ec77-4fa4-89c0-25c8c9cc0cf3 req-1a6f8fa6-4f23-421b-99fb-2b570f4e52a3 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Terminate volume connection completed successfully.
Nov 06 17:16:05 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-7a94e528-ec77-4fa4-89c0-25c8c9cc0cf3 req-1a6f8fa6-4f23-421b-99fb-2b570f4e52a3 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Deleting attachment d3ab84bc-e5ae-4551-9578-1b6aa1738cd9. {{(pid=86856) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 17:16:08 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf8583cb-c24f-4918-927b-68735c324b21 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:16:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bf8583cb-c24f-4918-927b-68735c324b21 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Flow 'volume_create_manager' (8d0e3783-db08-412a-bfae-26d3c7dbe8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:16:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bf8583cb-c24f-4918-927b-68735c324b21 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b73e61a-85e3-48ea-ba73-d436b5a3973f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bf8583cb-c24f-4918-927b-68735c324b21 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b73e61a-85e3-48ea-ba73-d436b5a3973f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-776637279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ef30585-2d76-4068-b779-d61e6d22f8d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6813e66933545fda88eb73841cb1c89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:16:08Z,use_quota=True,user_id='0e3699fd947b4d258c168a759a339213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bf8583cb-c24f-4918-927b-68735c324b21 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ad80e23-a5eb-4df1-91e8-a4972c8a4751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bf8583cb-c24f-4918-927b-68735c324b21 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ad80e23-a5eb-4df1-91e8-a4972c8a4751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bf8583cb-c24f-4918-927b-68735c324b21 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24203a9b-dc1e-40eb-8341-0d4cc689ec2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bf8583cb-c24f-4918-927b-68735c324b21 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24203a9b-dc1e-40eb-8341-0d4cc689ec2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ef30585-2d76-4068-b779-d61e6d22f8d5', 'volume_name': 'volume-8ef30585-2d76-4068-b779-d61e6d22f8d5', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bf8583cb-c24f-4918-927b-68735c324b21 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61fbce47-ba5b-4541-bd6f-dec72cbd6c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bf8583cb-c24f-4918-927b-68735c324b21 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61fbce47-ba5b-4541-bd6f-dec72cbd6c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bf8583cb-c24f-4918-927b-68735c324b21 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aefa6fb-f1ec-49f7-9d07-f8c2e794f776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:08 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-bf8583cb-c24f-4918-927b-68735c324b21 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Volume 8ef30585-2d76-4068-b779-d61e6d22f8d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ef30585-2d76-4068-b779-d61e6d22f8d5', 'volume_size': 1}
Nov 06 17:16:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bf8583cb-c24f-4918-927b-68735c324b21 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:16:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bf8583cb-c24f-4918-927b-68735c324b21 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:16:08 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bf8583cb-c24f-4918-927b-68735c324b21 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-776637279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ef30585-2d76-4068-b779-d61e6d22f8d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6813e66933545fda88eb73841cb1c89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:16:08Z,use_quota=True,user_id='0e3699fd947b4d258c168a759a339213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:16:08 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-bf8583cb-c24f-4918-927b-68735c324b21 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Creating volume 8ef30585-2d76-4068-b779-d61e6d22f8d5 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:16:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bf8583cb-c24f-4918-927b-68735c324b21 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:16:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bf8583cb-c24f-4918-927b-68735c324b21 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:16:08 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bf8583cb-c24f-4918-927b-68735c324b21 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:16:08 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bf8583cb-c24f-4918-927b-68735c324b21 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:16:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bf8583cb-c24f-4918-927b-68735c324b21 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:16:08 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bf8583cb-c24f-4918-927b-68735c324b21 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:16:08 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-bf8583cb-c24f-4918-927b-68735c324b21 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:16:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bf8583cb-c24f-4918-927b-68735c324b21 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8ef30585-2d76-4068-b779-d61e6d22f8d5 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:08 devstack sudo[99607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8ef30585-2d76-4068-b779-d61e6d22f8d5 1073741824
Nov 06 17:16:08 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:08 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bf8583cb-c24f-4918-927b-68735c324b21 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8ef30585-2d76-4068-b779-d61e6d22f8d5 1073741824" returned: 0 in 0.765s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bf8583cb-c24f-4918-927b-68735c324b21 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8ef30585-2d76-4068-b779-d61e6d22f8d5 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:09 devstack sudo[99613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8ef30585-2d76-4068-b779-d61e6d22f8d5
Nov 06 17:16:09 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:09 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bf8583cb-c24f-4918-927b-68735c324b21 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8ef30585-2d76-4068-b779-d61e6d22f8d5" returned: 0 in 0.333s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:09 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bf8583cb-c24f-4918-927b-68735c324b21 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:16:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bf8583cb-c24f-4918-927b-68735c324b21 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:16:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bf8583cb-c24f-4918-927b-68735c324b21 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aefa6fb-f1ec-49f7-9d07-f8c2e794f776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ef30585-2d76-4068-b779-d61e6d22f8d5', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bf8583cb-c24f-4918-927b-68735c324b21 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8700b552-b793-443e-b20b-d90ebad9fac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:09 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-bf8583cb-c24f-4918-927b-68735c324b21 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Volume volume-8ef30585-2d76-4068-b779-d61e6d22f8d5 (8ef30585-2d76-4068-b779-d61e6d22f8d5): created successfully
Nov 06 17:16:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bf8583cb-c24f-4918-927b-68735c324b21 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8700b552-b793-443e-b20b-d90ebad9fac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bf8583cb-c24f-4918-927b-68735c324b21 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Flow 'volume_create_manager' (8d0e3783-db08-412a-bfae-26d3c7dbe8bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:16:09 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-bf8583cb-c24f-4918-927b-68735c324b21 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Created volume successfully.
Nov 06 17:16:10 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-50f54d4b-6c6b-417c-b815-198a083731b0 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Acquiring lock "cinder-f5693360-b11a-470c-a193-b4f5646f0496-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:16:10 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-50f54d4b-6c6b-417c-b815-198a083731b0 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Lock "cinder-f5693360-b11a-470c-a193-b4f5646f0496-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:16:10 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-50f54d4b-6c6b-417c-b815-198a083731b0 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Acquiring lock "cinder-quobyte-f5693360-b11a-470c-a193-b4f5646f0496" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:16:10 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-50f54d4b-6c6b-417c-b815-198a083731b0 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Lock "cinder-quobyte-f5693360-b11a-470c-a193-b4f5646f0496" acquired by "delete_volume" :: waited 0.035s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:16:10 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bf4aaa-bad6-4d00-bc49-1aa71691aac2]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:16:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-50f54d4b-6c6b-417c-b815-198a083731b0 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f5693360-b11a-470c-a193-b4f5646f0496 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:10 devstack sudo[99620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f5693360-b11a-470c-a193-b4f5646f0496
Nov 06 17:16:10 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-9677411d-7ea9-482d-a71a-3aa0b6401861 req-7ab07186-2284-41c4-bc9a-b812f638c865 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:16:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-9677411d-7ea9-482d-a71a-3aa0b6401861 req-7ab07186-2284-41c4-bc9a-b812f638c865 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:16:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-9677411d-7ea9-482d-a71a-3aa0b6401861 req-7ab07186-2284-41c4-bc9a-b812f638c865 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:16:11 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-50f54d4b-6c6b-417c-b815-198a083731b0 tempest-TestServerVolumeAttachmentScenario-1965196702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f5693360-b11a-470c-a193-b4f5646f0496" returned: 0 in 0.413s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-50f54d4b-6c6b-417c-b815-198a083731b0 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f5693360-b11a-470c-a193-b4f5646f0496 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:11 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-9677411d-7ea9-482d-a71a-3aa0b6401861 req-7ab07186-2284-41c4-bc9a-b812f638c865 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316', 'name': 'volume-8ef30585-2d76-4068-b779-d61e6d22f8d5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd0656a58-e7ac-4c5f-8678-f0e4ffcc03fd', 'enforce_multipath': True} {{(pid=86856) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 17:16:11 devstack sudo[99633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f5693360-b11a-470c-a193-b4f5646f0496
Nov 06 17:16:11 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:11 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-9677411d-7ea9-482d-a71a-3aa0b6401861 req-7ab07186-2284-41c4-bc9a-b812f638c865 tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] attachment_update completed successfully.
Nov 06 17:16:11 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-50f54d4b-6c6b-417c-b815-198a083731b0 tempest-TestServerVolumeAttachmentScenario-1965196702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f5693360-b11a-470c-a193-b4f5646f0496" returned: 0 in 0.297s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-50f54d4b-6c6b-417c-b815-198a083731b0 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Lock "cinder-quobyte-f5693360-b11a-470c-a193-b4f5646f0496" released by "delete_volume" :: held 0.769s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:16:11 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-50f54d4b-6c6b-417c-b815-198a083731b0 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Created reservations ['2efd152c-bb2d-43a1-91e0-3d77c3220d7c', '7562efee-936f-40bb-b89f-30b15d396a9b', 'c6a90ef2-915f-4b00-99ed-2fb91e2085a2', '9837554e-eead-4c2d-b219-f867db7cd08b'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:16:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-50f54d4b-6c6b-417c-b815-198a083731b0 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:16:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-50f54d4b-6c6b-417c-b815-198a083731b0 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:16:11 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-50f54d4b-6c6b-417c-b815-198a083731b0 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:16:11 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-50f54d4b-6c6b-417c-b815-198a083731b0 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:16:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-50f54d4b-6c6b-417c-b815-198a083731b0 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:16:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-50f54d4b-6c6b-417c-b815-198a083731b0 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:11 devstack sudo[99768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:16:11 devstack sudo[99768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9e5af083-32a2-4ff5-8462-202942cc5c8f tempest-TestServerVolumeAttachmentScenario-1965196702 None] Acquiring lock "cinder-4e76ba89-7aad-4f36-bec3-3025d8e9b052-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:16:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9e5af083-32a2-4ff5-8462-202942cc5c8f tempest-TestServerVolumeAttachmentScenario-1965196702 None] Lock "cinder-4e76ba89-7aad-4f36-bec3-3025d8e9b052-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:16:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9e5af083-32a2-4ff5-8462-202942cc5c8f tempest-TestServerVolumeAttachmentScenario-1965196702 None] Acquiring lock "cinder-quobyte-4e76ba89-7aad-4f36-bec3-3025d8e9b052" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:16:12 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9e5af083-32a2-4ff5-8462-202942cc5c8f tempest-TestServerVolumeAttachmentScenario-1965196702 None] Lock "cinder-quobyte-4e76ba89-7aad-4f36-bec3-3025d8e9b052" acquired by "delete_volume" :: waited 0.033s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:16:12 devstack sudo[99768]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-50f54d4b-6c6b-417c-b815-198a083731b0 tempest-TestServerVolumeAttachmentScenario-1965196702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.405s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:12 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-50f54d4b-6c6b-417c-b815-198a083731b0 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:16:12 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-50f54d4b-6c6b-417c-b815-198a083731b0 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Deleted volume successfully.
Nov 06 17:16:12 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28ce950-adc4-40e8-90d9-1a264219a21c]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:16:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9e5af083-32a2-4ff5-8462-202942cc5c8f tempest-TestServerVolumeAttachmentScenario-1965196702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-4e76ba89-7aad-4f36-bec3-3025d8e9b052 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:12 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-50f54d4b-6c6b-417c-b815-198a083731b0 tempest-TestServerVolumeAttachmentScenario-1965196702 None] Lock "cinder-f5693360-b11a-470c-a193-b4f5646f0496-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:16:12 devstack sudo[100055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-4e76ba89-7aad-4f36-bec3-3025d8e9b052
Nov 06 17:16:12 devstack sudo[100055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:12 devstack sudo[100055]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9e5af083-32a2-4ff5-8462-202942cc5c8f tempest-TestServerVolumeAttachmentScenario-1965196702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-4e76ba89-7aad-4f36-bec3-3025d8e9b052" returned: 0 in 0.423s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9e5af083-32a2-4ff5-8462-202942cc5c8f tempest-TestServerVolumeAttachmentScenario-1965196702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-4e76ba89-7aad-4f36-bec3-3025d8e9b052 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:12 devstack sudo[100060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-4e76ba89-7aad-4f36-bec3-3025d8e9b052
Nov 06 17:16:12 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:12 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9e5af083-32a2-4ff5-8462-202942cc5c8f tempest-TestServerVolumeAttachmentScenario-1965196702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-4e76ba89-7aad-4f36-bec3-3025d8e9b052" returned: 0 in 0.248s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:12 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9e5af083-32a2-4ff5-8462-202942cc5c8f tempest-TestServerVolumeAttachmentScenario-1965196702 None] Lock "cinder-quobyte-4e76ba89-7aad-4f36-bec3-3025d8e9b052" released by "delete_volume" :: held 0.772s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:16:12 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-9e5af083-32a2-4ff5-8462-202942cc5c8f tempest-TestServerVolumeAttachmentScenario-1965196702 None] Created reservations ['ef7048c4-2bc8-4cf1-bd02-1a78bce1633c', 'f927aa92-9f0c-4351-b525-d05439aa7b18', '4b7f17dc-086e-415f-b76e-55d504288e33', '20527975-c94e-4d91-a796-59390cc1e8ba'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:16:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9e5af083-32a2-4ff5-8462-202942cc5c8f tempest-TestServerVolumeAttachmentScenario-1965196702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:16:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9e5af083-32a2-4ff5-8462-202942cc5c8f tempest-TestServerVolumeAttachmentScenario-1965196702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:16:12 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-9e5af083-32a2-4ff5-8462-202942cc5c8f tempest-TestServerVolumeAttachmentScenario-1965196702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:16:12 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-9e5af083-32a2-4ff5-8462-202942cc5c8f tempest-TestServerVolumeAttachmentScenario-1965196702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:16:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9e5af083-32a2-4ff5-8462-202942cc5c8f tempest-TestServerVolumeAttachmentScenario-1965196702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:16:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9e5af083-32a2-4ff5-8462-202942cc5c8f tempest-TestServerVolumeAttachmentScenario-1965196702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:12 devstack sudo[100063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:16:12 devstack sudo[100063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:13 devstack sudo[100063]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9e5af083-32a2-4ff5-8462-202942cc5c8f tempest-TestServerVolumeAttachmentScenario-1965196702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.447s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:13 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-9e5af083-32a2-4ff5-8462-202942cc5c8f tempest-TestServerVolumeAttachmentScenario-1965196702 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:16:13 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-9e5af083-32a2-4ff5-8462-202942cc5c8f tempest-TestServerVolumeAttachmentScenario-1965196702 None] Deleted volume successfully.
Nov 06 17:16:13 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9e5af083-32a2-4ff5-8462-202942cc5c8f tempest-TestServerVolumeAttachmentScenario-1965196702 None] Lock "cinder-4e76ba89-7aad-4f36-bec3-3025d8e9b052-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:16:14 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-6783c437-e717-4801-8bbe-fa169e2f5654 req-907e3acb-68c8-4e65-81f3-60b86ad4adcc tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Terminate volume connection completed successfully.
Nov 06 17:16:14 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-6783c437-e717-4801-8bbe-fa169e2f5654 req-907e3acb-68c8-4e65-81f3-60b86ad4adcc tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Deleting attachment d0656a58-e7ac-4c5f-8678-f0e4ffcc03fd. {{(pid=86856) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 17:16:15 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-260c3144-7db8-446c-b6a4-353a9e83616e tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Acquiring lock "cinder-8ef30585-2d76-4068-b779-d61e6d22f8d5-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:16:15 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-260c3144-7db8-446c-b6a4-353a9e83616e tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Lock "cinder-8ef30585-2d76-4068-b779-d61e6d22f8d5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:16:15 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-260c3144-7db8-446c-b6a4-353a9e83616e tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Acquiring lock "cinder-quobyte-8ef30585-2d76-4068-b779-d61e6d22f8d5" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:16:15 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-260c3144-7db8-446c-b6a4-353a9e83616e tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Lock "cinder-quobyte-8ef30585-2d76-4068-b779-d61e6d22f8d5" acquired by "delete_volume" :: waited 0.021s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:16:15 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a842390-4efa-4b69-bfaf-91da3cedb4d8]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:16:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-260c3144-7db8-446c-b6a4-353a9e83616e tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8ef30585-2d76-4068-b779-d61e6d22f8d5 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:15 devstack sudo[100096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8ef30585-2d76-4068-b779-d61e6d22f8d5
Nov 06 17:16:15 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:16 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-260c3144-7db8-446c-b6a4-353a9e83616e tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8ef30585-2d76-4068-b779-d61e6d22f8d5" returned: 0 in 0.438s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-260c3144-7db8-446c-b6a4-353a9e83616e tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8ef30585-2d76-4068-b779-d61e6d22f8d5 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:16 devstack sudo[100114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8ef30585-2d76-4068-b779-d61e6d22f8d5
Nov 06 17:16:16 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:16 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-260c3144-7db8-446c-b6a4-353a9e83616e tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8ef30585-2d76-4068-b779-d61e6d22f8d5" returned: 0 in 0.341s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:16 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-260c3144-7db8-446c-b6a4-353a9e83616e tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Lock "cinder-quobyte-8ef30585-2d76-4068-b779-d61e6d22f8d5" released by "delete_volume" :: held 0.847s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:16:16 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-260c3144-7db8-446c-b6a4-353a9e83616e tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Created reservations ['ad629db2-e819-45a0-8785-3c9923c2452d', '557568e8-5df8-4eb2-b0db-8156e9c7d8e4', 'dfa3ce07-5483-451e-8ce1-856e6fd4e933', '84ae5349-2883-4fde-a3c1-1a8dd6f14f01'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:16:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-260c3144-7db8-446c-b6a4-353a9e83616e tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:16:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-260c3144-7db8-446c-b6a4-353a9e83616e tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:16:16 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-260c3144-7db8-446c-b6a4-353a9e83616e tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:16:16 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-260c3144-7db8-446c-b6a4-353a9e83616e tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:16:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-260c3144-7db8-446c-b6a4-353a9e83616e tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:16:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-260c3144-7db8-446c-b6a4-353a9e83616e tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:16 devstack sudo[100124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:16:16 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:17 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-260c3144-7db8-446c-b6a4-353a9e83616e tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.361s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:17 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-260c3144-7db8-446c-b6a4-353a9e83616e tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:16:17 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-260c3144-7db8-446c-b6a4-353a9e83616e tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Deleted volume successfully.
Nov 06 17:16:17 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-260c3144-7db8-446c-b6a4-353a9e83616e tempest-TestServerVolumeAttachScenarioOldVersion-1637941517 None] Lock "cinder-8ef30585-2d76-4068-b779-d61e6d22f8d5-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:16:26 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=42,cinder:UPDATE=39,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:16:27 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=37,cinder:UPDATE=24,cinder:INSERT=7,cinder:DELETE=3 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:16:27 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-075f0b53-e61d-413c-be80-fd40e2051607 tempest-TestMinimumBasicScenario-906141890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:16:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-075f0b53-e61d-413c-be80-fd40e2051607 tempest-TestMinimumBasicScenario-906141890 None] Flow 'volume_create_manager' (59efad9c-7fff-4510-9674-eb608943625d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:16:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-075f0b53-e61d-413c-be80-fd40e2051607 tempest-TestMinimumBasicScenario-906141890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c443ea49-8513-4008-97fc-0732e1c54baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-075f0b53-e61d-413c-be80-fd40e2051607 tempest-TestMinimumBasicScenario-906141890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c443ea49-8513-4008-97fc-0732e1c54baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:16:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2047055045',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fa71296-b234-403a-afe7-20c6a009567f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66872b7102d74db08287e14bd058cda5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:16:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:16:28Z,use_quota=True,user_id='805678faa7f04c60b0711aeeb4951af4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-075f0b53-e61d-413c-be80-fd40e2051607 tempest-TestMinimumBasicScenario-906141890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a7bd453-ef58-46eb-aa5f-3655bb07102f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-075f0b53-e61d-413c-be80-fd40e2051607 tempest-TestMinimumBasicScenario-906141890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a7bd453-ef58-46eb-aa5f-3655bb07102f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-075f0b53-e61d-413c-be80-fd40e2051607 tempest-TestMinimumBasicScenario-906141890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8377d106-ea81-44ca-9925-e76d01833221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-075f0b53-e61d-413c-be80-fd40e2051607 tempest-TestMinimumBasicScenario-906141890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8377d106-ea81-44ca-9925-e76d01833221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fa71296-b234-403a-afe7-20c6a009567f', 'volume_name': 'volume-9fa71296-b234-403a-afe7-20c6a009567f', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-075f0b53-e61d-413c-be80-fd40e2051607 tempest-TestMinimumBasicScenario-906141890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0e948a0-1c28-4f77-bcd2-cb3b914bf730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-075f0b53-e61d-413c-be80-fd40e2051607 tempest-TestMinimumBasicScenario-906141890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0e948a0-1c28-4f77-bcd2-cb3b914bf730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-075f0b53-e61d-413c-be80-fd40e2051607 tempest-TestMinimumBasicScenario-906141890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b34a75-e01f-4f35-9d14-d023658d845c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:27 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-075f0b53-e61d-413c-be80-fd40e2051607 tempest-TestMinimumBasicScenario-906141890 None] Volume 9fa71296-b234-403a-afe7-20c6a009567f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fa71296-b234-403a-afe7-20c6a009567f', 'volume_size': 1}
Nov 06 17:16:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-075f0b53-e61d-413c-be80-fd40e2051607 tempest-TestMinimumBasicScenario-906141890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:16:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-075f0b53-e61d-413c-be80-fd40e2051607 tempest-TestMinimumBasicScenario-906141890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:16:27 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-075f0b53-e61d-413c-be80-fd40e2051607 tempest-TestMinimumBasicScenario-906141890 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:16:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2047055045',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fa71296-b234-403a-afe7-20c6a009567f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66872b7102d74db08287e14bd058cda5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:16:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:16:28Z,use_quota=True,user_id='805678faa7f04c60b0711aeeb4951af4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:16:27 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-075f0b53-e61d-413c-be80-fd40e2051607 tempest-TestMinimumBasicScenario-906141890 None] Creating volume 9fa71296-b234-403a-afe7-20c6a009567f {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:16:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-075f0b53-e61d-413c-be80-fd40e2051607 tempest-TestMinimumBasicScenario-906141890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:16:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-075f0b53-e61d-413c-be80-fd40e2051607 tempest-TestMinimumBasicScenario-906141890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:16:27 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-075f0b53-e61d-413c-be80-fd40e2051607 tempest-TestMinimumBasicScenario-906141890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:16:27 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-075f0b53-e61d-413c-be80-fd40e2051607 tempest-TestMinimumBasicScenario-906141890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:16:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-075f0b53-e61d-413c-be80-fd40e2051607 tempest-TestMinimumBasicScenario-906141890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:16:27 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-075f0b53-e61d-413c-be80-fd40e2051607 tempest-TestMinimumBasicScenario-906141890 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:16:27 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-075f0b53-e61d-413c-be80-fd40e2051607 tempest-TestMinimumBasicScenario-906141890 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:16:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-075f0b53-e61d-413c-be80-fd40e2051607 tempest-TestMinimumBasicScenario-906141890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9fa71296-b234-403a-afe7-20c6a009567f 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:27 devstack sudo[100237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9fa71296-b234-403a-afe7-20c6a009567f 1073741824
Nov 06 17:16:27 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:28 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-075f0b53-e61d-413c-be80-fd40e2051607 tempest-TestMinimumBasicScenario-906141890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9fa71296-b234-403a-afe7-20c6a009567f 1073741824" returned: 0 in 0.734s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-075f0b53-e61d-413c-be80-fd40e2051607 tempest-TestMinimumBasicScenario-906141890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9fa71296-b234-403a-afe7-20c6a009567f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:28 devstack sudo[100243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9fa71296-b234-403a-afe7-20c6a009567f
Nov 06 17:16:28 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:29 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-075f0b53-e61d-413c-be80-fd40e2051607 tempest-TestMinimumBasicScenario-906141890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9fa71296-b234-403a-afe7-20c6a009567f" returned: 0 in 0.345s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:29 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-075f0b53-e61d-413c-be80-fd40e2051607 tempest-TestMinimumBasicScenario-906141890 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:16:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-075f0b53-e61d-413c-be80-fd40e2051607 tempest-TestMinimumBasicScenario-906141890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:16:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-075f0b53-e61d-413c-be80-fd40e2051607 tempest-TestMinimumBasicScenario-906141890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b34a75-e01f-4f35-9d14-d023658d845c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fa71296-b234-403a-afe7-20c6a009567f', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-075f0b53-e61d-413c-be80-fd40e2051607 tempest-TestMinimumBasicScenario-906141890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d47514be-5d32-47a1-8eb1-569a6c617a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:29 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-075f0b53-e61d-413c-be80-fd40e2051607 tempest-TestMinimumBasicScenario-906141890 None] Volume volume-9fa71296-b234-403a-afe7-20c6a009567f (9fa71296-b234-403a-afe7-20c6a009567f): created successfully
Nov 06 17:16:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-075f0b53-e61d-413c-be80-fd40e2051607 tempest-TestMinimumBasicScenario-906141890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d47514be-5d32-47a1-8eb1-569a6c617a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-075f0b53-e61d-413c-be80-fd40e2051607 tempest-TestMinimumBasicScenario-906141890 None] Flow 'volume_create_manager' (59efad9c-7fff-4510-9674-eb608943625d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:16:29 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-075f0b53-e61d-413c-be80-fd40e2051607 tempest-TestMinimumBasicScenario-906141890 None] Created volume successfully.
Nov 06 17:16:30 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-9752ab3c-e47f-459f-9bc0-9eac2e3c911a tempest-CreateVolumesFromImageTest-1557845107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:16:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9752ab3c-e47f-459f-9bc0-9eac2e3c911a tempest-CreateVolumesFromImageTest-1557845107 None] Flow 'volume_create_manager' (42a137fd-61e1-412a-88cc-19289b1a0933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:16:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9752ab3c-e47f-459f-9bc0-9eac2e3c911a tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac316c10-09e9-4bb1-8626-fbce4e9ce357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9752ab3c-e47f-459f-9bc0-9eac2e3c911a tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac316c10-09e9-4bb1-8626-fbce4e9ce357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-392650410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=421346ec-66a0-4cef-86b9-1a77369c6160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a30919d92fe43febb48ac550a8a3083',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:16:31Z,use_quota=True,user_id='11fd6ce21c77487faf9c7599bd9ae3cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9752ab3c-e47f-459f-9bc0-9eac2e3c911a tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7812883-6b3c-49d7-98ce-81cfb83310e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9752ab3c-e47f-459f-9bc0-9eac2e3c911a tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7812883-6b3c-49d7-98ce-81cfb83310e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9752ab3c-e47f-459f-9bc0-9eac2e3c911a tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a33e2231-dcf7-4dd5-8b6d-c4fa554971d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9752ab3c-e47f-459f-9bc0-9eac2e3c911a tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a33e2231-dcf7-4dd5-8b6d-c4fa554971d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '421346ec-66a0-4cef-86b9-1a77369c6160', 'volume_name': 'volume-421346ec-66a0-4cef-86b9-1a77369c6160', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9752ab3c-e47f-459f-9bc0-9eac2e3c911a tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c9733ef-6761-4a13-8d0b-feafebe13367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9752ab3c-e47f-459f-9bc0-9eac2e3c911a tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c9733ef-6761-4a13-8d0b-feafebe13367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9752ab3c-e47f-459f-9bc0-9eac2e3c911a tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (153f27fc-2ac3-4604-a947-0da57d695209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:31 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-9752ab3c-e47f-459f-9bc0-9eac2e3c911a tempest-CreateVolumesFromImageTest-1557845107 None] Volume 421346ec-66a0-4cef-86b9-1a77369c6160: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-421346ec-66a0-4cef-86b9-1a77369c6160', 'volume_size': 1}
Nov 06 17:16:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9752ab3c-e47f-459f-9bc0-9eac2e3c911a tempest-CreateVolumesFromImageTest-1557845107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:16:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9752ab3c-e47f-459f-9bc0-9eac2e3c911a tempest-CreateVolumesFromImageTest-1557845107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:16:31 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-9752ab3c-e47f-459f-9bc0-9eac2e3c911a tempest-CreateVolumesFromImageTest-1557845107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-392650410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=421346ec-66a0-4cef-86b9-1a77369c6160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a30919d92fe43febb48ac550a8a3083',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:16:31Z,use_quota=True,user_id='11fd6ce21c77487faf9c7599bd9ae3cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:16:31 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-9752ab3c-e47f-459f-9bc0-9eac2e3c911a tempest-CreateVolumesFromImageTest-1557845107 None] Creating volume 421346ec-66a0-4cef-86b9-1a77369c6160 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:16:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9752ab3c-e47f-459f-9bc0-9eac2e3c911a tempest-CreateVolumesFromImageTest-1557845107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:16:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9752ab3c-e47f-459f-9bc0-9eac2e3c911a tempest-CreateVolumesFromImageTest-1557845107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:16:31 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-9752ab3c-e47f-459f-9bc0-9eac2e3c911a tempest-CreateVolumesFromImageTest-1557845107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:16:31 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-9752ab3c-e47f-459f-9bc0-9eac2e3c911a tempest-CreateVolumesFromImageTest-1557845107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:16:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9752ab3c-e47f-459f-9bc0-9eac2e3c911a tempest-CreateVolumesFromImageTest-1557845107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:16:31 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-9752ab3c-e47f-459f-9bc0-9eac2e3c911a tempest-CreateVolumesFromImageTest-1557845107 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:16:31 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-9752ab3c-e47f-459f-9bc0-9eac2e3c911a tempest-CreateVolumesFromImageTest-1557845107 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:16:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9752ab3c-e47f-459f-9bc0-9eac2e3c911a tempest-CreateVolumesFromImageTest-1557845107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-421346ec-66a0-4cef-86b9-1a77369c6160 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:31 devstack sudo[100257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-421346ec-66a0-4cef-86b9-1a77369c6160 1073741824
Nov 06 17:16:31 devstack sudo[100257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:31 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-85700bb3-0877-4648-8564-397eb7dc40fc tempest-CreateVolumesFromImageTest-1557845107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:16:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-85700bb3-0877-4648-8564-397eb7dc40fc tempest-CreateVolumesFromImageTest-1557845107 None] Flow 'volume_create_manager' (30741884-991f-4dc1-9edc-649f7824c020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:16:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-85700bb3-0877-4648-8564-397eb7dc40fc tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4c2415a-4915-4e08-9162-b34f326e72b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-85700bb3-0877-4648-8564-397eb7dc40fc tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4c2415a-4915-4e08-9162-b34f326e72b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1268715950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1580489-6cbe-4370-9192-c0c0382223d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a30919d92fe43febb48ac550a8a3083',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:16:31Z,use_quota=True,user_id='11fd6ce21c77487faf9c7599bd9ae3cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-85700bb3-0877-4648-8564-397eb7dc40fc tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f572483b-67ca-469c-a2b3-3158bc69fcb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-85700bb3-0877-4648-8564-397eb7dc40fc tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f572483b-67ca-469c-a2b3-3158bc69fcb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-85700bb3-0877-4648-8564-397eb7dc40fc tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dee10a5-1b1a-4d46-806d-029e2dd285f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-85700bb3-0877-4648-8564-397eb7dc40fc tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dee10a5-1b1a-4d46-806d-029e2dd285f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1580489-6cbe-4370-9192-c0c0382223d6', 'volume_name': 'volume-e1580489-6cbe-4370-9192-c0c0382223d6', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-85700bb3-0877-4648-8564-397eb7dc40fc tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5da183cc-99a0-402c-8a5c-cdaeba6ea4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-85700bb3-0877-4648-8564-397eb7dc40fc tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5da183cc-99a0-402c-8a5c-cdaeba6ea4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-85700bb3-0877-4648-8564-397eb7dc40fc tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e630b5c-690e-42ff-a419-175152950680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:31 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-85700bb3-0877-4648-8564-397eb7dc40fc tempest-CreateVolumesFromImageTest-1557845107 None] Volume e1580489-6cbe-4370-9192-c0c0382223d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1580489-6cbe-4370-9192-c0c0382223d6', 'volume_size': 1}
Nov 06 17:16:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-85700bb3-0877-4648-8564-397eb7dc40fc tempest-CreateVolumesFromImageTest-1557845107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:16:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-8a9f1485-4c09-4ced-92b4-44e3229353b5 req-c37de2af-abfb-4563-8fcc-d030973fd01e tempest-TestMinimumBasicScenario-906141890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:16:31 devstack sudo[100257]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9752ab3c-e47f-459f-9bc0-9eac2e3c911a tempest-CreateVolumesFromImageTest-1557845107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-421346ec-66a0-4cef-86b9-1a77369c6160 1073741824" returned: 0 in 0.753s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9752ab3c-e47f-459f-9bc0-9eac2e3c911a tempest-CreateVolumesFromImageTest-1557845107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-421346ec-66a0-4cef-86b9-1a77369c6160 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:32 devstack sudo[100267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-421346ec-66a0-4cef-86b9-1a77369c6160
Nov 06 17:16:32 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-94411f54-6d02-4be0-914a-4965bcc299ba tempest-CreateVolumesFromImageTest-1557845107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-94411f54-6d02-4be0-914a-4965bcc299ba tempest-CreateVolumesFromImageTest-1557845107 None] Flow 'volume_create_manager' (e9e91660-f1c2-423c-a892-5416cf8d544d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-94411f54-6d02-4be0-914a-4965bcc299ba tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cad0f55-caa9-4ca6-866e-5c8c485bfdb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-94411f54-6d02-4be0-914a-4965bcc299ba tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cad0f55-caa9-4ca6-866e-5c8c485bfdb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-355287394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6038b703-89fa-4df1-a7cc-7b6797217b6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a30919d92fe43febb48ac550a8a3083',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:16:32Z,use_quota=True,user_id='11fd6ce21c77487faf9c7599bd9ae3cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-94411f54-6d02-4be0-914a-4965bcc299ba tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f321b0a-ce96-4690-82fe-ba7454ecc870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-94411f54-6d02-4be0-914a-4965bcc299ba tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f321b0a-ce96-4690-82fe-ba7454ecc870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-94411f54-6d02-4be0-914a-4965bcc299ba tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (864dc937-7d0b-493b-95e8-04119852d887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-94411f54-6d02-4be0-914a-4965bcc299ba tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (864dc937-7d0b-493b-95e8-04119852d887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6038b703-89fa-4df1-a7cc-7b6797217b6e', 'volume_name': 'volume-6038b703-89fa-4df1-a7cc-7b6797217b6e', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-94411f54-6d02-4be0-914a-4965bcc299ba tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b299f90b-3a44-450c-9924-aa3a82a52210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:32 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-94411f54-6d02-4be0-914a-4965bcc299ba tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b299f90b-3a44-450c-9924-aa3a82a52210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-94411f54-6d02-4be0-914a-4965bcc299ba tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ee3d256-2613-4e4f-a569-1d479d3b5aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:32 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-94411f54-6d02-4be0-914a-4965bcc299ba tempest-CreateVolumesFromImageTest-1557845107 None] Volume 6038b703-89fa-4df1-a7cc-7b6797217b6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6038b703-89fa-4df1-a7cc-7b6797217b6e', 'volume_size': 1}
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-94411f54-6d02-4be0-914a-4965bcc299ba tempest-CreateVolumesFromImageTest-1557845107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9752ab3c-e47f-459f-9bc0-9eac2e3c911a tempest-CreateVolumesFromImageTest-1557845107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-421346ec-66a0-4cef-86b9-1a77369c6160" returned: 0 in 0.504s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-9752ab3c-e47f-459f-9bc0-9eac2e3c911a tempest-CreateVolumesFromImageTest-1557845107 None] <== create_volume: return (1330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9752ab3c-e47f-459f-9bc0-9eac2e3c911a tempest-CreateVolumesFromImageTest-1557845107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-85700bb3-0877-4648-8564-397eb7dc40fc tempest-CreateVolumesFromImageTest-1557845107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.850s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-85700bb3-0877-4648-8564-397eb7dc40fc tempest-CreateVolumesFromImageTest-1557845107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1268715950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1580489-6cbe-4370-9192-c0c0382223d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a30919d92fe43febb48ac550a8a3083',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:16:31Z,use_quota=True,user_id='11fd6ce21c77487faf9c7599bd9ae3cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-85700bb3-0877-4648-8564-397eb7dc40fc tempest-CreateVolumesFromImageTest-1557845107 None] Creating volume e1580489-6cbe-4370-9192-c0c0382223d6 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-85700bb3-0877-4648-8564-397eb7dc40fc tempest-CreateVolumesFromImageTest-1557845107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-85700bb3-0877-4648-8564-397eb7dc40fc tempest-CreateVolumesFromImageTest-1557845107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-85700bb3-0877-4648-8564-397eb7dc40fc tempest-CreateVolumesFromImageTest-1557845107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-85700bb3-0877-4648-8564-397eb7dc40fc tempest-CreateVolumesFromImageTest-1557845107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-85700bb3-0877-4648-8564-397eb7dc40fc tempest-CreateVolumesFromImageTest-1557845107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-85700bb3-0877-4648-8564-397eb7dc40fc tempest-CreateVolumesFromImageTest-1557845107 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:16:32 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-85700bb3-0877-4648-8564-397eb7dc40fc tempest-CreateVolumesFromImageTest-1557845107 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-85700bb3-0877-4648-8564-397eb7dc40fc tempest-CreateVolumesFromImageTest-1557845107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e1580489-6cbe-4370-9192-c0c0382223d6 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9752ab3c-e47f-459f-9bc0-9eac2e3c911a tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (153f27fc-2ac3-4604-a947-0da57d695209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-421346ec-66a0-4cef-86b9-1a77369c6160', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9752ab3c-e47f-459f-9bc0-9eac2e3c911a tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbeeca34-63d8-43d4-987b-a6a490dd8bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:32 devstack sudo[100270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e1580489-6cbe-4370-9192-c0c0382223d6 1073741824
Nov 06 17:16:32 devstack sudo[100270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:32 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-9752ab3c-e47f-459f-9bc0-9eac2e3c911a tempest-CreateVolumesFromImageTest-1557845107 None] Volume volume-421346ec-66a0-4cef-86b9-1a77369c6160 (421346ec-66a0-4cef-86b9-1a77369c6160): created successfully
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9752ab3c-e47f-459f-9bc0-9eac2e3c911a tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbeeca34-63d8-43d4-987b-a6a490dd8bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9752ab3c-e47f-459f-9bc0-9eac2e3c911a tempest-CreateVolumesFromImageTest-1557845107 None] Flow 'volume_create_manager' (42a137fd-61e1-412a-88cc-19289b1a0933) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:16:32 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-9752ab3c-e47f-459f-9bc0-9eac2e3c911a tempest-CreateVolumesFromImageTest-1557845107 None] Created volume successfully.
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd913e72-d9b1-4aed-a92b-1d8b9431ad10 tempest-CreateVolumesFromImageTest-1557845107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cd913e72-d9b1-4aed-a92b-1d8b9431ad10 tempest-CreateVolumesFromImageTest-1557845107 None] Flow 'volume_create_manager' (6a6082be-b981-4768-816d-27d5e46ee40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cd913e72-d9b1-4aed-a92b-1d8b9431ad10 tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c569518-041a-4224-bc34-d5a65211f6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cd913e72-d9b1-4aed-a92b-1d8b9431ad10 tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c569518-041a-4224-bc34-d5a65211f6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-816270620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488ef897-afba-4e82-b6e7-cec4bcd2491e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a30919d92fe43febb48ac550a8a3083',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:16:33Z,use_quota=True,user_id='11fd6ce21c77487faf9c7599bd9ae3cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cd913e72-d9b1-4aed-a92b-1d8b9431ad10 tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e867d4-3314-4549-8a13-0b00142ddf78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cd913e72-d9b1-4aed-a92b-1d8b9431ad10 tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e867d4-3314-4549-8a13-0b00142ddf78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cd913e72-d9b1-4aed-a92b-1d8b9431ad10 tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (115a11b1-55d3-44de-b0f7-c12f086a2cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cd913e72-d9b1-4aed-a92b-1d8b9431ad10 tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (115a11b1-55d3-44de-b0f7-c12f086a2cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '488ef897-afba-4e82-b6e7-cec4bcd2491e', 'volume_name': 'volume-488ef897-afba-4e82-b6e7-cec4bcd2491e', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cd913e72-d9b1-4aed-a92b-1d8b9431ad10 tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5fc2424-7827-4b62-b0b6-e0de813941de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cd913e72-d9b1-4aed-a92b-1d8b9431ad10 tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5fc2424-7827-4b62-b0b6-e0de813941de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cd913e72-d9b1-4aed-a92b-1d8b9431ad10 tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a031d73f-74b0-4747-9ccb-dd222ba74d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:32 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-cd913e72-d9b1-4aed-a92b-1d8b9431ad10 tempest-CreateVolumesFromImageTest-1557845107 None] Volume 488ef897-afba-4e82-b6e7-cec4bcd2491e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-488ef897-afba-4e82-b6e7-cec4bcd2491e', 'volume_size': 1}
Nov 06 17:16:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-cd913e72-d9b1-4aed-a92b-1d8b9431ad10 tempest-CreateVolumesFromImageTest-1557845107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:16:33 devstack sudo[100270]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-85700bb3-0877-4648-8564-397eb7dc40fc tempest-CreateVolumesFromImageTest-1557845107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e1580489-6cbe-4370-9192-c0c0382223d6 1073741824" returned: 0 in 0.816s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-85700bb3-0877-4648-8564-397eb7dc40fc tempest-CreateVolumesFromImageTest-1557845107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e1580489-6cbe-4370-9192-c0c0382223d6 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:33 devstack sudo[100276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e1580489-6cbe-4370-9192-c0c0382223d6
Nov 06 17:16:33 devstack sudo[100276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:33 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-c31d37d7-0583-459c-af30-ab37c2f04890 tempest-CreateVolumesFromImageTest-1557845107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:16:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c31d37d7-0583-459c-af30-ab37c2f04890 tempest-CreateVolumesFromImageTest-1557845107 None] Flow 'volume_create_manager' (15b3b80e-6b14-485e-86d4-f392bfb004ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:16:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c31d37d7-0583-459c-af30-ab37c2f04890 tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02147575-2cbc-4d8e-8567-fd71c9e4e3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c31d37d7-0583-459c-af30-ab37c2f04890 tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02147575-2cbc-4d8e-8567-fd71c9e4e3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-396504267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be5a15ee-f101-479e-bd62-505ed37ec18b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a30919d92fe43febb48ac550a8a3083',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:16:33Z,use_quota=True,user_id='11fd6ce21c77487faf9c7599bd9ae3cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c31d37d7-0583-459c-af30-ab37c2f04890 tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f12074e5-5b4c-46c3-ac38-d3434cf4301f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c31d37d7-0583-459c-af30-ab37c2f04890 tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f12074e5-5b4c-46c3-ac38-d3434cf4301f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c31d37d7-0583-459c-af30-ab37c2f04890 tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50ed8697-321a-473e-9dc9-6ad03ff447fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c31d37d7-0583-459c-af30-ab37c2f04890 tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50ed8697-321a-473e-9dc9-6ad03ff447fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be5a15ee-f101-479e-bd62-505ed37ec18b', 'volume_name': 'volume-be5a15ee-f101-479e-bd62-505ed37ec18b', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c31d37d7-0583-459c-af30-ab37c2f04890 tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a78c8a1d-4fe1-446a-9a27-15c61e748830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c31d37d7-0583-459c-af30-ab37c2f04890 tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a78c8a1d-4fe1-446a-9a27-15c61e748830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c31d37d7-0583-459c-af30-ab37c2f04890 tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff45f5b0-b384-493c-b9ba-79d94e1bf97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:33 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-c31d37d7-0583-459c-af30-ab37c2f04890 tempest-CreateVolumesFromImageTest-1557845107 None] Volume be5a15ee-f101-479e-bd62-505ed37ec18b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be5a15ee-f101-479e-bd62-505ed37ec18b', 'volume_size': 1}
Nov 06 17:16:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c31d37d7-0583-459c-af30-ab37c2f04890 tempest-CreateVolumesFromImageTest-1557845107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:16:33 devstack sudo[100276]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-85700bb3-0877-4648-8564-397eb7dc40fc tempest-CreateVolumesFromImageTest-1557845107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e1580489-6cbe-4370-9192-c0c0382223d6" returned: 0 in 0.365s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:33 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-85700bb3-0877-4648-8564-397eb7dc40fc tempest-CreateVolumesFromImageTest-1557845107 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:16:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-85700bb3-0877-4648-8564-397eb7dc40fc tempest-CreateVolumesFromImageTest-1557845107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:16:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-8a9f1485-4c09-4ced-92b4-44e3229353b5 req-c37de2af-abfb-4563-8fcc-d030973fd01e tempest-TestMinimumBasicScenario-906141890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.189s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:16:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-8a9f1485-4c09-4ced-92b4-44e3229353b5 req-c37de2af-abfb-4563-8fcc-d030973fd01e tempest-TestMinimumBasicScenario-906141890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:16:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-94411f54-6d02-4be0-914a-4965bcc299ba tempest-CreateVolumesFromImageTest-1557845107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.376s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:16:33 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-94411f54-6d02-4be0-914a-4965bcc299ba tempest-CreateVolumesFromImageTest-1557845107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-355287394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6038b703-89fa-4df1-a7cc-7b6797217b6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a30919d92fe43febb48ac550a8a3083',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:16:32Z,use_quota=True,user_id='11fd6ce21c77487faf9c7599bd9ae3cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:16:33 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-94411f54-6d02-4be0-914a-4965bcc299ba tempest-CreateVolumesFromImageTest-1557845107 None] Creating volume 6038b703-89fa-4df1-a7cc-7b6797217b6e {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:16:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-94411f54-6d02-4be0-914a-4965bcc299ba tempest-CreateVolumesFromImageTest-1557845107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:16:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-94411f54-6d02-4be0-914a-4965bcc299ba tempest-CreateVolumesFromImageTest-1557845107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:16:33 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-94411f54-6d02-4be0-914a-4965bcc299ba tempest-CreateVolumesFromImageTest-1557845107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:16:33 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-94411f54-6d02-4be0-914a-4965bcc299ba tempest-CreateVolumesFromImageTest-1557845107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:16:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-94411f54-6d02-4be0-914a-4965bcc299ba tempest-CreateVolumesFromImageTest-1557845107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:16:33 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-94411f54-6d02-4be0-914a-4965bcc299ba tempest-CreateVolumesFromImageTest-1557845107 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:16:33 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-94411f54-6d02-4be0-914a-4965bcc299ba tempest-CreateVolumesFromImageTest-1557845107 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:16:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-94411f54-6d02-4be0-914a-4965bcc299ba tempest-CreateVolumesFromImageTest-1557845107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6038b703-89fa-4df1-a7cc-7b6797217b6e 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-85700bb3-0877-4648-8564-397eb7dc40fc tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e630b5c-690e-42ff-a419-175152950680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1580489-6cbe-4370-9192-c0c0382223d6', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-85700bb3-0877-4648-8564-397eb7dc40fc tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7467d062-16da-4db4-88dd-4a58b04cd6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:33 devstack sudo[100280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6038b703-89fa-4df1-a7cc-7b6797217b6e 1073741824
Nov 06 17:16:33 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:33 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-85700bb3-0877-4648-8564-397eb7dc40fc tempest-CreateVolumesFromImageTest-1557845107 None] Volume volume-e1580489-6cbe-4370-9192-c0c0382223d6 (e1580489-6cbe-4370-9192-c0c0382223d6): created successfully
Nov 06 17:16:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-85700bb3-0877-4648-8564-397eb7dc40fc tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7467d062-16da-4db4-88dd-4a58b04cd6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-85700bb3-0877-4648-8564-397eb7dc40fc tempest-CreateVolumesFromImageTest-1557845107 None] Flow 'volume_create_manager' (30741884-991f-4dc1-9edc-649f7824c020) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:16:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-8a9f1485-4c09-4ced-92b4-44e3229353b5 req-c37de2af-abfb-4563-8fcc-d030973fd01e tempest-TestMinimumBasicScenario-906141890 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316', 'name': 'volume-9fa71296-b234-403a-afe7-20c6a009567f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5dcabac7-02e6-434f-b970-336e18003fdc', 'enforce_multipath': True} {{(pid=86856) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 17:16:33 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-85700bb3-0877-4648-8564-397eb7dc40fc tempest-CreateVolumesFromImageTest-1557845107 None] Created volume successfully.
Nov 06 17:16:34 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-8a9f1485-4c09-4ced-92b4-44e3229353b5 req-c37de2af-abfb-4563-8fcc-d030973fd01e tempest-TestMinimumBasicScenario-906141890 None] attachment_update completed successfully.
Nov 06 17:16:34 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-94411f54-6d02-4be0-914a-4965bcc299ba tempest-CreateVolumesFromImageTest-1557845107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6038b703-89fa-4df1-a7cc-7b6797217b6e 1073741824" returned: 0 in 0.704s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-94411f54-6d02-4be0-914a-4965bcc299ba tempest-CreateVolumesFromImageTest-1557845107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6038b703-89fa-4df1-a7cc-7b6797217b6e {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:34 devstack sudo[100722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6038b703-89fa-4df1-a7cc-7b6797217b6e
Nov 06 17:16:34 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:34 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-94411f54-6d02-4be0-914a-4965bcc299ba tempest-CreateVolumesFromImageTest-1557845107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6038b703-89fa-4df1-a7cc-7b6797217b6e" returned: 0 in 0.337s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-94411f54-6d02-4be0-914a-4965bcc299ba tempest-CreateVolumesFromImageTest-1557845107 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:16:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-94411f54-6d02-4be0-914a-4965bcc299ba tempest-CreateVolumesFromImageTest-1557845107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:16:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-cd913e72-d9b1-4aed-a92b-1d8b9431ad10 tempest-CreateVolumesFromImageTest-1557845107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.085s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:16:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-cd913e72-d9b1-4aed-a92b-1d8b9431ad10 tempest-CreateVolumesFromImageTest-1557845107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-816270620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488ef897-afba-4e82-b6e7-cec4bcd2491e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a30919d92fe43febb48ac550a8a3083',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:16:33Z,use_quota=True,user_id='11fd6ce21c77487faf9c7599bd9ae3cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:16:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-cd913e72-d9b1-4aed-a92b-1d8b9431ad10 tempest-CreateVolumesFromImageTest-1557845107 None] Creating volume 488ef897-afba-4e82-b6e7-cec4bcd2491e {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:16:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-cd913e72-d9b1-4aed-a92b-1d8b9431ad10 tempest-CreateVolumesFromImageTest-1557845107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:16:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-cd913e72-d9b1-4aed-a92b-1d8b9431ad10 tempest-CreateVolumesFromImageTest-1557845107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:16:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-cd913e72-d9b1-4aed-a92b-1d8b9431ad10 tempest-CreateVolumesFromImageTest-1557845107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:16:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-cd913e72-d9b1-4aed-a92b-1d8b9431ad10 tempest-CreateVolumesFromImageTest-1557845107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:16:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-cd913e72-d9b1-4aed-a92b-1d8b9431ad10 tempest-CreateVolumesFromImageTest-1557845107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:16:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-cd913e72-d9b1-4aed-a92b-1d8b9431ad10 tempest-CreateVolumesFromImageTest-1557845107 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:16:34 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-cd913e72-d9b1-4aed-a92b-1d8b9431ad10 tempest-CreateVolumesFromImageTest-1557845107 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:16:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cd913e72-d9b1-4aed-a92b-1d8b9431ad10 tempest-CreateVolumesFromImageTest-1557845107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488ef897-afba-4e82-b6e7-cec4bcd2491e 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:35 devstack sudo[100726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488ef897-afba-4e82-b6e7-cec4bcd2491e 1073741824
Nov 06 17:16:35 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:35 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-94411f54-6d02-4be0-914a-4965bcc299ba tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ee3d256-2613-4e4f-a569-1d479d3b5aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6038b703-89fa-4df1-a7cc-7b6797217b6e', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:35 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-94411f54-6d02-4be0-914a-4965bcc299ba tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e39aab22-f583-4126-a78e-e297c63a5a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:35 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-94411f54-6d02-4be0-914a-4965bcc299ba tempest-CreateVolumesFromImageTest-1557845107 None] Volume volume-6038b703-89fa-4df1-a7cc-7b6797217b6e (6038b703-89fa-4df1-a7cc-7b6797217b6e): created successfully
Nov 06 17:16:35 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-94411f54-6d02-4be0-914a-4965bcc299ba tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e39aab22-f583-4126-a78e-e297c63a5a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:35 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-94411f54-6d02-4be0-914a-4965bcc299ba tempest-CreateVolumesFromImageTest-1557845107 None] Flow 'volume_create_manager' (e9e91660-f1c2-423c-a892-5416cf8d544d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:16:35 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-94411f54-6d02-4be0-914a-4965bcc299ba tempest-CreateVolumesFromImageTest-1557845107 None] Created volume successfully.
Nov 06 17:16:35 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cd913e72-d9b1-4aed-a92b-1d8b9431ad10 tempest-CreateVolumesFromImageTest-1557845107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488ef897-afba-4e82-b6e7-cec4bcd2491e 1073741824" returned: 0 in 0.582s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cd913e72-d9b1-4aed-a92b-1d8b9431ad10 tempest-CreateVolumesFromImageTest-1557845107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488ef897-afba-4e82-b6e7-cec4bcd2491e {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:35 devstack sudo[100737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488ef897-afba-4e82-b6e7-cec4bcd2491e
Nov 06 17:16:35 devstack sudo[100737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:35 devstack sudo[100737]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cd913e72-d9b1-4aed-a92b-1d8b9431ad10 tempest-CreateVolumesFromImageTest-1557845107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488ef897-afba-4e82-b6e7-cec4bcd2491e" returned: 0 in 0.296s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-cd913e72-d9b1-4aed-a92b-1d8b9431ad10 tempest-CreateVolumesFromImageTest-1557845107 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:16:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-cd913e72-d9b1-4aed-a92b-1d8b9431ad10 tempest-CreateVolumesFromImageTest-1557845107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:16:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c31d37d7-0583-459c-af30-ab37c2f04890 tempest-CreateVolumesFromImageTest-1557845107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.229s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:16:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c31d37d7-0583-459c-af30-ab37c2f04890 tempest-CreateVolumesFromImageTest-1557845107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-396504267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be5a15ee-f101-479e-bd62-505ed37ec18b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a30919d92fe43febb48ac550a8a3083',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:16:33Z,use_quota=True,user_id='11fd6ce21c77487faf9c7599bd9ae3cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:16:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-c31d37d7-0583-459c-af30-ab37c2f04890 tempest-CreateVolumesFromImageTest-1557845107 None] Creating volume be5a15ee-f101-479e-bd62-505ed37ec18b {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:16:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c31d37d7-0583-459c-af30-ab37c2f04890 tempest-CreateVolumesFromImageTest-1557845107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:16:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c31d37d7-0583-459c-af30-ab37c2f04890 tempest-CreateVolumesFromImageTest-1557845107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:16:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c31d37d7-0583-459c-af30-ab37c2f04890 tempest-CreateVolumesFromImageTest-1557845107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:16:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c31d37d7-0583-459c-af30-ab37c2f04890 tempest-CreateVolumesFromImageTest-1557845107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:16:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c31d37d7-0583-459c-af30-ab37c2f04890 tempest-CreateVolumesFromImageTest-1557845107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:16:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c31d37d7-0583-459c-af30-ab37c2f04890 tempest-CreateVolumesFromImageTest-1557845107 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:16:35 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-c31d37d7-0583-459c-af30-ab37c2f04890 tempest-CreateVolumesFromImageTest-1557845107 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:16:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c31d37d7-0583-459c-af30-ab37c2f04890 tempest-CreateVolumesFromImageTest-1557845107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-be5a15ee-f101-479e-bd62-505ed37ec18b 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:35 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cd913e72-d9b1-4aed-a92b-1d8b9431ad10 tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a031d73f-74b0-4747-9ccb-dd222ba74d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-488ef897-afba-4e82-b6e7-cec4bcd2491e', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:35 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cd913e72-d9b1-4aed-a92b-1d8b9431ad10 tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0424ca91-c417-45ed-8352-67afd16f2ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:35 devstack sudo[100740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-be5a15ee-f101-479e-bd62-505ed37ec18b 1073741824
Nov 06 17:16:35 devstack sudo[100740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:35 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-cd913e72-d9b1-4aed-a92b-1d8b9431ad10 tempest-CreateVolumesFromImageTest-1557845107 None] Volume volume-488ef897-afba-4e82-b6e7-cec4bcd2491e (488ef897-afba-4e82-b6e7-cec4bcd2491e): created successfully
Nov 06 17:16:35 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cd913e72-d9b1-4aed-a92b-1d8b9431ad10 tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0424ca91-c417-45ed-8352-67afd16f2ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:35 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cd913e72-d9b1-4aed-a92b-1d8b9431ad10 tempest-CreateVolumesFromImageTest-1557845107 None] Flow 'volume_create_manager' (6a6082be-b981-4768-816d-27d5e46ee40f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:16:35 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-cd913e72-d9b1-4aed-a92b-1d8b9431ad10 tempest-CreateVolumesFromImageTest-1557845107 None] Created volume successfully.
Nov 06 17:16:36 devstack sudo[100740]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c31d37d7-0583-459c-af30-ab37c2f04890 tempest-CreateVolumesFromImageTest-1557845107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-be5a15ee-f101-479e-bd62-505ed37ec18b 1073741824" returned: 0 in 0.566s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c31d37d7-0583-459c-af30-ab37c2f04890 tempest-CreateVolumesFromImageTest-1557845107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-be5a15ee-f101-479e-bd62-505ed37ec18b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:36 devstack sudo[100746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-be5a15ee-f101-479e-bd62-505ed37ec18b
Nov 06 17:16:36 devstack sudo[100746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:36 devstack sudo[100746]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c31d37d7-0583-459c-af30-ab37c2f04890 tempest-CreateVolumesFromImageTest-1557845107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-be5a15ee-f101-479e-bd62-505ed37ec18b" returned: 0 in 0.275s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:36 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c31d37d7-0583-459c-af30-ab37c2f04890 tempest-CreateVolumesFromImageTest-1557845107 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:16:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c31d37d7-0583-459c-af30-ab37c2f04890 tempest-CreateVolumesFromImageTest-1557845107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:16:36 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c31d37d7-0583-459c-af30-ab37c2f04890 tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff45f5b0-b384-493c-b9ba-79d94e1bf97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be5a15ee-f101-479e-bd62-505ed37ec18b', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:36 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c31d37d7-0583-459c-af30-ab37c2f04890 tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69e37b08-ed69-4f03-94b6-f409923dd02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:36 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-c31d37d7-0583-459c-af30-ab37c2f04890 tempest-CreateVolumesFromImageTest-1557845107 None] Volume volume-be5a15ee-f101-479e-bd62-505ed37ec18b (be5a15ee-f101-479e-bd62-505ed37ec18b): created successfully
Nov 06 17:16:36 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c31d37d7-0583-459c-af30-ab37c2f04890 tempest-CreateVolumesFromImageTest-1557845107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69e37b08-ed69-4f03-94b6-f409923dd02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:36 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-c31d37d7-0583-459c-af30-ab37c2f04890 tempest-CreateVolumesFromImageTest-1557845107 None] Flow 'volume_create_manager' (15b3b80e-6b14-485e-86d4-f392bfb004ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:16:36 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-c31d37d7-0583-459c-af30-ab37c2f04890 tempest-CreateVolumesFromImageTest-1557845107 None] Created volume successfully.
Nov 06 17:16:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-fa6e4f57-6574-43b4-a588-447cccb7be88 tempest-CreateVolumesFromImageTest-1557845107 None] Acquiring lock "cinder-be5a15ee-f101-479e-bd62-505ed37ec18b-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:16:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-fa6e4f57-6574-43b4-a588-447cccb7be88 tempest-CreateVolumesFromImageTest-1557845107 None] Lock "cinder-be5a15ee-f101-479e-bd62-505ed37ec18b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:16:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-fa6e4f57-6574-43b4-a588-447cccb7be88 tempest-CreateVolumesFromImageTest-1557845107 None] Acquiring lock "cinder-quobyte-be5a15ee-f101-479e-bd62-505ed37ec18b" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:16:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-fa6e4f57-6574-43b4-a588-447cccb7be88 tempest-CreateVolumesFromImageTest-1557845107 None] Lock "cinder-quobyte-be5a15ee-f101-479e-bd62-505ed37ec18b" acquired by "delete_volume" :: waited 0.017s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:16:37 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[8162875f-77b8-483c-9c8a-f933fc86d7ec]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:16:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fa6e4f57-6574-43b4-a588-447cccb7be88 tempest-CreateVolumesFromImageTest-1557845107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-be5a15ee-f101-479e-bd62-505ed37ec18b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:37 devstack sudo[100749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-be5a15ee-f101-479e-bd62-505ed37ec18b
Nov 06 17:16:37 devstack sudo[100749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:37 devstack sudo[100749]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fa6e4f57-6574-43b4-a588-447cccb7be88 tempest-CreateVolumesFromImageTest-1557845107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-be5a15ee-f101-479e-bd62-505ed37ec18b" returned: 0 in 0.411s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fa6e4f57-6574-43b4-a588-447cccb7be88 tempest-CreateVolumesFromImageTest-1557845107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-be5a15ee-f101-479e-bd62-505ed37ec18b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:37 devstack sudo[100754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-be5a15ee-f101-479e-bd62-505ed37ec18b
Nov 06 17:16:37 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:37 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fa6e4f57-6574-43b4-a588-447cccb7be88 tempest-CreateVolumesFromImageTest-1557845107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-be5a15ee-f101-479e-bd62-505ed37ec18b" returned: 0 in 0.277s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-fa6e4f57-6574-43b4-a588-447cccb7be88 tempest-CreateVolumesFromImageTest-1557845107 None] Lock "cinder-quobyte-be5a15ee-f101-479e-bd62-505ed37ec18b" released by "delete_volume" :: held 0.742s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:16:37 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-fa6e4f57-6574-43b4-a588-447cccb7be88 tempest-CreateVolumesFromImageTest-1557845107 None] Created reservations ['e68f6ee7-5a09-434c-a10a-bca8a1c4c928', 'f3fa86e8-887e-4595-aa1b-15565436502b', '2e2c7143-d69a-42f0-a47f-52c8af9b07b4', 'b8610d59-0b61-4200-9f39-eeb9451dbdfc'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:16:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-fa6e4f57-6574-43b4-a588-447cccb7be88 tempest-CreateVolumesFromImageTest-1557845107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:16:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-fa6e4f57-6574-43b4-a588-447cccb7be88 tempest-CreateVolumesFromImageTest-1557845107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:16:38 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-fa6e4f57-6574-43b4-a588-447cccb7be88 tempest-CreateVolumesFromImageTest-1557845107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:16:38 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-fa6e4f57-6574-43b4-a588-447cccb7be88 tempest-CreateVolumesFromImageTest-1557845107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:16:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-fa6e4f57-6574-43b4-a588-447cccb7be88 tempest-CreateVolumesFromImageTest-1557845107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:16:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fa6e4f57-6574-43b4-a588-447cccb7be88 tempest-CreateVolumesFromImageTest-1557845107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:38 devstack sudo[100757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:16:38 devstack sudo[100757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:38 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-789da619-d119-425d-a8df-f6336bc739c9 tempest-CreateVolumesFromImageTest-1557845107 None] Acquiring lock "cinder-488ef897-afba-4e82-b6e7-cec4bcd2491e-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:16:38 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-789da619-d119-425d-a8df-f6336bc739c9 tempest-CreateVolumesFromImageTest-1557845107 None] Lock "cinder-488ef897-afba-4e82-b6e7-cec4bcd2491e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:16:38 devstack sudo[100757]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fa6e4f57-6574-43b4-a588-447cccb7be88 tempest-CreateVolumesFromImageTest-1557845107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.311s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:38 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-fa6e4f57-6574-43b4-a588-447cccb7be88 tempest-CreateVolumesFromImageTest-1557845107 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:16:38 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-fa6e4f57-6574-43b4-a588-447cccb7be88 tempest-CreateVolumesFromImageTest-1557845107 None] Deleted volume successfully.
Nov 06 17:16:38 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-fa6e4f57-6574-43b4-a588-447cccb7be88 tempest-CreateVolumesFromImageTest-1557845107 None] Lock "cinder-be5a15ee-f101-479e-bd62-505ed37ec18b-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:16:38 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-789da619-d119-425d-a8df-f6336bc739c9 tempest-CreateVolumesFromImageTest-1557845107 None] Acquiring lock "cinder-quobyte-488ef897-afba-4e82-b6e7-cec4bcd2491e" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:16:38 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-789da619-d119-425d-a8df-f6336bc739c9 tempest-CreateVolumesFromImageTest-1557845107 None] Lock "cinder-quobyte-488ef897-afba-4e82-b6e7-cec4bcd2491e" acquired by "delete_volume" :: waited 0.015s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:16:38 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[81cd2ba4-e1f3-487c-b02d-71337ab7e044]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:16:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-789da619-d119-425d-a8df-f6336bc739c9 tempest-CreateVolumesFromImageTest-1557845107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488ef897-afba-4e82-b6e7-cec4bcd2491e {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:38 devstack sudo[100760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488ef897-afba-4e82-b6e7-cec4bcd2491e
Nov 06 17:16:38 devstack sudo[100760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:38 devstack sudo[100760]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-789da619-d119-425d-a8df-f6336bc739c9 tempest-CreateVolumesFromImageTest-1557845107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488ef897-afba-4e82-b6e7-cec4bcd2491e" returned: 0 in 0.395s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-789da619-d119-425d-a8df-f6336bc739c9 tempest-CreateVolumesFromImageTest-1557845107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488ef897-afba-4e82-b6e7-cec4bcd2491e {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:38 devstack sudo[100766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488ef897-afba-4e82-b6e7-cec4bcd2491e
Nov 06 17:16:38 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:39 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-789da619-d119-425d-a8df-f6336bc739c9 tempest-CreateVolumesFromImageTest-1557845107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488ef897-afba-4e82-b6e7-cec4bcd2491e" returned: 0 in 0.294s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-789da619-d119-425d-a8df-f6336bc739c9 tempest-CreateVolumesFromImageTest-1557845107 None] Lock "cinder-quobyte-488ef897-afba-4e82-b6e7-cec4bcd2491e" released by "delete_volume" :: held 0.759s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:16:39 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-789da619-d119-425d-a8df-f6336bc739c9 tempest-CreateVolumesFromImageTest-1557845107 None] Created reservations ['1b78f590-13a6-4198-bdaa-1ccb9e8de956', '6d45f05c-77b7-4ebb-9ae0-5248c442e277', '1664b69a-6269-4d1a-a017-1c3314291291', '24fbdd95-1fe8-4135-b5cd-cf6bbe16676e'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:16:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-789da619-d119-425d-a8df-f6336bc739c9 tempest-CreateVolumesFromImageTest-1557845107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:16:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-789da619-d119-425d-a8df-f6336bc739c9 tempest-CreateVolumesFromImageTest-1557845107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:16:39 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-789da619-d119-425d-a8df-f6336bc739c9 tempest-CreateVolumesFromImageTest-1557845107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:16:39 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-789da619-d119-425d-a8df-f6336bc739c9 tempest-CreateVolumesFromImageTest-1557845107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:16:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-789da619-d119-425d-a8df-f6336bc739c9 tempest-CreateVolumesFromImageTest-1557845107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:16:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-789da619-d119-425d-a8df-f6336bc739c9 tempest-CreateVolumesFromImageTest-1557845107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:39 devstack sudo[100770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:16:39 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f8c67731-324f-42c5-bad8-62e1ce4a3618 tempest-CreateVolumesFromImageTest-1557845107 None] Acquiring lock "cinder-6038b703-89fa-4df1-a7cc-7b6797217b6e-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:16:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f8c67731-324f-42c5-bad8-62e1ce4a3618 tempest-CreateVolumesFromImageTest-1557845107 None] Lock "cinder-6038b703-89fa-4df1-a7cc-7b6797217b6e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:16:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f8c67731-324f-42c5-bad8-62e1ce4a3618 tempest-CreateVolumesFromImageTest-1557845107 None] Acquiring lock "cinder-quobyte-6038b703-89fa-4df1-a7cc-7b6797217b6e" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:16:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f8c67731-324f-42c5-bad8-62e1ce4a3618 tempest-CreateVolumesFromImageTest-1557845107 None] Lock "cinder-quobyte-6038b703-89fa-4df1-a7cc-7b6797217b6e" acquired by "delete_volume" :: waited 0.024s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:16:39 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d145c5-1747-486b-9f46-5e9981fa88b7]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:16:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f8c67731-324f-42c5-bad8-62e1ce4a3618 tempest-CreateVolumesFromImageTest-1557845107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6038b703-89fa-4df1-a7cc-7b6797217b6e {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:39 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-789da619-d119-425d-a8df-f6336bc739c9 tempest-CreateVolumesFromImageTest-1557845107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.338s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:39 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-789da619-d119-425d-a8df-f6336bc739c9 tempest-CreateVolumesFromImageTest-1557845107 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:16:39 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-789da619-d119-425d-a8df-f6336bc739c9 tempest-CreateVolumesFromImageTest-1557845107 None] Deleted volume successfully.
Nov 06 17:16:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-789da619-d119-425d-a8df-f6336bc739c9 tempest-CreateVolumesFromImageTest-1557845107 None] Lock "cinder-488ef897-afba-4e82-b6e7-cec4bcd2491e-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:16:39 devstack sudo[100773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6038b703-89fa-4df1-a7cc-7b6797217b6e
Nov 06 17:16:39 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:40 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f8c67731-324f-42c5-bad8-62e1ce4a3618 tempest-CreateVolumesFromImageTest-1557845107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6038b703-89fa-4df1-a7cc-7b6797217b6e" returned: 0 in 0.557s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f8c67731-324f-42c5-bad8-62e1ce4a3618 tempest-CreateVolumesFromImageTest-1557845107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6038b703-89fa-4df1-a7cc-7b6797217b6e {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:40 devstack sudo[100780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6038b703-89fa-4df1-a7cc-7b6797217b6e
Nov 06 17:16:40 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:40 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f8c67731-324f-42c5-bad8-62e1ce4a3618 tempest-CreateVolumesFromImageTest-1557845107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6038b703-89fa-4df1-a7cc-7b6797217b6e" returned: 0 in 0.274s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:40 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f8c67731-324f-42c5-bad8-62e1ce4a3618 tempest-CreateVolumesFromImageTest-1557845107 None] Lock "cinder-quobyte-6038b703-89fa-4df1-a7cc-7b6797217b6e" released by "delete_volume" :: held 0.898s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:16:40 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-f8c67731-324f-42c5-bad8-62e1ce4a3618 tempest-CreateVolumesFromImageTest-1557845107 None] Created reservations ['2bd5f653-266c-407f-a28d-3e3c5c95e983', 'e3835b71-8c80-4a81-ac70-d2b752793e1e', '53f23f11-6035-48d7-bb3e-e821b35590b3', '78ec049e-176a-40ef-9a4c-66bc84dd9ca0'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:16:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f8c67731-324f-42c5-bad8-62e1ce4a3618 tempest-CreateVolumesFromImageTest-1557845107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:16:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f8c67731-324f-42c5-bad8-62e1ce4a3618 tempest-CreateVolumesFromImageTest-1557845107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:16:40 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-f8c67731-324f-42c5-bad8-62e1ce4a3618 tempest-CreateVolumesFromImageTest-1557845107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:16:40 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-f8c67731-324f-42c5-bad8-62e1ce4a3618 tempest-CreateVolumesFromImageTest-1557845107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:16:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f8c67731-324f-42c5-bad8-62e1ce4a3618 tempest-CreateVolumesFromImageTest-1557845107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:16:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f8c67731-324f-42c5-bad8-62e1ce4a3618 tempest-CreateVolumesFromImageTest-1557845107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:40 devstack sudo[100783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:16:40 devstack sudo[100783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:40 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a299df2f-1527-4dda-b010-6482af9cdcda tempest-CreateVolumesFromImageTest-1557845107 None] Acquiring lock "cinder-e1580489-6cbe-4370-9192-c0c0382223d6-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:16:40 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a299df2f-1527-4dda-b010-6482af9cdcda tempest-CreateVolumesFromImageTest-1557845107 None] Lock "cinder-e1580489-6cbe-4370-9192-c0c0382223d6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:16:40 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a299df2f-1527-4dda-b010-6482af9cdcda tempest-CreateVolumesFromImageTest-1557845107 None] Acquiring lock "cinder-quobyte-e1580489-6cbe-4370-9192-c0c0382223d6" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:16:40 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a299df2f-1527-4dda-b010-6482af9cdcda tempest-CreateVolumesFromImageTest-1557845107 None] Lock "cinder-quobyte-e1580489-6cbe-4370-9192-c0c0382223d6" acquired by "delete_volume" :: waited 0.030s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:16:40 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[321d40a5-7656-463a-9ded-a5a4428f1f25]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:16:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a299df2f-1527-4dda-b010-6482af9cdcda tempest-CreateVolumesFromImageTest-1557845107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e1580489-6cbe-4370-9192-c0c0382223d6 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:41 devstack sudo[100783]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f8c67731-324f-42c5-bad8-62e1ce4a3618 tempest-CreateVolumesFromImageTest-1557845107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.335s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:41 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-f8c67731-324f-42c5-bad8-62e1ce4a3618 tempest-CreateVolumesFromImageTest-1557845107 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:16:41 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-f8c67731-324f-42c5-bad8-62e1ce4a3618 tempest-CreateVolumesFromImageTest-1557845107 None] Deleted volume successfully.
Nov 06 17:16:41 devstack sudo[100785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e1580489-6cbe-4370-9192-c0c0382223d6
Nov 06 17:16:41 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:41 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f8c67731-324f-42c5-bad8-62e1ce4a3618 tempest-CreateVolumesFromImageTest-1557845107 None] Lock "cinder-6038b703-89fa-4df1-a7cc-7b6797217b6e-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:16:41 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a299df2f-1527-4dda-b010-6482af9cdcda tempest-CreateVolumesFromImageTest-1557845107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e1580489-6cbe-4370-9192-c0c0382223d6" returned: 0 in 0.510s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a299df2f-1527-4dda-b010-6482af9cdcda tempest-CreateVolumesFromImageTest-1557845107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e1580489-6cbe-4370-9192-c0c0382223d6 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:41 devstack sudo[100792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e1580489-6cbe-4370-9192-c0c0382223d6
Nov 06 17:16:41 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:41 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a299df2f-1527-4dda-b010-6482af9cdcda tempest-CreateVolumesFromImageTest-1557845107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e1580489-6cbe-4370-9192-c0c0382223d6" returned: 0 in 0.350s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:41 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a299df2f-1527-4dda-b010-6482af9cdcda tempest-CreateVolumesFromImageTest-1557845107 None] Lock "cinder-quobyte-e1580489-6cbe-4370-9192-c0c0382223d6" released by "delete_volume" :: held 0.936s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:16:41 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-a299df2f-1527-4dda-b010-6482af9cdcda tempest-CreateVolumesFromImageTest-1557845107 None] Created reservations ['30ca3e14-6a91-4fe6-ba4e-e44139d2ed79', '8509f8af-c143-46ac-acf2-387a329abcfb', 'd6243c0a-2821-4983-9edc-b6aea6a9a900', 'b0cbacf9-fa08-48ab-94e8-43633fee2eee'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:16:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a299df2f-1527-4dda-b010-6482af9cdcda tempest-CreateVolumesFromImageTest-1557845107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:16:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a299df2f-1527-4dda-b010-6482af9cdcda tempest-CreateVolumesFromImageTest-1557845107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:16:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a299df2f-1527-4dda-b010-6482af9cdcda tempest-CreateVolumesFromImageTest-1557845107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:16:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a299df2f-1527-4dda-b010-6482af9cdcda tempest-CreateVolumesFromImageTest-1557845107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:16:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a299df2f-1527-4dda-b010-6482af9cdcda tempest-CreateVolumesFromImageTest-1557845107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:16:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a299df2f-1527-4dda-b010-6482af9cdcda tempest-CreateVolumesFromImageTest-1557845107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:42 devstack sudo[100795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:16:42 devstack sudo[100795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:42 devstack sudo[100795]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a299df2f-1527-4dda-b010-6482af9cdcda tempest-CreateVolumesFromImageTest-1557845107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.280s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:42 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-a299df2f-1527-4dda-b010-6482af9cdcda tempest-CreateVolumesFromImageTest-1557845107 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:16:42 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-a299df2f-1527-4dda-b010-6482af9cdcda tempest-CreateVolumesFromImageTest-1557845107 None] Deleted volume successfully.
Nov 06 17:16:42 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a299df2f-1527-4dda-b010-6482af9cdcda tempest-CreateVolumesFromImageTest-1557845107 None] Lock "cinder-e1580489-6cbe-4370-9192-c0c0382223d6-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:16:42 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:16:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:16:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:16:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:16:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:16:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:16:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:42 devstack sudo[100798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:16:42 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:42 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.367s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:42 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:16:42 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager._thread_info {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:16:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread count: 28 {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 17:16:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread info: [<_MainThread(MainThread, started 125183137599616)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125183027608256)>, <Thread(Thread-3 (stat_writer), started daemon 125183025243776)>, <Thread(Rabbit-heartbeat, started daemon 125183023512896)>, <Thread(Thread-5 (_runner), started daemon 125183023357120)>, <Thread(Thread-7 (_runner), started daemon 125183021306496)>, <Thread(fd_logger, started daemon 125183018711616)>, <Thread(privsep_reader, started daemon 125183017484224)>, <Thread(tpool_thread_0, started daemon 125183013742272)>, <Thread(tpool_thread_1, started daemon 125183005349568)>, <Thread(tpool_thread_2, started daemon 125182996956864)>, <Thread(tpool_thread_3, started daemon 125182988564160)>, <Thread(tpool_thread_4, started daemon 125182980171456)>, <Thread(tpool_thread_5, started daemon 125182971778752)>, <Thread(tpool_thread_6, started daemon 125182963386048)>, <Thread(tpool_thread_7, started daemon 125182954993344)>, <Thread(tpool_thread_8, started daemon 125182946600640)>, <Thread(tpool_thread_9, started daemon 125182938207936)>, <Thread(tpool_thread_10, started daemon 125182929815232)>, <Thread(tpool_thread_11, started daemon 125182921422528)>, <Thread(tpool_thread_12, started daemon 125182913013440)>, <Thread(tpool_thread_13, started daemon 125182904604352)>, <Thread(tpool_thread_14, started daemon 125182896195264)>, <Thread(tpool_thread_15, started daemon 125182887786176)>, <Thread(tpool_thread_16, started daemon 125182879377088)>, <Thread(tpool_thread_17, started daemon 125182870968000)>, <Thread(tpool_thread_18, started daemon 125182862558912)>, <Thread(tpool_thread_19, started daemon 125182854149824)>] {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 17:16:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-984c43a6-ab2d-4c02-b1d0-c36110538ce0 tempest-CreateVolumesFromImageTest-1557845107 None] Acquiring lock "cinder-421346ec-66a0-4cef-86b9-1a77369c6160-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:16:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-984c43a6-ab2d-4c02-b1d0-c36110538ce0 tempest-CreateVolumesFromImageTest-1557845107 None] Lock "cinder-421346ec-66a0-4cef-86b9-1a77369c6160-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:16:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-984c43a6-ab2d-4c02-b1d0-c36110538ce0 tempest-CreateVolumesFromImageTest-1557845107 None] Acquiring lock "cinder-quobyte-421346ec-66a0-4cef-86b9-1a77369c6160" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:16:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-984c43a6-ab2d-4c02-b1d0-c36110538ce0 tempest-CreateVolumesFromImageTest-1557845107 None] Lock "cinder-quobyte-421346ec-66a0-4cef-86b9-1a77369c6160" acquired by "delete_volume" :: waited 0.031s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:16:43 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2acbb80-577d-4872-a8e8-ac9b3ff49240]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:16:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-984c43a6-ab2d-4c02-b1d0-c36110538ce0 tempest-CreateVolumesFromImageTest-1557845107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-421346ec-66a0-4cef-86b9-1a77369c6160 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:43 devstack sudo[100801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-421346ec-66a0-4cef-86b9-1a77369c6160
Nov 06 17:16:43 devstack sudo[100801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:43 devstack sudo[100801]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-984c43a6-ab2d-4c02-b1d0-c36110538ce0 tempest-CreateVolumesFromImageTest-1557845107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-421346ec-66a0-4cef-86b9-1a77369c6160" returned: 0 in 0.595s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-984c43a6-ab2d-4c02-b1d0-c36110538ce0 tempest-CreateVolumesFromImageTest-1557845107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-421346ec-66a0-4cef-86b9-1a77369c6160 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:44 devstack sudo[100808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-421346ec-66a0-4cef-86b9-1a77369c6160
Nov 06 17:16:44 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:44 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-984c43a6-ab2d-4c02-b1d0-c36110538ce0 tempest-CreateVolumesFromImageTest-1557845107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-421346ec-66a0-4cef-86b9-1a77369c6160" returned: 0 in 0.323s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:44 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-984c43a6-ab2d-4c02-b1d0-c36110538ce0 tempest-CreateVolumesFromImageTest-1557845107 None] Lock "cinder-quobyte-421346ec-66a0-4cef-86b9-1a77369c6160" released by "delete_volume" :: held 1.007s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:16:44 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-984c43a6-ab2d-4c02-b1d0-c36110538ce0 tempest-CreateVolumesFromImageTest-1557845107 None] Created reservations ['2f0e09a1-3c54-424d-99fb-a71062a53411', '17865f45-24e7-43b5-b3c2-676e13230c81', '317ede58-5a94-4faf-896c-a939f1ce653b', 'da71685a-0ce5-40c5-90a7-7abaac99c582'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:16:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-984c43a6-ab2d-4c02-b1d0-c36110538ce0 tempest-CreateVolumesFromImageTest-1557845107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:16:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-984c43a6-ab2d-4c02-b1d0-c36110538ce0 tempest-CreateVolumesFromImageTest-1557845107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:16:44 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-984c43a6-ab2d-4c02-b1d0-c36110538ce0 tempest-CreateVolumesFromImageTest-1557845107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:16:44 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-984c43a6-ab2d-4c02-b1d0-c36110538ce0 tempest-CreateVolumesFromImageTest-1557845107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:16:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-984c43a6-ab2d-4c02-b1d0-c36110538ce0 tempest-CreateVolumesFromImageTest-1557845107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:16:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-984c43a6-ab2d-4c02-b1d0-c36110538ce0 tempest-CreateVolumesFromImageTest-1557845107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:44 devstack sudo[100811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:16:44 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:44 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-984c43a6-ab2d-4c02-b1d0-c36110538ce0 tempest-CreateVolumesFromImageTest-1557845107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.401s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:44 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-984c43a6-ab2d-4c02-b1d0-c36110538ce0 tempest-CreateVolumesFromImageTest-1557845107 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:16:44 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-984c43a6-ab2d-4c02-b1d0-c36110538ce0 tempest-CreateVolumesFromImageTest-1557845107 None] Deleted volume successfully.
Nov 06 17:16:45 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-984c43a6-ab2d-4c02-b1d0-c36110538ce0 tempest-CreateVolumesFromImageTest-1557845107 None] Lock "cinder-421346ec-66a0-4cef-86b9-1a77369c6160-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:16:50 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed7fd316-77df-46ae-84ce-e90117eacb5b tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:16:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ed7fd316-77df-46ae-84ce-e90117eacb5b tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Flow 'volume_create_manager' (f4f21fd5-0c55-4213-a15e-731c0022aeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:16:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ed7fd316-77df-46ae-84ce-e90117eacb5b tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f6508db-6475-4fa5-a108-a8bf5d468ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ed7fd316-77df-46ae-84ce-e90117eacb5b tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f6508db-6475-4fa5-a108-a8bf5d468ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1942223289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9338aee-72b5-4324-baf8-62c2d42584ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3156e2da8e940349b8a615b8684f850',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:16:50Z,use_quota=True,user_id='70e7bcb2dc4a4bcaa02bd45088796a04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ed7fd316-77df-46ae-84ce-e90117eacb5b tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8cee953-9dc7-415b-b9dd-4c96d7f595f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ed7fd316-77df-46ae-84ce-e90117eacb5b tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8cee953-9dc7-415b-b9dd-4c96d7f595f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ed7fd316-77df-46ae-84ce-e90117eacb5b tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8185b0b4-707d-4ed3-b5fb-4dc31940d7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ed7fd316-77df-46ae-84ce-e90117eacb5b tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8185b0b4-707d-4ed3-b5fb-4dc31940d7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9338aee-72b5-4324-baf8-62c2d42584ba', 'volume_name': 'volume-f9338aee-72b5-4324-baf8-62c2d42584ba', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ed7fd316-77df-46ae-84ce-e90117eacb5b tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c359ca41-5d66-4a4c-b075-92292c177ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ed7fd316-77df-46ae-84ce-e90117eacb5b tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c359ca41-5d66-4a4c-b075-92292c177ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ed7fd316-77df-46ae-84ce-e90117eacb5b tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c516af76-a3ea-4b9a-bc7a-94a82c3ef1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:50 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-ed7fd316-77df-46ae-84ce-e90117eacb5b tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Volume f9338aee-72b5-4324-baf8-62c2d42584ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9338aee-72b5-4324-baf8-62c2d42584ba', 'volume_size': 1}
Nov 06 17:16:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ed7fd316-77df-46ae-84ce-e90117eacb5b tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:16:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ed7fd316-77df-46ae-84ce-e90117eacb5b tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:16:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ed7fd316-77df-46ae-84ce-e90117eacb5b tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1942223289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9338aee-72b5-4324-baf8-62c2d42584ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3156e2da8e940349b8a615b8684f850',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:16:50Z,use_quota=True,user_id='70e7bcb2dc4a4bcaa02bd45088796a04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:16:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-ed7fd316-77df-46ae-84ce-e90117eacb5b tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Creating volume f9338aee-72b5-4324-baf8-62c2d42584ba {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:16:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ed7fd316-77df-46ae-84ce-e90117eacb5b tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:16:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ed7fd316-77df-46ae-84ce-e90117eacb5b tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:16:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ed7fd316-77df-46ae-84ce-e90117eacb5b tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:16:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ed7fd316-77df-46ae-84ce-e90117eacb5b tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:16:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ed7fd316-77df-46ae-84ce-e90117eacb5b tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:16:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ed7fd316-77df-46ae-84ce-e90117eacb5b tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:16:50 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-ed7fd316-77df-46ae-84ce-e90117eacb5b tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:16:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ed7fd316-77df-46ae-84ce-e90117eacb5b tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9338aee-72b5-4324-baf8-62c2d42584ba 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:50 devstack sudo[100866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9338aee-72b5-4324-baf8-62c2d42584ba 1073741824
Nov 06 17:16:50 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:50 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ed7fd316-77df-46ae-84ce-e90117eacb5b tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9338aee-72b5-4324-baf8-62c2d42584ba 1073741824" returned: 0 in 0.504s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ed7fd316-77df-46ae-84ce-e90117eacb5b tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9338aee-72b5-4324-baf8-62c2d42584ba {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:51 devstack sudo[100872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9338aee-72b5-4324-baf8-62c2d42584ba
Nov 06 17:16:51 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:51 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ed7fd316-77df-46ae-84ce-e90117eacb5b tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9338aee-72b5-4324-baf8-62c2d42584ba" returned: 0 in 0.354s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:51 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ed7fd316-77df-46ae-84ce-e90117eacb5b tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:16:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ed7fd316-77df-46ae-84ce-e90117eacb5b tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:16:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ed7fd316-77df-46ae-84ce-e90117eacb5b tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c516af76-a3ea-4b9a-bc7a-94a82c3ef1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9338aee-72b5-4324-baf8-62c2d42584ba', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ed7fd316-77df-46ae-84ce-e90117eacb5b tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fda2d34-82f3-4696-92af-e8b7a287be5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:51 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-ed7fd316-77df-46ae-84ce-e90117eacb5b tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Volume volume-f9338aee-72b5-4324-baf8-62c2d42584ba (f9338aee-72b5-4324-baf8-62c2d42584ba): created successfully
Nov 06 17:16:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ed7fd316-77df-46ae-84ce-e90117eacb5b tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fda2d34-82f3-4696-92af-e8b7a287be5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ed7fd316-77df-46ae-84ce-e90117eacb5b tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Flow 'volume_create_manager' (f4f21fd5-0c55-4213-a15e-731c0022aeec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:16:51 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-ed7fd316-77df-46ae-84ce-e90117eacb5b tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Created volume successfully.
Nov 06 17:16:53 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-47210a0b-2493-4e04-8be7-83884ae9c52e tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:16:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-47210a0b-2493-4e04-8be7-83884ae9c52e tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Flow 'volume_create_manager' (60f7d0f7-d5f7-40f2-9394-8f70c9ebb1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:16:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-47210a0b-2493-4e04-8be7-83884ae9c52e tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba52ad83-15b0-495d-91dd-373e0a98ba4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-47210a0b-2493-4e04-8be7-83884ae9c52e tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba52ad83-15b0-495d-91dd-373e0a98ba4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-448140813',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2185ca7-1fe0-411f-8719-4dc9c8c8dda6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3156e2da8e940349b8a615b8684f850',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:16:53Z,use_quota=True,user_id='70e7bcb2dc4a4bcaa02bd45088796a04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-47210a0b-2493-4e04-8be7-83884ae9c52e tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31734c54-15b7-4503-8892-38da5d27eba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-47210a0b-2493-4e04-8be7-83884ae9c52e tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31734c54-15b7-4503-8892-38da5d27eba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-47210a0b-2493-4e04-8be7-83884ae9c52e tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60efe16e-1215-487c-8601-849b3b8fd78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-47210a0b-2493-4e04-8be7-83884ae9c52e tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60efe16e-1215-487c-8601-849b3b8fd78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2185ca7-1fe0-411f-8719-4dc9c8c8dda6', 'volume_name': 'volume-f2185ca7-1fe0-411f-8719-4dc9c8c8dda6', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-47210a0b-2493-4e04-8be7-83884ae9c52e tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c54eabff-5739-4fa3-b5cd-c8aaee7e5327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-47210a0b-2493-4e04-8be7-83884ae9c52e tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c54eabff-5739-4fa3-b5cd-c8aaee7e5327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-47210a0b-2493-4e04-8be7-83884ae9c52e tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e721203-deed-40ab-b2b6-96d6e72edb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:53 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-47210a0b-2493-4e04-8be7-83884ae9c52e tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Volume f2185ca7-1fe0-411f-8719-4dc9c8c8dda6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2185ca7-1fe0-411f-8719-4dc9c8c8dda6', 'volume_size': 1}
Nov 06 17:16:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-47210a0b-2493-4e04-8be7-83884ae9c52e tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:16:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-47210a0b-2493-4e04-8be7-83884ae9c52e tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:16:53 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-47210a0b-2493-4e04-8be7-83884ae9c52e tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-448140813',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2185ca7-1fe0-411f-8719-4dc9c8c8dda6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3156e2da8e940349b8a615b8684f850',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:16:53Z,use_quota=True,user_id='70e7bcb2dc4a4bcaa02bd45088796a04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:16:53 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-47210a0b-2493-4e04-8be7-83884ae9c52e tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Creating volume f2185ca7-1fe0-411f-8719-4dc9c8c8dda6 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:16:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-47210a0b-2493-4e04-8be7-83884ae9c52e tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:16:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-47210a0b-2493-4e04-8be7-83884ae9c52e tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:16:53 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-47210a0b-2493-4e04-8be7-83884ae9c52e tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:16:53 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-47210a0b-2493-4e04-8be7-83884ae9c52e tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:16:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-47210a0b-2493-4e04-8be7-83884ae9c52e tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:16:53 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-47210a0b-2493-4e04-8be7-83884ae9c52e tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:16:53 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-47210a0b-2493-4e04-8be7-83884ae9c52e tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:16:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-47210a0b-2493-4e04-8be7-83884ae9c52e tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f2185ca7-1fe0-411f-8719-4dc9c8c8dda6 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:53 devstack sudo[100903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f2185ca7-1fe0-411f-8719-4dc9c8c8dda6 1073741824
Nov 06 17:16:53 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:53 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-95581ced-1e8d-45ac-a17e-bbda9e8e5a13 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:16:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-95581ced-1e8d-45ac-a17e-bbda9e8e5a13 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Flow 'volume_create_manager' (2cae8868-62ce-42c0-91b2-24527aa4b6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:16:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-95581ced-1e8d-45ac-a17e-bbda9e8e5a13 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8c0e872-4302-47aa-8150-6a8a73c76d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-95581ced-1e8d-45ac-a17e-bbda9e8e5a13 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8c0e872-4302-47aa-8150-6a8a73c76d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1151205',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fc740c3-e940-485a-8ff8-778b4a593e3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3156e2da8e940349b8a615b8684f850',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:16:53Z,use_quota=True,user_id='70e7bcb2dc4a4bcaa02bd45088796a04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-95581ced-1e8d-45ac-a17e-bbda9e8e5a13 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (557f7a4a-786f-45f6-864c-3a940b9e1c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-95581ced-1e8d-45ac-a17e-bbda9e8e5a13 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (557f7a4a-786f-45f6-864c-3a940b9e1c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-95581ced-1e8d-45ac-a17e-bbda9e8e5a13 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc88d7eb-08b6-4151-9d0e-39ff6c46a693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-95581ced-1e8d-45ac-a17e-bbda9e8e5a13 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc88d7eb-08b6-4151-9d0e-39ff6c46a693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fc740c3-e940-485a-8ff8-778b4a593e3e', 'volume_name': 'volume-7fc740c3-e940-485a-8ff8-778b4a593e3e', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-95581ced-1e8d-45ac-a17e-bbda9e8e5a13 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94fcb24d-0998-4acb-a33e-06ba5674df70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-95581ced-1e8d-45ac-a17e-bbda9e8e5a13 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94fcb24d-0998-4acb-a33e-06ba5674df70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-95581ced-1e8d-45ac-a17e-bbda9e8e5a13 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a31bfad6-9b82-44f5-8644-e0ac4fe8420c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:53 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-95581ced-1e8d-45ac-a17e-bbda9e8e5a13 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Volume 7fc740c3-e940-485a-8ff8-778b4a593e3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fc740c3-e940-485a-8ff8-778b4a593e3e', 'volume_size': 1}
Nov 06 17:16:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-95581ced-1e8d-45ac-a17e-bbda9e8e5a13 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:16:54 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-47210a0b-2493-4e04-8be7-83884ae9c52e tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f2185ca7-1fe0-411f-8719-4dc9c8c8dda6 1073741824" returned: 0 in 1.061s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-47210a0b-2493-4e04-8be7-83884ae9c52e tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f2185ca7-1fe0-411f-8719-4dc9c8c8dda6 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:54 devstack sudo[100934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f2185ca7-1fe0-411f-8719-4dc9c8c8dda6
Nov 06 17:16:54 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:54 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7b6beaa-9a99-41dd-8542-7db470fdb240 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:16:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d7b6beaa-9a99-41dd-8542-7db470fdb240 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Flow 'volume_create_manager' (c18201ae-1a5d-41de-9109-93eb77c125f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:16:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d7b6beaa-9a99-41dd-8542-7db470fdb240 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f4be18-c2fa-431a-af08-1117d916e95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d7b6beaa-9a99-41dd-8542-7db470fdb240 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f4be18-c2fa-431a-af08-1117d916e95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1209123763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f3dd75b-1180-4a5c-9ae5-91c6f4fe3a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3156e2da8e940349b8a615b8684f850',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:16:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:16:54Z,use_quota=True,user_id='70e7bcb2dc4a4bcaa02bd45088796a04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d7b6beaa-9a99-41dd-8542-7db470fdb240 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aa27e38-ba31-42c2-822b-3e06dd66d2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d7b6beaa-9a99-41dd-8542-7db470fdb240 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aa27e38-ba31-42c2-822b-3e06dd66d2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d7b6beaa-9a99-41dd-8542-7db470fdb240 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed0081f8-1543-4464-8d1a-c0b25914f5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d7b6beaa-9a99-41dd-8542-7db470fdb240 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed0081f8-1543-4464-8d1a-c0b25914f5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f3dd75b-1180-4a5c-9ae5-91c6f4fe3a0a', 'volume_name': 'volume-5f3dd75b-1180-4a5c-9ae5-91c6f4fe3a0a', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d7b6beaa-9a99-41dd-8542-7db470fdb240 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (543e2b3e-f224-46b7-98cc-acefbf7190be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d7b6beaa-9a99-41dd-8542-7db470fdb240 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (543e2b3e-f224-46b7-98cc-acefbf7190be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d7b6beaa-9a99-41dd-8542-7db470fdb240 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (498ca588-2306-48ae-8a7c-a401dc3e3bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:54 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-d7b6beaa-9a99-41dd-8542-7db470fdb240 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Volume 5f3dd75b-1180-4a5c-9ae5-91c6f4fe3a0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f3dd75b-1180-4a5c-9ae5-91c6f4fe3a0a', 'volume_size': 1}
Nov 06 17:16:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d7b6beaa-9a99-41dd-8542-7db470fdb240 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:16:54 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-47210a0b-2493-4e04-8be7-83884ae9c52e tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f2185ca7-1fe0-411f-8719-4dc9c8c8dda6" returned: 0 in 0.426s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-47210a0b-2493-4e04-8be7-83884ae9c52e tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:16:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-47210a0b-2493-4e04-8be7-83884ae9c52e tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:16:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-95581ced-1e8d-45ac-a17e-bbda9e8e5a13 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.095s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:16:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-95581ced-1e8d-45ac-a17e-bbda9e8e5a13 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1151205',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fc740c3-e940-485a-8ff8-778b4a593e3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3156e2da8e940349b8a615b8684f850',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:16:53Z,use_quota=True,user_id='70e7bcb2dc4a4bcaa02bd45088796a04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:16:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-95581ced-1e8d-45ac-a17e-bbda9e8e5a13 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Creating volume 7fc740c3-e940-485a-8ff8-778b4a593e3e {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:16:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-95581ced-1e8d-45ac-a17e-bbda9e8e5a13 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:16:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-95581ced-1e8d-45ac-a17e-bbda9e8e5a13 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:16:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-95581ced-1e8d-45ac-a17e-bbda9e8e5a13 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:16:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-95581ced-1e8d-45ac-a17e-bbda9e8e5a13 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:16:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-95581ced-1e8d-45ac-a17e-bbda9e8e5a13 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:16:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-95581ced-1e8d-45ac-a17e-bbda9e8e5a13 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:16:54 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-95581ced-1e8d-45ac-a17e-bbda9e8e5a13 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:16:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-95581ced-1e8d-45ac-a17e-bbda9e8e5a13 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7fc740c3-e940-485a-8ff8-778b4a593e3e 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-47210a0b-2493-4e04-8be7-83884ae9c52e tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e721203-deed-40ab-b2b6-96d6e72edb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2185ca7-1fe0-411f-8719-4dc9c8c8dda6', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-47210a0b-2493-4e04-8be7-83884ae9c52e tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b746854e-36ec-4719-bdd5-9be3d8570eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:54 devstack sudo[100938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7fc740c3-e940-485a-8ff8-778b4a593e3e 1073741824
Nov 06 17:16:54 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:54 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-47210a0b-2493-4e04-8be7-83884ae9c52e tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Volume volume-f2185ca7-1fe0-411f-8719-4dc9c8c8dda6 (f2185ca7-1fe0-411f-8719-4dc9c8c8dda6): created successfully
Nov 06 17:16:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-47210a0b-2493-4e04-8be7-83884ae9c52e tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b746854e-36ec-4719-bdd5-9be3d8570eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-47210a0b-2493-4e04-8be7-83884ae9c52e tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Flow 'volume_create_manager' (60f7d0f7-d5f7-40f2-9394-8f70c9ebb1af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:16:55 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-47210a0b-2493-4e04-8be7-83884ae9c52e tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Created volume successfully.
Nov 06 17:16:55 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-529dce46-20aa-44b2-840a-bfc823335cc7 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:16:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-529dce46-20aa-44b2-840a-bfc823335cc7 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Flow 'volume_create_manager' (b48a1177-860c-42b8-97a5-3ab5d7ccb0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:16:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-529dce46-20aa-44b2-840a-bfc823335cc7 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (945566d7-b36b-4fc8-97b4-4b5d086bba7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-529dce46-20aa-44b2-840a-bfc823335cc7 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (945566d7-b36b-4fc8-97b4-4b5d086bba7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1084767637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ae9818d-3e14-465c-9d9a-21940a40b11a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3156e2da8e940349b8a615b8684f850',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:16:55Z,use_quota=True,user_id='70e7bcb2dc4a4bcaa02bd45088796a04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-529dce46-20aa-44b2-840a-bfc823335cc7 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (666b5f08-ee43-426d-8391-e2099bdafcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-529dce46-20aa-44b2-840a-bfc823335cc7 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (666b5f08-ee43-426d-8391-e2099bdafcdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-529dce46-20aa-44b2-840a-bfc823335cc7 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6559b734-3bc2-477c-9c53-7ac20e36a2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-529dce46-20aa-44b2-840a-bfc823335cc7 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6559b734-3bc2-477c-9c53-7ac20e36a2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ae9818d-3e14-465c-9d9a-21940a40b11a', 'volume_name': 'volume-3ae9818d-3e14-465c-9d9a-21940a40b11a', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-529dce46-20aa-44b2-840a-bfc823335cc7 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb824d2-92c3-4a48-ab1f-eb204317c411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-529dce46-20aa-44b2-840a-bfc823335cc7 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb824d2-92c3-4a48-ab1f-eb204317c411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-529dce46-20aa-44b2-840a-bfc823335cc7 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5d891e9-8344-4647-b29e-99f94bd922b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:55 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-529dce46-20aa-44b2-840a-bfc823335cc7 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Volume 3ae9818d-3e14-465c-9d9a-21940a40b11a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ae9818d-3e14-465c-9d9a-21940a40b11a', 'volume_size': 1}
Nov 06 17:16:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-529dce46-20aa-44b2-840a-bfc823335cc7 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:16:55 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-a11cf656-e8b3-42a6-ad63-bffc98636215 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:16:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a11cf656-e8b3-42a6-ad63-bffc98636215 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Flow 'volume_create_manager' (dee1808b-2bc0-4267-9aa8-8859fe1bd9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:16:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a11cf656-e8b3-42a6-ad63-bffc98636215 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99260175-3ff1-4d96-9a38-dbf2e6424558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:55 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-95581ced-1e8d-45ac-a17e-bbda9e8e5a13 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7fc740c3-e940-485a-8ff8-778b4a593e3e 1073741824" returned: 0 in 0.937s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a11cf656-e8b3-42a6-ad63-bffc98636215 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99260175-3ff1-4d96-9a38-dbf2e6424558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-715646643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b22718ca-9b02-4c4a-879b-64a1cc8ccd56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3156e2da8e940349b8a615b8684f850',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:16:56Z,use_quota=True,user_id='70e7bcb2dc4a4bcaa02bd45088796a04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a11cf656-e8b3-42a6-ad63-bffc98636215 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa8ecb8-52f5-43b0-b07b-554cfc269864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a11cf656-e8b3-42a6-ad63-bffc98636215 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa8ecb8-52f5-43b0-b07b-554cfc269864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a11cf656-e8b3-42a6-ad63-bffc98636215 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5574d0a5-aada-406b-bc2a-7206318df0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a11cf656-e8b3-42a6-ad63-bffc98636215 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5574d0a5-aada-406b-bc2a-7206318df0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b22718ca-9b02-4c4a-879b-64a1cc8ccd56', 'volume_name': 'volume-b22718ca-9b02-4c4a-879b-64a1cc8ccd56', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a11cf656-e8b3-42a6-ad63-bffc98636215 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e72325-ca82-45d3-8aae-0e18d3cb6cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a11cf656-e8b3-42a6-ad63-bffc98636215 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e72325-ca82-45d3-8aae-0e18d3cb6cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:55 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a11cf656-e8b3-42a6-ad63-bffc98636215 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8df595c-7e51-4fae-87e2-a7c284d44229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:55 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-a11cf656-e8b3-42a6-ad63-bffc98636215 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Volume b22718ca-9b02-4c4a-879b-64a1cc8ccd56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b22718ca-9b02-4c4a-879b-64a1cc8ccd56', 'volume_size': 1}
Nov 06 17:16:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a11cf656-e8b3-42a6-ad63-bffc98636215 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:16:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-95581ced-1e8d-45ac-a17e-bbda9e8e5a13 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7fc740c3-e940-485a-8ff8-778b4a593e3e {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:55 devstack sudo[100944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7fc740c3-e940-485a-8ff8-778b4a593e3e
Nov 06 17:16:55 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:56 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-95581ced-1e8d-45ac-a17e-bbda9e8e5a13 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7fc740c3-e940-485a-8ff8-778b4a593e3e" returned: 0 in 0.517s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:56 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-95581ced-1e8d-45ac-a17e-bbda9e8e5a13 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:16:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-95581ced-1e8d-45ac-a17e-bbda9e8e5a13 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:16:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d7b6beaa-9a99-41dd-8542-7db470fdb240 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.817s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:16:56 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d7b6beaa-9a99-41dd-8542-7db470fdb240 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1209123763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f3dd75b-1180-4a5c-9ae5-91c6f4fe3a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3156e2da8e940349b8a615b8684f850',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:16:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:16:54Z,use_quota=True,user_id='70e7bcb2dc4a4bcaa02bd45088796a04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:16:56 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-d7b6beaa-9a99-41dd-8542-7db470fdb240 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Creating volume 5f3dd75b-1180-4a5c-9ae5-91c6f4fe3a0a {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:16:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d7b6beaa-9a99-41dd-8542-7db470fdb240 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:16:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d7b6beaa-9a99-41dd-8542-7db470fdb240 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:16:56 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d7b6beaa-9a99-41dd-8542-7db470fdb240 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:16:56 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d7b6beaa-9a99-41dd-8542-7db470fdb240 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:16:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d7b6beaa-9a99-41dd-8542-7db470fdb240 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:16:56 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d7b6beaa-9a99-41dd-8542-7db470fdb240 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:16:56 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-d7b6beaa-9a99-41dd-8542-7db470fdb240 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:16:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d7b6beaa-9a99-41dd-8542-7db470fdb240 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5f3dd75b-1180-4a5c-9ae5-91c6f4fe3a0a 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:56 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-95581ced-1e8d-45ac-a17e-bbda9e8e5a13 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a31bfad6-9b82-44f5-8644-e0ac4fe8420c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fc740c3-e940-485a-8ff8-778b4a593e3e', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:56 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-95581ced-1e8d-45ac-a17e-bbda9e8e5a13 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed9c8bd-4594-4405-8457-cfe557ee19cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:56 devstack sudo[100948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5f3dd75b-1180-4a5c-9ae5-91c6f4fe3a0a 1073741824
Nov 06 17:16:56 devstack sudo[100948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:56 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-95581ced-1e8d-45ac-a17e-bbda9e8e5a13 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Volume volume-7fc740c3-e940-485a-8ff8-778b4a593e3e (7fc740c3-e940-485a-8ff8-778b4a593e3e): created successfully
Nov 06 17:16:56 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-95581ced-1e8d-45ac-a17e-bbda9e8e5a13 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed9c8bd-4594-4405-8457-cfe557ee19cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:56 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-95581ced-1e8d-45ac-a17e-bbda9e8e5a13 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Flow 'volume_create_manager' (2cae8868-62ce-42c0-91b2-24527aa4b6fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:16:56 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-95581ced-1e8d-45ac-a17e-bbda9e8e5a13 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Created volume successfully.
Nov 06 17:16:57 devstack sudo[100948]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d7b6beaa-9a99-41dd-8542-7db470fdb240 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5f3dd75b-1180-4a5c-9ae5-91c6f4fe3a0a 1073741824" returned: 0 in 0.577s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d7b6beaa-9a99-41dd-8542-7db470fdb240 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5f3dd75b-1180-4a5c-9ae5-91c6f4fe3a0a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:57 devstack sudo[100955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5f3dd75b-1180-4a5c-9ae5-91c6f4fe3a0a
Nov 06 17:16:57 devstack sudo[100955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:57 devstack sudo[100955]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d7b6beaa-9a99-41dd-8542-7db470fdb240 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5f3dd75b-1180-4a5c-9ae5-91c6f4fe3a0a" returned: 0 in 0.290s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:57 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d7b6beaa-9a99-41dd-8542-7db470fdb240 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:16:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d7b6beaa-9a99-41dd-8542-7db470fdb240 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:16:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-529dce46-20aa-44b2-840a-bfc823335cc7 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.022s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:16:57 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-529dce46-20aa-44b2-840a-bfc823335cc7 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1084767637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ae9818d-3e14-465c-9d9a-21940a40b11a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3156e2da8e940349b8a615b8684f850',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:16:55Z,use_quota=True,user_id='70e7bcb2dc4a4bcaa02bd45088796a04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:16:57 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-529dce46-20aa-44b2-840a-bfc823335cc7 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Creating volume 3ae9818d-3e14-465c-9d9a-21940a40b11a {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:16:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-529dce46-20aa-44b2-840a-bfc823335cc7 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:16:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-529dce46-20aa-44b2-840a-bfc823335cc7 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:16:57 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-529dce46-20aa-44b2-840a-bfc823335cc7 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:16:57 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-529dce46-20aa-44b2-840a-bfc823335cc7 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:16:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-529dce46-20aa-44b2-840a-bfc823335cc7 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:16:57 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-529dce46-20aa-44b2-840a-bfc823335cc7 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:16:57 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-529dce46-20aa-44b2-840a-bfc823335cc7 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:16:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-529dce46-20aa-44b2-840a-bfc823335cc7 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3ae9818d-3e14-465c-9d9a-21940a40b11a 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:57 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d7b6beaa-9a99-41dd-8542-7db470fdb240 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (498ca588-2306-48ae-8a7c-a401dc3e3bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f3dd75b-1180-4a5c-9ae5-91c6f4fe3a0a', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:57 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d7b6beaa-9a99-41dd-8542-7db470fdb240 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c30d3802-84c7-45fc-a77c-c567dd528534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:57 devstack sudo[100958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3ae9818d-3e14-465c-9d9a-21940a40b11a 1073741824
Nov 06 17:16:57 devstack sudo[100958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:57 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-d7b6beaa-9a99-41dd-8542-7db470fdb240 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Volume volume-5f3dd75b-1180-4a5c-9ae5-91c6f4fe3a0a (5f3dd75b-1180-4a5c-9ae5-91c6f4fe3a0a): created successfully
Nov 06 17:16:57 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d7b6beaa-9a99-41dd-8542-7db470fdb240 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c30d3802-84c7-45fc-a77c-c567dd528534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:57 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d7b6beaa-9a99-41dd-8542-7db470fdb240 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Flow 'volume_create_manager' (c18201ae-1a5d-41de-9109-93eb77c125f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:16:57 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-d7b6beaa-9a99-41dd-8542-7db470fdb240 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Created volume successfully.
Nov 06 17:16:57 devstack sudo[100958]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-529dce46-20aa-44b2-840a-bfc823335cc7 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3ae9818d-3e14-465c-9d9a-21940a40b11a 1073741824" returned: 0 in 0.452s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-529dce46-20aa-44b2-840a-bfc823335cc7 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3ae9818d-3e14-465c-9d9a-21940a40b11a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:57 devstack sudo[100963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3ae9818d-3e14-465c-9d9a-21940a40b11a
Nov 06 17:16:57 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:58 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-529dce46-20aa-44b2-840a-bfc823335cc7 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3ae9818d-3e14-465c-9d9a-21940a40b11a" returned: 0 in 0.349s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:58 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-529dce46-20aa-44b2-840a-bfc823335cc7 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:16:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-529dce46-20aa-44b2-840a-bfc823335cc7 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:16:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a11cf656-e8b3-42a6-ad63-bffc98636215 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.374s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:16:58 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a11cf656-e8b3-42a6-ad63-bffc98636215 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-715646643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b22718ca-9b02-4c4a-879b-64a1cc8ccd56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3156e2da8e940349b8a615b8684f850',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:16:56Z,use_quota=True,user_id='70e7bcb2dc4a4bcaa02bd45088796a04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:16:58 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-a11cf656-e8b3-42a6-ad63-bffc98636215 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Creating volume b22718ca-9b02-4c4a-879b-64a1cc8ccd56 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:16:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a11cf656-e8b3-42a6-ad63-bffc98636215 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:16:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a11cf656-e8b3-42a6-ad63-bffc98636215 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:16:58 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a11cf656-e8b3-42a6-ad63-bffc98636215 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:16:58 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a11cf656-e8b3-42a6-ad63-bffc98636215 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:16:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a11cf656-e8b3-42a6-ad63-bffc98636215 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:16:58 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a11cf656-e8b3-42a6-ad63-bffc98636215 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:16:58 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-a11cf656-e8b3-42a6-ad63-bffc98636215 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:16:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a11cf656-e8b3-42a6-ad63-bffc98636215 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b22718ca-9b02-4c4a-879b-64a1cc8ccd56 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-529dce46-20aa-44b2-840a-bfc823335cc7 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5d891e9-8344-4647-b29e-99f94bd922b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ae9818d-3e14-465c-9d9a-21940a40b11a', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-529dce46-20aa-44b2-840a-bfc823335cc7 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35f680a4-9f04-4d91-abe1-dc28b227d82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:58 devstack sudo[100966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b22718ca-9b02-4c4a-879b-64a1cc8ccd56 1073741824
Nov 06 17:16:58 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:58 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-529dce46-20aa-44b2-840a-bfc823335cc7 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Volume volume-3ae9818d-3e14-465c-9d9a-21940a40b11a (3ae9818d-3e14-465c-9d9a-21940a40b11a): created successfully
Nov 06 17:16:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-529dce46-20aa-44b2-840a-bfc823335cc7 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35f680a4-9f04-4d91-abe1-dc28b227d82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-529dce46-20aa-44b2-840a-bfc823335cc7 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Flow 'volume_create_manager' (b48a1177-860c-42b8-97a5-3ab5d7ccb0ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:16:58 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-529dce46-20aa-44b2-840a-bfc823335cc7 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Created volume successfully.
Nov 06 17:16:58 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a11cf656-e8b3-42a6-ad63-bffc98636215 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b22718ca-9b02-4c4a-879b-64a1cc8ccd56 1073741824" returned: 0 in 0.570s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a11cf656-e8b3-42a6-ad63-bffc98636215 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b22718ca-9b02-4c4a-879b-64a1cc8ccd56 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:16:58 devstack sudo[100972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b22718ca-9b02-4c4a-879b-64a1cc8ccd56
Nov 06 17:16:58 devstack sudo[100972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:16:59 devstack sudo[100972]: pam_unix(sudo:session): session closed for user root
Nov 06 17:16:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a11cf656-e8b3-42a6-ad63-bffc98636215 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b22718ca-9b02-4c4a-879b-64a1cc8ccd56" returned: 0 in 0.336s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:16:59 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a11cf656-e8b3-42a6-ad63-bffc98636215 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:16:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a11cf656-e8b3-42a6-ad63-bffc98636215 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:16:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a11cf656-e8b3-42a6-ad63-bffc98636215 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8df595c-7e51-4fae-87e2-a7c284d44229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b22718ca-9b02-4c4a-879b-64a1cc8ccd56', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a11cf656-e8b3-42a6-ad63-bffc98636215 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46485f38-6b49-49b6-8366-582adb96fc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:16:59 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-a11cf656-e8b3-42a6-ad63-bffc98636215 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Volume volume-b22718ca-9b02-4c4a-879b-64a1cc8ccd56 (b22718ca-9b02-4c4a-879b-64a1cc8ccd56): created successfully
Nov 06 17:16:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a11cf656-e8b3-42a6-ad63-bffc98636215 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46485f38-6b49-49b6-8366-582adb96fc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:16:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a11cf656-e8b3-42a6-ad63-bffc98636215 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Flow 'volume_create_manager' (dee1808b-2bc0-4267-9aa8-8859fe1bd9f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:16:59 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-a11cf656-e8b3-42a6-ad63-bffc98636215 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Created volume successfully.
Nov 06 17:17:00 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-2ef76004-7f34-429a-ad07-d6e8194a1533 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Acquiring lock "cinder-b22718ca-9b02-4c4a-879b-64a1cc8ccd56-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:17:00 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-2ef76004-7f34-429a-ad07-d6e8194a1533 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "cinder-b22718ca-9b02-4c4a-879b-64a1cc8ccd56-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:17:00 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-2ef76004-7f34-429a-ad07-d6e8194a1533 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Acquiring lock "cinder-quobyte-b22718ca-9b02-4c4a-879b-64a1cc8ccd56" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:17:00 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-2ef76004-7f34-429a-ad07-d6e8194a1533 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "cinder-quobyte-b22718ca-9b02-4c4a-879b-64a1cc8ccd56" acquired by "delete_volume" :: waited 0.027s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:17:00 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[05626c00-8839-4fbb-82e6-785f7b15e810]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:17:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2ef76004-7f34-429a-ad07-d6e8194a1533 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b22718ca-9b02-4c4a-879b-64a1cc8ccd56 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:17:00 devstack sudo[100975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b22718ca-9b02-4c4a-879b-64a1cc8ccd56
Nov 06 17:17:00 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:17:00 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root
Nov 06 17:17:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2ef76004-7f34-429a-ad07-d6e8194a1533 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b22718ca-9b02-4c4a-879b-64a1cc8ccd56" returned: 0 in 0.417s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:17:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2ef76004-7f34-429a-ad07-d6e8194a1533 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b22718ca-9b02-4c4a-879b-64a1cc8ccd56 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:17:01 devstack sudo[100980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b22718ca-9b02-4c4a-879b-64a1cc8ccd56
Nov 06 17:17:01 devstack sudo[100980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:17:01 devstack sudo[100980]: pam_unix(sudo:session): session closed for user root
Nov 06 17:17:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2ef76004-7f34-429a-ad07-d6e8194a1533 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b22718ca-9b02-4c4a-879b-64a1cc8ccd56" returned: 0 in 0.380s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:17:01 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-2ef76004-7f34-429a-ad07-d6e8194a1533 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "cinder-quobyte-b22718ca-9b02-4c4a-879b-64a1cc8ccd56" released by "delete_volume" :: held 0.853s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:17:01 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-2ef76004-7f34-429a-ad07-d6e8194a1533 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Created reservations ['cfcd4237-8f3b-437c-ba5e-0ed576c9001b', 'f3b76a9f-2eaf-44d6-ae6c-babfd7c0f2cc', 'c68fde49-6989-44e2-9847-ac89bf2fb9fe', '2f12a907-5883-4bbb-bff0-fabf191ba4a1'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:17:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2ef76004-7f34-429a-ad07-d6e8194a1533 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:17:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2ef76004-7f34-429a-ad07-d6e8194a1533 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:17:01 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-2ef76004-7f34-429a-ad07-d6e8194a1533 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:17:01 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-2ef76004-7f34-429a-ad07-d6e8194a1533 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:17:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2ef76004-7f34-429a-ad07-d6e8194a1533 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:17:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2ef76004-7f34-429a-ad07-d6e8194a1533 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:17:01 devstack sudo[100987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:17:01 devstack sudo[100987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:17:01 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-02d0f023-f90a-4e67-860d-fe8643fefca1 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Acquiring lock "cinder-3ae9818d-3e14-465c-9d9a-21940a40b11a-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:17:01 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-02d0f023-f90a-4e67-860d-fe8643fefca1 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "cinder-3ae9818d-3e14-465c-9d9a-21940a40b11a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:17:01 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-02d0f023-f90a-4e67-860d-fe8643fefca1 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Acquiring lock "cinder-quobyte-3ae9818d-3e14-465c-9d9a-21940a40b11a" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:17:01 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-02d0f023-f90a-4e67-860d-fe8643fefca1 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "cinder-quobyte-3ae9818d-3e14-465c-9d9a-21940a40b11a" acquired by "delete_volume" :: waited 0.033s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:17:01 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[3badc8ac-de83-462c-90f0-cc57fe313c68]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:17:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-02d0f023-f90a-4e67-860d-fe8643fefca1 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3ae9818d-3e14-465c-9d9a-21940a40b11a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:17:01 devstack sudo[100987]: pam_unix(sudo:session): session closed for user root
Nov 06 17:17:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2ef76004-7f34-429a-ad07-d6e8194a1533 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.384s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:17:01 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-2ef76004-7f34-429a-ad07-d6e8194a1533 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:17:01 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-2ef76004-7f34-429a-ad07-d6e8194a1533 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Deleted volume successfully.
Nov 06 17:17:01 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-2ef76004-7f34-429a-ad07-d6e8194a1533 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "cinder-b22718ca-9b02-4c4a-879b-64a1cc8ccd56-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:17:01 devstack sudo[100990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3ae9818d-3e14-465c-9d9a-21940a40b11a
Nov 06 17:17:01 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:17:02 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root
Nov 06 17:17:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-02d0f023-f90a-4e67-860d-fe8643fefca1 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3ae9818d-3e14-465c-9d9a-21940a40b11a" returned: 0 in 0.469s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:17:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-02d0f023-f90a-4e67-860d-fe8643fefca1 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3ae9818d-3e14-465c-9d9a-21940a40b11a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:17:02 devstack sudo[100996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3ae9818d-3e14-465c-9d9a-21940a40b11a
Nov 06 17:17:02 devstack sudo[100996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:17:02 devstack sudo[100996]: pam_unix(sudo:session): session closed for user root
Nov 06 17:17:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-02d0f023-f90a-4e67-860d-fe8643fefca1 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3ae9818d-3e14-465c-9d9a-21940a40b11a" returned: 0 in 0.268s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:17:02 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-02d0f023-f90a-4e67-860d-fe8643fefca1 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "cinder-quobyte-3ae9818d-3e14-465c-9d9a-21940a40b11a" released by "delete_volume" :: held 0.816s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:17:02 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-02d0f023-f90a-4e67-860d-fe8643fefca1 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Created reservations ['9d308976-bf30-42b8-a6d2-e9fcde5d3a7f', 'f7a4c645-5d0e-4534-9b79-56b77108ed40', '0102bd6a-efce-45df-913c-389d5bf64ecd', '47e57b98-efab-4912-9b1f-e93340ac5b8a'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:17:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-02d0f023-f90a-4e67-860d-fe8643fefca1 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:17:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-02d0f023-f90a-4e67-860d-fe8643fefca1 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:17:02 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-02d0f023-f90a-4e67-860d-fe8643fefca1 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:17:02 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-02d0f023-f90a-4e67-860d-fe8643fefca1 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:17:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-02d0f023-f90a-4e67-860d-fe8643fefca1 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:17:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-02d0f023-f90a-4e67-860d-fe8643fefca1 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:17:02 devstack sudo[100999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:17:02 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:17:02 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5311bac5-89a5-4c8d-89cc-9f3e01625968 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Acquiring lock "cinder-5f3dd75b-1180-4a5c-9ae5-91c6f4fe3a0a-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:17:03 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5311bac5-89a5-4c8d-89cc-9f3e01625968 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "cinder-5f3dd75b-1180-4a5c-9ae5-91c6f4fe3a0a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:17:03 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5311bac5-89a5-4c8d-89cc-9f3e01625968 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Acquiring lock "cinder-quobyte-5f3dd75b-1180-4a5c-9ae5-91c6f4fe3a0a" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:17:03 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5311bac5-89a5-4c8d-89cc-9f3e01625968 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "cinder-quobyte-5f3dd75b-1180-4a5c-9ae5-91c6f4fe3a0a" acquired by "delete_volume" :: waited 0.037s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:17:03 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a4a3c3-07f6-4fd1-aace-5bc673803007]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:17:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5311bac5-89a5-4c8d-89cc-9f3e01625968 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5f3dd75b-1180-4a5c-9ae5-91c6f4fe3a0a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:17:03 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root
Nov 06 17:17:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-02d0f023-f90a-4e67-860d-fe8643fefca1 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.419s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:17:03 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-02d0f023-f90a-4e67-860d-fe8643fefca1 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:17:03 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-02d0f023-f90a-4e67-860d-fe8643fefca1 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Deleted volume successfully.
Nov 06 17:17:03 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-02d0f023-f90a-4e67-860d-fe8643fefca1 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "cinder-3ae9818d-3e14-465c-9d9a-21940a40b11a-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:17:03 devstack sudo[101002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5f3dd75b-1180-4a5c-9ae5-91c6f4fe3a0a
Nov 06 17:17:03 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:17:03 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root
Nov 06 17:17:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5311bac5-89a5-4c8d-89cc-9f3e01625968 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5f3dd75b-1180-4a5c-9ae5-91c6f4fe3a0a" returned: 0 in 0.468s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:17:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5311bac5-89a5-4c8d-89cc-9f3e01625968 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5f3dd75b-1180-4a5c-9ae5-91c6f4fe3a0a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:17:03 devstack sudo[101008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5f3dd75b-1180-4a5c-9ae5-91c6f4fe3a0a
Nov 06 17:17:03 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:17:03 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root
Nov 06 17:17:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5311bac5-89a5-4c8d-89cc-9f3e01625968 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5f3dd75b-1180-4a5c-9ae5-91c6f4fe3a0a" returned: 0 in 0.371s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:17:04 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5311bac5-89a5-4c8d-89cc-9f3e01625968 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "cinder-quobyte-5f3dd75b-1180-4a5c-9ae5-91c6f4fe3a0a" released by "delete_volume" :: held 0.904s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:17:04 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-5311bac5-89a5-4c8d-89cc-9f3e01625968 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Created reservations ['4fc11d73-d7b8-465f-a30c-e1851c8e9673', '62d8d72d-fd48-46a8-9ed7-408fafa6e7c6', '3d3c875f-94aa-4972-8348-4cb7549ad392', 'f3db6afa-6de3-42a7-ab4e-64a6521019ac'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:17:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5311bac5-89a5-4c8d-89cc-9f3e01625968 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:17:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5311bac5-89a5-4c8d-89cc-9f3e01625968 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:17:04 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5311bac5-89a5-4c8d-89cc-9f3e01625968 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:17:04 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5311bac5-89a5-4c8d-89cc-9f3e01625968 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:17:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5311bac5-89a5-4c8d-89cc-9f3e01625968 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:17:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5311bac5-89a5-4c8d-89cc-9f3e01625968 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:17:04 devstack sudo[101011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:17:04 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:17:04 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-0015c86c-1df6-4d06-a7da-bfc64a965e42 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Acquiring lock "cinder-7fc740c3-e940-485a-8ff8-778b4a593e3e-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:17:04 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-0015c86c-1df6-4d06-a7da-bfc64a965e42 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "cinder-7fc740c3-e940-485a-8ff8-778b4a593e3e-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:17:04 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-0015c86c-1df6-4d06-a7da-bfc64a965e42 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Acquiring lock "cinder-quobyte-7fc740c3-e940-485a-8ff8-778b4a593e3e" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:17:04 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-0015c86c-1df6-4d06-a7da-bfc64a965e42 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "cinder-quobyte-7fc740c3-e940-485a-8ff8-778b4a593e3e" acquired by "delete_volume" :: waited 0.036s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:17:04 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[72722d7b-d662-4997-bfa8-4b557378592e]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:17:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0015c86c-1df6-4d06-a7da-bfc64a965e42 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7fc740c3-e940-485a-8ff8-778b4a593e3e {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:17:04 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root
Nov 06 17:17:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5311bac5-89a5-4c8d-89cc-9f3e01625968 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.418s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:17:04 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-5311bac5-89a5-4c8d-89cc-9f3e01625968 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:17:04 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-5311bac5-89a5-4c8d-89cc-9f3e01625968 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Deleted volume successfully.
Nov 06 17:17:04 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5311bac5-89a5-4c8d-89cc-9f3e01625968 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "cinder-5f3dd75b-1180-4a5c-9ae5-91c6f4fe3a0a-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:17:04 devstack sudo[101014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7fc740c3-e940-485a-8ff8-778b4a593e3e
Nov 06 17:17:04 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:17:05 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root
Nov 06 17:17:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0015c86c-1df6-4d06-a7da-bfc64a965e42 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7fc740c3-e940-485a-8ff8-778b4a593e3e" returned: 0 in 0.436s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:17:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0015c86c-1df6-4d06-a7da-bfc64a965e42 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7fc740c3-e940-485a-8ff8-778b4a593e3e {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:17:05 devstack sudo[101019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7fc740c3-e940-485a-8ff8-778b4a593e3e
Nov 06 17:17:05 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:17:05 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root
Nov 06 17:17:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0015c86c-1df6-4d06-a7da-bfc64a965e42 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7fc740c3-e940-485a-8ff8-778b4a593e3e" returned: 0 in 0.269s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:17:05 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-0015c86c-1df6-4d06-a7da-bfc64a965e42 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "cinder-quobyte-7fc740c3-e940-485a-8ff8-778b4a593e3e" released by "delete_volume" :: held 0.782s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:17:05 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-0015c86c-1df6-4d06-a7da-bfc64a965e42 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Created reservations ['b23ab73d-2823-47ea-a972-ddb00bc0db4f', 'ee27d2cd-61a2-41be-8cc3-6ff9021dd89d', 'e69ca3d2-425f-410f-a56e-1f91c234ee77', '36138fd3-90cc-4471-9a8f-b8aa4566c0dd'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:17:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0015c86c-1df6-4d06-a7da-bfc64a965e42 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:17:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0015c86c-1df6-4d06-a7da-bfc64a965e42 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:17:05 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0015c86c-1df6-4d06-a7da-bfc64a965e42 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:17:05 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0015c86c-1df6-4d06-a7da-bfc64a965e42 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:17:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0015c86c-1df6-4d06-a7da-bfc64a965e42 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:17:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0015c86c-1df6-4d06-a7da-bfc64a965e42 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:17:05 devstack sudo[101022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:17:05 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:17:05 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c774b157-2aba-4d69-8406-2c06aeb623e4 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Acquiring lock "cinder-f2185ca7-1fe0-411f-8719-4dc9c8c8dda6-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:17:05 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c774b157-2aba-4d69-8406-2c06aeb623e4 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "cinder-f2185ca7-1fe0-411f-8719-4dc9c8c8dda6-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:17:05 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c774b157-2aba-4d69-8406-2c06aeb623e4 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Acquiring lock "cinder-quobyte-f2185ca7-1fe0-411f-8719-4dc9c8c8dda6" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:17:05 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c774b157-2aba-4d69-8406-2c06aeb623e4 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "cinder-quobyte-f2185ca7-1fe0-411f-8719-4dc9c8c8dda6" acquired by "delete_volume" :: waited 0.020s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:17:05 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac732020-917e-4a2b-90d7-a6f8bd5a006b]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:17:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c774b157-2aba-4d69-8406-2c06aeb623e4 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f2185ca7-1fe0-411f-8719-4dc9c8c8dda6 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:17:05 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root
Nov 06 17:17:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0015c86c-1df6-4d06-a7da-bfc64a965e42 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.360s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:17:05 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-0015c86c-1df6-4d06-a7da-bfc64a965e42 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:17:05 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-0015c86c-1df6-4d06-a7da-bfc64a965e42 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Deleted volume successfully.
Nov 06 17:17:05 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-0015c86c-1df6-4d06-a7da-bfc64a965e42 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "cinder-7fc740c3-e940-485a-8ff8-778b4a593e3e-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:17:05 devstack sudo[101025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f2185ca7-1fe0-411f-8719-4dc9c8c8dda6
Nov 06 17:17:05 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:17:06 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root
Nov 06 17:17:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c774b157-2aba-4d69-8406-2c06aeb623e4 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f2185ca7-1fe0-411f-8719-4dc9c8c8dda6" returned: 0 in 0.484s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:17:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c774b157-2aba-4d69-8406-2c06aeb623e4 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f2185ca7-1fe0-411f-8719-4dc9c8c8dda6 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:17:06 devstack sudo[101030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f2185ca7-1fe0-411f-8719-4dc9c8c8dda6
Nov 06 17:17:06 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:17:06 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root
Nov 06 17:17:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c774b157-2aba-4d69-8406-2c06aeb623e4 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f2185ca7-1fe0-411f-8719-4dc9c8c8dda6" returned: 0 in 0.313s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:17:06 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c774b157-2aba-4d69-8406-2c06aeb623e4 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "cinder-quobyte-f2185ca7-1fe0-411f-8719-4dc9c8c8dda6" released by "delete_volume" :: held 0.866s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:17:06 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-c774b157-2aba-4d69-8406-2c06aeb623e4 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Created reservations ['026e7acf-85ca-4cd0-8cdd-4570999fbb4c', '0947290b-6f36-4d48-9fe6-4f865488bf6b', 'c10663df-5ce3-46e7-911f-5cf9936cb85b', '953332d8-ad7f-4e22-ac99-d5619a4eb98f'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:17:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c774b157-2aba-4d69-8406-2c06aeb623e4 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:17:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c774b157-2aba-4d69-8406-2c06aeb623e4 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:17:06 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c774b157-2aba-4d69-8406-2c06aeb623e4 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:17:06 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c774b157-2aba-4d69-8406-2c06aeb623e4 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:17:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c774b157-2aba-4d69-8406-2c06aeb623e4 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:17:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c774b157-2aba-4d69-8406-2c06aeb623e4 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:17:06 devstack sudo[101034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:17:06 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:17:06 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9d555b0a-6c78-4d54-a328-cbb5265ef509 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Acquiring lock "cinder-f9338aee-72b5-4324-baf8-62c2d42584ba-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:17:06 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9d555b0a-6c78-4d54-a328-cbb5265ef509 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "cinder-f9338aee-72b5-4324-baf8-62c2d42584ba-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:17:06 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9d555b0a-6c78-4d54-a328-cbb5265ef509 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Acquiring lock "cinder-quobyte-f9338aee-72b5-4324-baf8-62c2d42584ba" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:17:06 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9d555b0a-6c78-4d54-a328-cbb5265ef509 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "cinder-quobyte-f9338aee-72b5-4324-baf8-62c2d42584ba" acquired by "delete_volume" :: waited 0.016s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:17:07 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[43680638-9829-4c20-891c-55c2fb64b1e2]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:17:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9d555b0a-6c78-4d54-a328-cbb5265ef509 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9338aee-72b5-4324-baf8-62c2d42584ba {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:17:07 devstack sudo[101036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9338aee-72b5-4324-baf8-62c2d42584ba
Nov 06 17:17:07 devstack sudo[101036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:17:07 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root
Nov 06 17:17:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c774b157-2aba-4d69-8406-2c06aeb623e4 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.406s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:17:07 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-c774b157-2aba-4d69-8406-2c06aeb623e4 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:17:07 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-c774b157-2aba-4d69-8406-2c06aeb623e4 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Deleted volume successfully.
Nov 06 17:17:07 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c774b157-2aba-4d69-8406-2c06aeb623e4 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "cinder-f2185ca7-1fe0-411f-8719-4dc9c8c8dda6-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:17:07 devstack sudo[101036]: pam_unix(sudo:session): session closed for user root
Nov 06 17:17:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9d555b0a-6c78-4d54-a328-cbb5265ef509 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9338aee-72b5-4324-baf8-62c2d42584ba" returned: 0 in 0.449s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:17:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9d555b0a-6c78-4d54-a328-cbb5265ef509 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9338aee-72b5-4324-baf8-62c2d42584ba {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:17:07 devstack sudo[101042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9338aee-72b5-4324-baf8-62c2d42584ba
Nov 06 17:17:07 devstack sudo[101042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:17:07 devstack sudo[101042]: pam_unix(sudo:session): session closed for user root
Nov 06 17:17:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9d555b0a-6c78-4d54-a328-cbb5265ef509 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9338aee-72b5-4324-baf8-62c2d42584ba" returned: 0 in 0.263s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:17:07 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9d555b0a-6c78-4d54-a328-cbb5265ef509 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "cinder-quobyte-f9338aee-72b5-4324-baf8-62c2d42584ba" released by "delete_volume" :: held 0.787s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:17:07 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-9d555b0a-6c78-4d54-a328-cbb5265ef509 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Created reservations ['a281465a-cc5d-4250-aefb-9b1bd406d5ae', '206fc2b5-9e64-476c-abce-04b0d54f1a2a', '04fe2ea4-429c-4ea5-8693-5c5622e1605b', '9ee7d7ac-4a0f-4896-b1ec-be52e7260666'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:17:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9d555b0a-6c78-4d54-a328-cbb5265ef509 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:17:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9d555b0a-6c78-4d54-a328-cbb5265ef509 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:17:07 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-9d555b0a-6c78-4d54-a328-cbb5265ef509 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:17:07 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-9d555b0a-6c78-4d54-a328-cbb5265ef509 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:17:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9d555b0a-6c78-4d54-a328-cbb5265ef509 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:17:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9d555b0a-6c78-4d54-a328-cbb5265ef509 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:17:07 devstack sudo[101045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:17:07 devstack sudo[101045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:17:08 devstack sudo[101045]: pam_unix(sudo:session): session closed for user root
Nov 06 17:17:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9d555b0a-6c78-4d54-a328-cbb5265ef509 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.273s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:17:08 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-9d555b0a-6c78-4d54-a328-cbb5265ef509 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:17:08 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-9d555b0a-6c78-4d54-a328-cbb5265ef509 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Deleted volume successfully.
Nov 06 17:17:08 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9d555b0a-6c78-4d54-a328-cbb5265ef509 tempest-CreateVolumesFromSourceVolumeTest-1458456191 None] Lock "cinder-f9338aee-72b5-4324-baf8-62c2d42584ba-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:17:08 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:17:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Flow 'volume_create_manager' (5270ea81-90b9-4d20-b930-a85f8f6f65fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:17:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (112357fb-ef54-431c-bfb2-0f2501c2efd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:17:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (112357fb-ef54-431c-bfb2-0f2501c2efd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-317511845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baffa222-0540-494b-8557-e25f425666d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='512304277a9c4bb4ac5c18ee02221929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:17:09Z,use_quota=True,user_id='fa694e4e34e54b5cb680c13bfc344361',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:17:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d636a462-f303-4097-b533-14b5d13caefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:17:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d636a462-f303-4097-b533-14b5d13caefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:17:08 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2990c00d-de9c-4c78-a988-b37108c68330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:17:08 devstack cinder-volume[86856]: DEBUG cinder.image.glance [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Creating Keystone auth plugin from conf {{(pid=86856) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 06 17:17:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2990c00d-de9c-4c78-a988-b37108c68330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'baffa222-0540-494b-8557-e25f425666d6', 'volume_name': 'volume-baffa222-0540-494b-8557-e25f425666d6', 'volume_size': 1, 'image_id': '420ae2ee-253a-40a6-ad62-b130f2314d4a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/420ae2ee-253a-40a6-ad62-b130f2314d4a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '805e2cf12fa14002ae5dfa994733f868', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '420ae2ee-253a-40a6-ad62-b130f2314d4a', 'created_at': datetime.datetime(2026, 11, 6, 15, 57, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 15, 57, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/420ae2ee-253a-40a6-ad62-b130f2314d4a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x71da6700f710>}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:17:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (148617a4-e256-4967-a687-a6bbd67bf608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:17:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (148617a4-e256-4967-a687-a6bbd67bf608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:17:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c4e0a2e-f166-468d-b155-c0be847cf6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:17:09 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Volume baffa222-0540-494b-8557-e25f425666d6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-baffa222-0540-494b-8557-e25f425666d6', 'volume_size': 1, 'image_id': '420ae2ee-253a-40a6-ad62-b130f2314d4a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/420ae2ee-253a-40a6-ad62-b130f2314d4a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '805e2cf12fa14002ae5dfa994733f868', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '420ae2ee-253a-40a6-ad62-b130f2314d4a', 'created_at': datetime.datetime(2026, 11, 6, 15, 57, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 15, 57, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/420ae2ee-253a-40a6-ad62-b130f2314d4a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x71da6700f710>}
Nov 06 17:17:09 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Trying to clone baffa222-0540-494b-8557-e25f425666d6 from image 420ae2ee-253a-40a6-ad62-b130f2314d4a at location (None, [{'url': 'file:///opt/stack/data/glance/images/420ae2ee-253a-40a6-ad62-b130f2314d4a', 'metadata': {}}]). {{(pid=86856) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 06 17:17:09 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_rv2b57umdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86856) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 06 17:17:09 devstack cinder-volume[86856]: INFO cinder.image.image_utils [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Image download 20.69 MB at 20.69 MB/s
Nov 06 17:17:09 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[0196b1cc-0fa1-4c62-a0ad-60d84cbf8dbf]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:17:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_rv2b57umdevstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:17:09 devstack sudo[101049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_rv2b57umdevstack@QuobyteHD
Nov 06 17:17:09 devstack sudo[101049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:17:10 devstack sudo[101049]: pam_unix(sudo:session): session closed for user root
Nov 06 17:17:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_rv2b57umdevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:17:10 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Temporary image 420ae2ee-253a-40a6-ad62-b130f2314d4a is fetched for user fa694e4e34e54b5cb680c13bfc344361. {{(pid=86856) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 06 17:17:10 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55bc54c-c2dd-4506-9e34-d23510ce37e3]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:17:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_rv2b57umdevstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:17:10 devstack sudo[101055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_rv2b57umdevstack@QuobyteHD
Nov 06 17:17:10 devstack sudo[101055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:17:10 devstack sudo[101055]: pam_unix(sudo:session): session closed for user root
Nov 06 17:17:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_rv2b57umdevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:17:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:17:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:17:10 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-317511845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baffa222-0540-494b-8557-e25f425666d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='512304277a9c4bb4ac5c18ee02221929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:17:09Z,use_quota=True,user_id='fa694e4e34e54b5cb680c13bfc344361',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:17:10 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Creating volume baffa222-0540-494b-8557-e25f425666d6 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:17:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:17:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:17:10 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:17:10 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:17:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:17:10 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:17:10 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:17:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-baffa222-0540-494b-8557-e25f425666d6 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:17:10 devstack sudo[101060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-baffa222-0540-494b-8557-e25f425666d6 1073741824
Nov 06 17:17:10 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:17:11 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root
Nov 06 17:17:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-baffa222-0540-494b-8557-e25f425666d6 1073741824" returned: 0 in 0.488s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:17:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-baffa222-0540-494b-8557-e25f425666d6 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:17:11 devstack sudo[101065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-baffa222-0540-494b-8557-e25f425666d6
Nov 06 17:17:11 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:17:11 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root
Nov 06 17:17:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-baffa222-0540-494b-8557-e25f425666d6" returned: 0 in 0.265s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:17:11 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:17:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:17:11 devstack cinder-volume[86856]: DEBUG cinder.volume.volume_utils [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Attempting download of 420ae2ee-253a-40a6-ad62-b130f2314d4a ((None, [{'url': 'file:///opt/stack/data/glance/images/420ae2ee-253a-40a6-ad62-b130f2314d4a', 'metadata': {}}])) to volume baffa222-0540-494b-8557-e25f425666d6. {{(pid=86856) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 06 17:17:11 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[0733f6e9-c2d0-40d9-9179-7027151a35d0]: (4, 'raw') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:17:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_420ae2ee-253a-40a6-ad62-b130f2314d4a_4rkt14ud {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:17:11 devstack sudo[101069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_420ae2ee-253a-40a6-ad62-b130f2314d4a_4rkt14ud
Nov 06 17:17:11 devstack sudo[101069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:17:11 devstack sudo[101069]: pam_unix(sudo:session): session closed for user root
Nov 06 17:17:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_420ae2ee-253a-40a6-ad62-b130f2314d4a_4rkt14ud" returned: 0 in 0.377s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:17:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_420ae2ee-253a-40a6-ad62-b130f2314d4a_4rkt14ud {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:17:12 devstack sudo[101073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_420ae2ee-253a-40a6-ad62-b130f2314d4a_4rkt14ud
Nov 06 17:17:12 devstack sudo[101073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:17:12 devstack sudo[101073]: pam_unix(sudo:session): session closed for user root
Nov 06 17:17:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_420ae2ee-253a-40a6-ad62-b130f2314d4a_4rkt14ud" returned: 1 in 0.348s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:17:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_420ae2ee-253a-40a6-ad62-b130f2314d4a_4rkt14ud' failed. Not Retrying. {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 17:17:12 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7926486-5865-4919-9a0a-e1cc80c3cd49]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:17:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_rv2b57umdevstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:17:12 devstack sudo[101077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_rv2b57umdevstack@QuobyteHD
Nov 06 17:17:12 devstack sudo[101077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:17:12 devstack sudo[101077]: pam_unix(sudo:session): session closed for user root
Nov 06 17:17:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_rv2b57umdevstack@QuobyteHD" returned: 0 in 0.328s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:17:12 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] 420ae2ee-253a-40a6-ad62-b130f2314d4a was qcow2, converting to qcow2 {{(pid=86856) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 06 17:17:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_rv2b57umdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-baffa222-0540-494b-8557-e25f425666d6 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:17:12 devstack sudo[101082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_rv2b57umdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-baffa222-0540-494b-8557-e25f425666d6
Nov 06 17:17:12 devstack sudo[101082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:17:14 devstack sudo[101082]: pam_unix(sudo:session): session closed for user root
Nov 06 17:17:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_rv2b57umdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-baffa222-0540-494b-8557-e25f425666d6" returned: 0 in 2.351s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:17:14 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_420ae2ee-253a-40a6-ad62-b130f2314d4a_rv2b57umdevstack@QuobyteHD, size 112.00 MB, duration 2.35 sec, destination /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-baffa222-0540-494b-8557-e25f425666d6 {{(pid=86856) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 17:17:14 devstack cinder-volume[86856]: INFO cinder.image.image_utils [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Converted 112.00 MB image at 47.61 MB/s
Nov 06 17:17:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-baffa222-0540-494b-8557-e25f425666d6 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:17:14 devstack sudo[101089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-baffa222-0540-494b-8557-e25f425666d6 1G
Nov 06 17:17:14 devstack sudo[101089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:17:15 devstack sudo[101089]: pam_unix(sudo:session): session closed for user root
Nov 06 17:17:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-baffa222-0540-494b-8557-e25f425666d6 1G" returned: 0 in 0.360s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:17:15 devstack cinder-volume[86856]: DEBUG cinder.volume.volume_utils [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Downloaded image 420ae2ee-253a-40a6-ad62-b130f2314d4a ((None, [{'url': 'file:///opt/stack/data/glance/images/420ae2ee-253a-40a6-ad62-b130f2314d4a', 'metadata': {}}])) to volume baffa222-0540-494b-8557-e25f425666d6 successfully. {{(pid=86856) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 06 17:17:15 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Temporary image 420ae2ee-253a-40a6-ad62-b130f2314d4a for user fa694e4e34e54b5cb680c13bfc344361 is deleted. {{(pid=86856) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 06 17:17:15 devstack cinder-volume[86856]: DEBUG cinder.volume.volume_utils [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Marking volume baffa222-0540-494b-8557-e25f425666d6 as bootable. {{(pid=86856) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 06 17:17:15 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Copying metadata from image 420ae2ee-253a-40a6-ad62-b130f2314d4a to baffa222-0540-494b-8557-e25f425666d6. {{(pid=86856) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 06 17:17:15 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Creating volume glance metadata for volume baffa222-0540-494b-8557-e25f425666d6 backed by image 420ae2ee-253a-40a6-ad62-b130f2314d4a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '420ae2ee-253a-40a6-ad62-b130f2314d4a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86856) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 06 17:17:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c4e0a2e-f166-468d-b155-c0be847cf6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baffa222-0540-494b-8557-e25f425666d6', 'volume_size': 1, 'image_id': '420ae2ee-253a-40a6-ad62-b130f2314d4a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/420ae2ee-253a-40a6-ad62-b130f2314d4a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '805e2cf12fa14002ae5dfa994733f868', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '420ae2ee-253a-40a6-ad62-b130f2314d4a', 'created_at': datetime.datetime(2026, 11, 6, 15, 57, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 15, 57, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/420ae2ee-253a-40a6-ad62-b130f2314d4a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x71da6700f710>}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:17:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89dda42e-a067-4d1d-9410-35cb7d0d1a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:17:15 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Volume volume-baffa222-0540-494b-8557-e25f425666d6 (baffa222-0540-494b-8557-e25f425666d6): created successfully
Nov 06 17:17:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89dda42e-a067-4d1d-9410-35cb7d0d1a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:17:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Flow 'volume_create_manager' (5270ea81-90b9-4d20-b930-a85f8f6f65fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:17:15 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-41bb38c9-4323-45ed-9180-50db5b8e62e2 tempest-TestShelveInstance-1986826358 None] Created volume successfully.
Nov 06 17:17:18 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-0fc7c74a-ec37-4a35-93d4-4ec2071d6008 req-4ae7de1c-2282-432c-8b4a-9ee7b9082b11 tempest-TestMinimumBasicScenario-906141890 None] Terminate volume connection completed successfully.
Nov 06 17:17:18 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-0fc7c74a-ec37-4a35-93d4-4ec2071d6008 req-4ae7de1c-2282-432c-8b4a-9ee7b9082b11 tempest-TestMinimumBasicScenario-906141890 None] Deleting attachment 5dcabac7-02e6-434f-b970-336e18003fdc. {{(pid=86856) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 17:17:19 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9b076372-a622-4e7a-8717-cefde85e12a3 tempest-TestMinimumBasicScenario-906141890 None] Acquiring lock "cinder-9fa71296-b234-403a-afe7-20c6a009567f-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:17:19 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9b076372-a622-4e7a-8717-cefde85e12a3 tempest-TestMinimumBasicScenario-906141890 None] Lock "cinder-9fa71296-b234-403a-afe7-20c6a009567f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:17:19 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9b076372-a622-4e7a-8717-cefde85e12a3 tempest-TestMinimumBasicScenario-906141890 None] Acquiring lock "cinder-quobyte-9fa71296-b234-403a-afe7-20c6a009567f" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:17:19 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9b076372-a622-4e7a-8717-cefde85e12a3 tempest-TestMinimumBasicScenario-906141890 None] Lock "cinder-quobyte-9fa71296-b234-403a-afe7-20c6a009567f" acquired by "delete_volume" :: waited 0.030s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:17:19 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[946d1c06-706c-4032-891c-1f1bb2978c08]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:17:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9b076372-a622-4e7a-8717-cefde85e12a3 tempest-TestMinimumBasicScenario-906141890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9fa71296-b234-403a-afe7-20c6a009567f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:17:19 devstack sudo[101115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9fa71296-b234-403a-afe7-20c6a009567f
Nov 06 17:17:19 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:17:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-fd19c5c1-13e8-45b5-b0ce-4478da4a7ad5 req-268d02cf-94da-4497-a0fa-843d86b21e7d tempest-TestShelveInstance-1986826358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:17:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-fd19c5c1-13e8-45b5-b0ce-4478da4a7ad5 req-268d02cf-94da-4497-a0fa-843d86b21e7d tempest-TestShelveInstance-1986826358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:17:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-fd19c5c1-13e8-45b5-b0ce-4478da4a7ad5 req-268d02cf-94da-4497-a0fa-843d86b21e7d tempest-TestShelveInstance-1986826358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:17:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-fd19c5c1-13e8-45b5-b0ce-4478da4a7ad5 req-268d02cf-94da-4497-a0fa-843d86b21e7d tempest-TestShelveInstance-1986826358 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316', 'name': 'volume-baffa222-0540-494b-8557-e25f425666d6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d494c10-8981-48ec-b6ed-7ce32e705a98', 'enforce_multipath': True} {{(pid=86856) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 17:17:20 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-fd19c5c1-13e8-45b5-b0ce-4478da4a7ad5 req-268d02cf-94da-4497-a0fa-843d86b21e7d tempest-TestShelveInstance-1986826358 None] attachment_update completed successfully.
Nov 06 17:17:20 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root
Nov 06 17:17:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9b076372-a622-4e7a-8717-cefde85e12a3 tempest-TestMinimumBasicScenario-906141890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9fa71296-b234-403a-afe7-20c6a009567f" returned: 0 in 0.677s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:17:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9b076372-a622-4e7a-8717-cefde85e12a3 tempest-TestMinimumBasicScenario-906141890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9fa71296-b234-403a-afe7-20c6a009567f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:17:20 devstack sudo[101122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9fa71296-b234-403a-afe7-20c6a009567f
Nov 06 17:17:20 devstack sudo[101122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:17:20 devstack sudo[101122]: pam_unix(sudo:session): session closed for user root
Nov 06 17:17:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9b076372-a622-4e7a-8717-cefde85e12a3 tempest-TestMinimumBasicScenario-906141890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9fa71296-b234-403a-afe7-20c6a009567f" returned: 0 in 0.306s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:17:20 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9b076372-a622-4e7a-8717-cefde85e12a3 tempest-TestMinimumBasicScenario-906141890 None] Lock "cinder-quobyte-9fa71296-b234-403a-afe7-20c6a009567f" released by "delete_volume" :: held 1.052s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:17:20 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-9b076372-a622-4e7a-8717-cefde85e12a3 tempest-TestMinimumBasicScenario-906141890 None] Created reservations ['7445ee67-9530-4c3c-99ee-7b3bc57b6a76', 'd24038cb-530d-4879-8ace-345091f9081b', '1d174fa8-a94a-4fca-b7fa-fde67ddf53ab', '476bb5e5-752f-4326-9b23-72106c79fbb3'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:17:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9b076372-a622-4e7a-8717-cefde85e12a3 tempest-TestMinimumBasicScenario-906141890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:17:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9b076372-a622-4e7a-8717-cefde85e12a3 tempest-TestMinimumBasicScenario-906141890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:17:20 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-9b076372-a622-4e7a-8717-cefde85e12a3 tempest-TestMinimumBasicScenario-906141890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:17:20 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-9b076372-a622-4e7a-8717-cefde85e12a3 tempest-TestMinimumBasicScenario-906141890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:17:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9b076372-a622-4e7a-8717-cefde85e12a3 tempest-TestMinimumBasicScenario-906141890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:17:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9b076372-a622-4e7a-8717-cefde85e12a3 tempest-TestMinimumBasicScenario-906141890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:17:20 devstack sudo[101125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:17:20 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:17:21 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root
Nov 06 17:17:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9b076372-a622-4e7a-8717-cefde85e12a3 tempest-TestMinimumBasicScenario-906141890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.259s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:17:21 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-9b076372-a622-4e7a-8717-cefde85e12a3 tempest-TestMinimumBasicScenario-906141890 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:17:21 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-9b076372-a622-4e7a-8717-cefde85e12a3 tempest-TestMinimumBasicScenario-906141890 None] Deleted volume successfully.
Nov 06 17:17:21 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9b076372-a622-4e7a-8717-cefde85e12a3 tempest-TestMinimumBasicScenario-906141890 None] Lock "cinder-9fa71296-b234-403a-afe7-20c6a009567f-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:17:30 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:UPDATE=146,cinder:SELECT=105,cinder:INSERT=43,cinder:DELETE=15 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:17:31 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=110,cinder:UPDATE=133,cinder:DELETE=10,cinder:INSERT=31 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:17:42 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:17:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:17:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:17:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:17:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:17:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:17:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:17:42 devstack sudo[101658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:17:42 devstack sudo[101658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:17:42 devstack sudo[101658]: pam_unix(sudo:session): session closed for user root
Nov 06 17:17:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.258s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:17:42 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:17:42 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager._thread_info {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:17:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread count: 28 {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 17:17:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread info: [<_MainThread(MainThread, started 125183137599616)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125183027608256)>, <Thread(Thread-3 (stat_writer), started daemon 125183025243776)>, <Thread(Rabbit-heartbeat, started daemon 125183023512896)>, <Thread(Thread-5 (_runner), started daemon 125183023357120)>, <Thread(Thread-7 (_runner), started daemon 125183021306496)>, <Thread(fd_logger, started daemon 125183018711616)>, <Thread(privsep_reader, started daemon 125183017484224)>, <Thread(tpool_thread_0, started daemon 125183013742272)>, <Thread(tpool_thread_1, started daemon 125183005349568)>, <Thread(tpool_thread_2, started daemon 125182996956864)>, <Thread(tpool_thread_3, started daemon 125182988564160)>, <Thread(tpool_thread_4, started daemon 125182980171456)>, <Thread(tpool_thread_5, started daemon 125182971778752)>, <Thread(tpool_thread_6, started daemon 125182963386048)>, <Thread(tpool_thread_7, started daemon 125182954993344)>, <Thread(tpool_thread_8, started daemon 125182946600640)>, <Thread(tpool_thread_9, started daemon 125182938207936)>, <Thread(tpool_thread_10, started daemon 125182929815232)>, <Thread(tpool_thread_11, started daemon 125182921422528)>, <Thread(tpool_thread_12, started daemon 125182913013440)>, <Thread(tpool_thread_13, started daemon 125182904604352)>, <Thread(tpool_thread_14, started daemon 125182896195264)>, <Thread(tpool_thread_15, started daemon 125182887786176)>, <Thread(tpool_thread_16, started daemon 125182879377088)>, <Thread(tpool_thread_17, started daemon 125182870968000)>, <Thread(tpool_thread_18, started daemon 125182862558912)>, <Thread(tpool_thread_19, started daemon 125182854149824)>] {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 17:17:44 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:17:54 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-076ef825-48e0-4fc3-b2e2-4f60db48946c req-158296e4-a342-49e9-af93-212a1f72f36f tempest-TestShelveInstance-1986826358 None] Terminate volume connection completed successfully.
Nov 06 17:17:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-076ef825-48e0-4fc3-b2e2-4f60db48946c req-158296e4-a342-49e9-af93-212a1f72f36f tempest-TestShelveInstance-1986826358 None] Deleting attachment 3d494c10-8981-48ec-b6ed-7ce32e705a98. {{(pid=86856) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 17:17:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-e5bc9113-4052-496b-8746-fe8c52157234 req-34fc7dcb-0912-4fbc-bab9-1a882201d299 tempest-TestShelveInstance-1986826358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:17:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-e5bc9113-4052-496b-8746-fe8c52157234 req-34fc7dcb-0912-4fbc-bab9-1a882201d299 tempest-TestShelveInstance-1986826358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:17:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-e5bc9113-4052-496b-8746-fe8c52157234 req-34fc7dcb-0912-4fbc-bab9-1a882201d299 tempest-TestShelveInstance-1986826358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:17:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-e5bc9113-4052-496b-8746-fe8c52157234 req-34fc7dcb-0912-4fbc-bab9-1a882201d299 tempest-TestShelveInstance-1986826358 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316', 'name': 'volume-baffa222-0540-494b-8557-e25f425666d6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ccf4f7a1-2ccc-4efe-8e7d-5a4c2e1fba5d', 'enforce_multipath': True} {{(pid=86856) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 17:17:58 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-e5bc9113-4052-496b-8746-fe8c52157234 req-34fc7dcb-0912-4fbc-bab9-1a882201d299 tempest-TestShelveInstance-1986826358 None] attachment_update completed successfully.
Nov 06 17:17:58 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1ff48d7-e4b6-4645-86f5-3b5241eebfdb tempest-TestImageHashVerification-1415369233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:17:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e1ff48d7-e4b6-4645-86f5-3b5241eebfdb tempest-TestImageHashVerification-1415369233 None] Flow 'volume_create_manager' (fef252da-95f6-40a9-9a81-fdf87c6712b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:17:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e1ff48d7-e4b6-4645-86f5-3b5241eebfdb tempest-TestImageHashVerification-1415369233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (374a023d-9419-4694-a39b-85e91b67f8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:17:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e1ff48d7-e4b6-4645-86f5-3b5241eebfdb tempest-TestImageHashVerification-1415369233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (374a023d-9419-4694-a39b-85e91b67f8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-49646699',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b57bd88d-4d4e-4bff-87e3-91bca6c0d238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab7b32415b0c4b78af932114acc206a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:17:58Z,use_quota=True,user_id='bb39f9dda1c64281bdc71d91e764a07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:17:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e1ff48d7-e4b6-4645-86f5-3b5241eebfdb tempest-TestImageHashVerification-1415369233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56d76661-8fe2-43f1-bfa1-f31b647c676c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:17:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e1ff48d7-e4b6-4645-86f5-3b5241eebfdb tempest-TestImageHashVerification-1415369233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56d76661-8fe2-43f1-bfa1-f31b647c676c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:17:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e1ff48d7-e4b6-4645-86f5-3b5241eebfdb tempest-TestImageHashVerification-1415369233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab701e5a-9349-4a11-9974-24ccc234c169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:17:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e1ff48d7-e4b6-4645-86f5-3b5241eebfdb tempest-TestImageHashVerification-1415369233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab701e5a-9349-4a11-9974-24ccc234c169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b57bd88d-4d4e-4bff-87e3-91bca6c0d238', 'volume_name': 'volume-b57bd88d-4d4e-4bff-87e3-91bca6c0d238', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:17:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e1ff48d7-e4b6-4645-86f5-3b5241eebfdb tempest-TestImageHashVerification-1415369233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95e930a3-a13e-4b85-b061-51d6864bfada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:17:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e1ff48d7-e4b6-4645-86f5-3b5241eebfdb tempest-TestImageHashVerification-1415369233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95e930a3-a13e-4b85-b061-51d6864bfada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:17:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e1ff48d7-e4b6-4645-86f5-3b5241eebfdb tempest-TestImageHashVerification-1415369233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e00687f1-0578-4907-ab74-2e3427e0b4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:17:58 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-e1ff48d7-e4b6-4645-86f5-3b5241eebfdb tempest-TestImageHashVerification-1415369233 None] Volume b57bd88d-4d4e-4bff-87e3-91bca6c0d238: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b57bd88d-4d4e-4bff-87e3-91bca6c0d238', 'volume_size': 1}
Nov 06 17:17:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e1ff48d7-e4b6-4645-86f5-3b5241eebfdb tempest-TestImageHashVerification-1415369233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:17:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e1ff48d7-e4b6-4645-86f5-3b5241eebfdb tempest-TestImageHashVerification-1415369233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:17:58 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e1ff48d7-e4b6-4645-86f5-3b5241eebfdb tempest-TestImageHashVerification-1415369233 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-49646699',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b57bd88d-4d4e-4bff-87e3-91bca6c0d238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab7b32415b0c4b78af932114acc206a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:17:58Z,use_quota=True,user_id='bb39f9dda1c64281bdc71d91e764a07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:17:58 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-e1ff48d7-e4b6-4645-86f5-3b5241eebfdb tempest-TestImageHashVerification-1415369233 None] Creating volume b57bd88d-4d4e-4bff-87e3-91bca6c0d238 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:17:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e1ff48d7-e4b6-4645-86f5-3b5241eebfdb tempest-TestImageHashVerification-1415369233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:17:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e1ff48d7-e4b6-4645-86f5-3b5241eebfdb tempest-TestImageHashVerification-1415369233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:17:58 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e1ff48d7-e4b6-4645-86f5-3b5241eebfdb tempest-TestImageHashVerification-1415369233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:17:58 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e1ff48d7-e4b6-4645-86f5-3b5241eebfdb tempest-TestImageHashVerification-1415369233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:17:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e1ff48d7-e4b6-4645-86f5-3b5241eebfdb tempest-TestImageHashVerification-1415369233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:17:58 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e1ff48d7-e4b6-4645-86f5-3b5241eebfdb tempest-TestImageHashVerification-1415369233 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:17:58 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-e1ff48d7-e4b6-4645-86f5-3b5241eebfdb tempest-TestImageHashVerification-1415369233 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:17:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e1ff48d7-e4b6-4645-86f5-3b5241eebfdb tempest-TestImageHashVerification-1415369233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b57bd88d-4d4e-4bff-87e3-91bca6c0d238 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:17:58 devstack sudo[101778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b57bd88d-4d4e-4bff-87e3-91bca6c0d238 1073741824
Nov 06 17:17:58 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:17:59 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root
Nov 06 17:17:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e1ff48d7-e4b6-4645-86f5-3b5241eebfdb tempest-TestImageHashVerification-1415369233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b57bd88d-4d4e-4bff-87e3-91bca6c0d238 1073741824" returned: 0 in 0.482s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:17:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e1ff48d7-e4b6-4645-86f5-3b5241eebfdb tempest-TestImageHashVerification-1415369233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b57bd88d-4d4e-4bff-87e3-91bca6c0d238 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:17:59 devstack sudo[101783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b57bd88d-4d4e-4bff-87e3-91bca6c0d238
Nov 06 17:17:59 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:17:59 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root
Nov 06 17:17:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e1ff48d7-e4b6-4645-86f5-3b5241eebfdb tempest-TestImageHashVerification-1415369233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b57bd88d-4d4e-4bff-87e3-91bca6c0d238" returned: 0 in 0.342s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:17:59 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e1ff48d7-e4b6-4645-86f5-3b5241eebfdb tempest-TestImageHashVerification-1415369233 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:17:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e1ff48d7-e4b6-4645-86f5-3b5241eebfdb tempest-TestImageHashVerification-1415369233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:17:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e1ff48d7-e4b6-4645-86f5-3b5241eebfdb tempest-TestImageHashVerification-1415369233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e00687f1-0578-4907-ab74-2e3427e0b4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b57bd88d-4d4e-4bff-87e3-91bca6c0d238', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:17:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e1ff48d7-e4b6-4645-86f5-3b5241eebfdb tempest-TestImageHashVerification-1415369233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e31aa2b-9373-4825-b553-e420517e61c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:17:59 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-e1ff48d7-e4b6-4645-86f5-3b5241eebfdb tempest-TestImageHashVerification-1415369233 None] Volume volume-b57bd88d-4d4e-4bff-87e3-91bca6c0d238 (b57bd88d-4d4e-4bff-87e3-91bca6c0d238): created successfully
Nov 06 17:17:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e1ff48d7-e4b6-4645-86f5-3b5241eebfdb tempest-TestImageHashVerification-1415369233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e31aa2b-9373-4825-b553-e420517e61c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:17:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e1ff48d7-e4b6-4645-86f5-3b5241eebfdb tempest-TestImageHashVerification-1415369233 None] Flow 'volume_create_manager' (fef252da-95f6-40a9-9a81-fdf87c6712b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:17:59 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-e1ff48d7-e4b6-4645-86f5-3b5241eebfdb tempest-TestImageHashVerification-1415369233 None] Created volume successfully.
Nov 06 17:18:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1244a5a5-9282-460e-8efc-e90ad108741a tempest-TestImageHashVerification-1415369233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:18:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1244a5a5-9282-460e-8efc-e90ad108741a tempest-TestImageHashVerification-1415369233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:18:02 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b37393c-0dfb-4bef-a8e5-a38c5cffb378]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:18:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1244a5a5-9282-460e-8efc-e90ad108741a tempest-TestImageHashVerification-1415369233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b57bd88d-4d4e-4bff-87e3-91bca6c0d238 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:02 devstack sudo[102267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b57bd88d-4d4e-4bff-87e3-91bca6c0d238
Nov 06 17:18:02 devstack sudo[102267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:18:02 devstack sudo[102267]: pam_unix(sudo:session): session closed for user root
Nov 06 17:18:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1244a5a5-9282-460e-8efc-e90ad108741a tempest-TestImageHashVerification-1415369233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b57bd88d-4d4e-4bff-87e3-91bca6c0d238" returned: 0 in 0.368s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:18:02 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc098733-ada4-4a63-9a69-8d0cfd4b1e7a]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:18:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1244a5a5-9282-460e-8efc-e90ad108741a tempest-TestImageHashVerification-1415369233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b57bd88d-4d4e-4bff-87e3-91bca6c0d238 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:02 devstack sudo[102272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b57bd88d-4d4e-4bff-87e3-91bca6c0d238
Nov 06 17:18:02 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:18:03 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root
Nov 06 17:18:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1244a5a5-9282-460e-8efc-e90ad108741a tempest-TestImageHashVerification-1415369233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b57bd88d-4d4e-4bff-87e3-91bca6c0d238" returned: 0 in 0.404s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:18:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1244a5a5-9282-460e-8efc-e90ad108741a tempest-TestImageHashVerification-1415369233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b57bd88d-4d4e-4bff-87e3-91bca6c0d238 /opt/stack/data/cinder/conversion/b57bd88d-4d4e-4bff-87e3-91bca6c0d238.temp_image.ba9d2721-c89b-4722-b7ee-1fcb93e175c5338td2p9.img {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:03 devstack sudo[102279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b57bd88d-4d4e-4bff-87e3-91bca6c0d238 /opt/stack/data/cinder/conversion/b57bd88d-4d4e-4bff-87e3-91bca6c0d238.temp_image.ba9d2721-c89b-4722-b7ee-1fcb93e175c5338td2p9.img
Nov 06 17:18:03 devstack sudo[102279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:18:09 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=11,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:18:10 devstack sudo[102279]: pam_unix(sudo:session): session closed for user root
Nov 06 17:18:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1244a5a5-9282-460e-8efc-e90ad108741a tempest-TestImageHashVerification-1415369233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b57bd88d-4d4e-4bff-87e3-91bca6c0d238 /opt/stack/data/cinder/conversion/b57bd88d-4d4e-4bff-87e3-91bca6c0d238.temp_image.ba9d2721-c89b-4722-b7ee-1fcb93e175c5338td2p9.img" returned: 0 in 7.295s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:18:10 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4eaa72f-b5dd-4e47-813d-ff5a0c468c2e]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:18:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1244a5a5-9282-460e-8efc-e90ad108741a tempest-TestImageHashVerification-1415369233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b57bd88d-4d4e-4bff-87e3-91bca6c0d238 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:10 devstack sudo[102294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b57bd88d-4d4e-4bff-87e3-91bca6c0d238
Nov 06 17:18:10 devstack sudo[102294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:18:11 devstack sudo[102294]: pam_unix(sudo:session): session closed for user root
Nov 06 17:18:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1244a5a5-9282-460e-8efc-e90ad108741a tempest-TestImageHashVerification-1415369233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b57bd88d-4d4e-4bff-87e3-91bca6c0d238" returned: 0 in 0.547s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:18:11 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-1244a5a5-9282-460e-8efc-e90ad108741a tempest-TestImageHashVerification-1415369233 None] Image conversion details: src /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b57bd88d-4d4e-4bff-87e3-91bca6c0d238, size 1024.00 MB, duration 7.30 sec, destination /opt/stack/data/cinder/conversion/b57bd88d-4d4e-4bff-87e3-91bca6c0d238.temp_image.ba9d2721-c89b-4722-b7ee-1fcb93e175c5338td2p9.img {{(pid=86856) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 17:18:11 devstack cinder-volume[86856]: INFO cinder.image.image_utils [None req-1244a5a5-9282-460e-8efc-e90ad108741a tempest-TestImageHashVerification-1415369233 None] Converted 1024.00 MB image at 140.34 MB/s
Nov 06 17:18:11 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-1244a5a5-9282-460e-8efc-e90ad108741a tempest-TestImageHashVerification-1415369233 None] ba9d2721-c89b-4722-b7ee-1fcb93e175c5 was raw, no need to convert to raw {{(pid=86856) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Nov 06 17:18:21 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=1 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:18:21 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=10,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:18:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1244a5a5-9282-460e-8efc-e90ad108741a tempest-TestImageHashVerification-1415369233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.458s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:18:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1244a5a5-9282-460e-8efc-e90ad108741a tempest-TestImageHashVerification-1415369233 None] Uploaded volume to glance image-id: ba9d2721-c89b-4722-b7ee-1fcb93e175c5. {{(pid=86856) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 06 17:18:29 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-1244a5a5-9282-460e-8efc-e90ad108741a tempest-TestImageHashVerification-1415369233 None] Copy volume to image completed successfully.
Nov 06 17:18:30 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-71dfbf21-49b7-4fcc-8f96-83cf9550fa4f tempest-TestImageHashVerification-1415369233 None] Acquiring lock "cinder-b57bd88d-4d4e-4bff-87e3-91bca6c0d238-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:18:30 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-71dfbf21-49b7-4fcc-8f96-83cf9550fa4f tempest-TestImageHashVerification-1415369233 None] Lock "cinder-b57bd88d-4d4e-4bff-87e3-91bca6c0d238-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:18:31 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-71dfbf21-49b7-4fcc-8f96-83cf9550fa4f tempest-TestImageHashVerification-1415369233 None] Acquiring lock "cinder-quobyte-b57bd88d-4d4e-4bff-87e3-91bca6c0d238" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:18:31 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-71dfbf21-49b7-4fcc-8f96-83cf9550fa4f tempest-TestImageHashVerification-1415369233 None] Lock "cinder-quobyte-b57bd88d-4d4e-4bff-87e3-91bca6c0d238" acquired by "delete_volume" :: waited 0.020s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:18:31 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[502a4d60-7c74-4b39-a54d-5ccce24543ef]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:18:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-71dfbf21-49b7-4fcc-8f96-83cf9550fa4f tempest-TestImageHashVerification-1415369233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b57bd88d-4d4e-4bff-87e3-91bca6c0d238 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:31 devstack sudo[102340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b57bd88d-4d4e-4bff-87e3-91bca6c0d238
Nov 06 17:18:31 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:18:31 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root
Nov 06 17:18:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-71dfbf21-49b7-4fcc-8f96-83cf9550fa4f tempest-TestImageHashVerification-1415369233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b57bd88d-4d4e-4bff-87e3-91bca6c0d238" returned: 0 in 0.364s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:18:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-71dfbf21-49b7-4fcc-8f96-83cf9550fa4f tempest-TestImageHashVerification-1415369233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b57bd88d-4d4e-4bff-87e3-91bca6c0d238 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:31 devstack sudo[102346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b57bd88d-4d4e-4bff-87e3-91bca6c0d238
Nov 06 17:18:31 devstack sudo[102346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:18:31 devstack sudo[102346]: pam_unix(sudo:session): session closed for user root
Nov 06 17:18:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-71dfbf21-49b7-4fcc-8f96-83cf9550fa4f tempest-TestImageHashVerification-1415369233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b57bd88d-4d4e-4bff-87e3-91bca6c0d238" returned: 0 in 0.246s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:18:31 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-71dfbf21-49b7-4fcc-8f96-83cf9550fa4f tempest-TestImageHashVerification-1415369233 None] Lock "cinder-quobyte-b57bd88d-4d4e-4bff-87e3-91bca6c0d238" released by "delete_volume" :: held 0.649s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:18:31 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-71dfbf21-49b7-4fcc-8f96-83cf9550fa4f tempest-TestImageHashVerification-1415369233 None] Created reservations ['46575b0a-4098-44c9-894d-13c348e09e11', '320eacb2-42c1-4244-9f11-ebb11c244a25', '4f62f301-81ed-4c08-b788-f51e4587fe04', '1bccdc5e-b6b7-48e7-b6e7-3b7b94e3cd98'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:18:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-71dfbf21-49b7-4fcc-8f96-83cf9550fa4f tempest-TestImageHashVerification-1415369233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:18:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-71dfbf21-49b7-4fcc-8f96-83cf9550fa4f tempest-TestImageHashVerification-1415369233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:18:31 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-71dfbf21-49b7-4fcc-8f96-83cf9550fa4f tempest-TestImageHashVerification-1415369233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:18:31 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-71dfbf21-49b7-4fcc-8f96-83cf9550fa4f tempest-TestImageHashVerification-1415369233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:18:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-71dfbf21-49b7-4fcc-8f96-83cf9550fa4f tempest-TestImageHashVerification-1415369233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:18:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-71dfbf21-49b7-4fcc-8f96-83cf9550fa4f tempest-TestImageHashVerification-1415369233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:31 devstack sudo[102350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:18:31 devstack sudo[102350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:18:32 devstack sudo[102350]: pam_unix(sudo:session): session closed for user root
Nov 06 17:18:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-71dfbf21-49b7-4fcc-8f96-83cf9550fa4f tempest-TestImageHashVerification-1415369233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.249s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:18:32 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-71dfbf21-49b7-4fcc-8f96-83cf9550fa4f tempest-TestImageHashVerification-1415369233 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:18:32 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-71dfbf21-49b7-4fcc-8f96-83cf9550fa4f tempest-TestImageHashVerification-1415369233 None] Deleted volume successfully.
Nov 06 17:18:32 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-71dfbf21-49b7-4fcc-8f96-83cf9550fa4f tempest-TestImageHashVerification-1415369233 None] Lock "cinder-b57bd88d-4d4e-4bff-87e3-91bca6c0d238-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:18:41 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=4,cinder:UPDATE=10,cinder:INSERT=3 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:18:42 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:18:42 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:18:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:18:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:18:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:18:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:18:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:18:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:42 devstack sudo[102388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:18:42 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:18:42 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-866ab5ef-ee4b-4ccb-abe1-2dd7f8e12807 req-8c5ced04-9748-4057-bee2-a52f09cc11c6 tempest-TestShelveInstance-1986826358 None] Terminate volume connection completed successfully.
Nov 06 17:18:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-866ab5ef-ee4b-4ccb-abe1-2dd7f8e12807 req-8c5ced04-9748-4057-bee2-a52f09cc11c6 tempest-TestShelveInstance-1986826358 None] Deleting attachment ccf4f7a1-2ccc-4efe-8e7d-5a4c2e1fba5d. {{(pid=86856) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 17:18:42 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root
Nov 06 17:18:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.309s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:18:42 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:18:42 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager._thread_info {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:18:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread count: 28 {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 17:18:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread info: [<_MainThread(MainThread, started 125183137599616)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125183027608256)>, <Thread(Thread-3 (stat_writer), started daemon 125183025243776)>, <Thread(Rabbit-heartbeat, started daemon 125183023512896)>, <Thread(Thread-5 (_runner), started daemon 125183023357120)>, <Thread(Thread-7 (_runner), started daemon 125183021306496)>, <Thread(fd_logger, started daemon 125183018711616)>, <Thread(privsep_reader, started daemon 125183017484224)>, <Thread(tpool_thread_0, started daemon 125183013742272)>, <Thread(tpool_thread_1, started daemon 125183005349568)>, <Thread(tpool_thread_2, started daemon 125182996956864)>, <Thread(tpool_thread_3, started daemon 125182988564160)>, <Thread(tpool_thread_4, started daemon 125182980171456)>, <Thread(tpool_thread_5, started daemon 125182971778752)>, <Thread(tpool_thread_6, started daemon 125182963386048)>, <Thread(tpool_thread_7, started daemon 125182954993344)>, <Thread(tpool_thread_8, started daemon 125182946600640)>, <Thread(tpool_thread_9, started daemon 125182938207936)>, <Thread(tpool_thread_10, started daemon 125182929815232)>, <Thread(tpool_thread_11, started daemon 125182921422528)>, <Thread(tpool_thread_12, started daemon 125182913013440)>, <Thread(tpool_thread_13, started daemon 125182904604352)>, <Thread(tpool_thread_14, started daemon 125182896195264)>, <Thread(tpool_thread_15, started daemon 125182887786176)>, <Thread(tpool_thread_16, started daemon 125182879377088)>, <Thread(tpool_thread_17, started daemon 125182870968000)>, <Thread(tpool_thread_18, started daemon 125182862558912)>, <Thread(tpool_thread_19, started daemon 125182854149824)>] {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 17:18:42 devstack cinder-volume[86856]: DEBUG cinder.coordination [req-866ab5ef-ee4b-4ccb-abe1-2dd7f8e12807 req-03d3beee-4feb-48fb-b2b3-de68ef98421f tempest-TestShelveInstance-1986826358 None] Acquiring lock "cinder-baffa222-0540-494b-8557-e25f425666d6-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:18:42 devstack cinder-volume[86856]: DEBUG cinder.coordination [req-866ab5ef-ee4b-4ccb-abe1-2dd7f8e12807 req-03d3beee-4feb-48fb-b2b3-de68ef98421f tempest-TestShelveInstance-1986826358 None] Lock "cinder-baffa222-0540-494b-8557-e25f425666d6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:18:42 devstack cinder-volume[86856]: DEBUG cinder.coordination [req-866ab5ef-ee4b-4ccb-abe1-2dd7f8e12807 req-03d3beee-4feb-48fb-b2b3-de68ef98421f tempest-TestShelveInstance-1986826358 None] Acquiring lock "cinder-quobyte-baffa222-0540-494b-8557-e25f425666d6" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:18:42 devstack cinder-volume[86856]: DEBUG cinder.coordination [req-866ab5ef-ee4b-4ccb-abe1-2dd7f8e12807 req-03d3beee-4feb-48fb-b2b3-de68ef98421f tempest-TestShelveInstance-1986826358 None] Lock "cinder-quobyte-baffa222-0540-494b-8557-e25f425666d6" acquired by "delete_volume" :: waited 0.026s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:18:43 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0e209a-69af-46c3-99f5-45fe37396600]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:18:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-866ab5ef-ee4b-4ccb-abe1-2dd7f8e12807 req-03d3beee-4feb-48fb-b2b3-de68ef98421f tempest-TestShelveInstance-1986826358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-baffa222-0540-494b-8557-e25f425666d6 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:43 devstack sudo[102391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-baffa222-0540-494b-8557-e25f425666d6
Nov 06 17:18:43 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:18:43 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root
Nov 06 17:18:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-866ab5ef-ee4b-4ccb-abe1-2dd7f8e12807 req-03d3beee-4feb-48fb-b2b3-de68ef98421f tempest-TestShelveInstance-1986826358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-baffa222-0540-494b-8557-e25f425666d6" returned: 0 in 0.465s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:18:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-866ab5ef-ee4b-4ccb-abe1-2dd7f8e12807 req-03d3beee-4feb-48fb-b2b3-de68ef98421f tempest-TestShelveInstance-1986826358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-baffa222-0540-494b-8557-e25f425666d6 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:43 devstack sudo[102396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-baffa222-0540-494b-8557-e25f425666d6
Nov 06 17:18:43 devstack sudo[102396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:18:43 devstack sudo[102396]: pam_unix(sudo:session): session closed for user root
Nov 06 17:18:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-866ab5ef-ee4b-4ccb-abe1-2dd7f8e12807 req-03d3beee-4feb-48fb-b2b3-de68ef98421f tempest-TestShelveInstance-1986826358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-baffa222-0540-494b-8557-e25f425666d6" returned: 0 in 0.262s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:18:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [req-866ab5ef-ee4b-4ccb-abe1-2dd7f8e12807 req-03d3beee-4feb-48fb-b2b3-de68ef98421f tempest-TestShelveInstance-1986826358 None] Lock "cinder-quobyte-baffa222-0540-494b-8557-e25f425666d6" released by "delete_volume" :: held 0.789s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:18:43 devstack cinder-volume[86856]: DEBUG cinder.quota [req-866ab5ef-ee4b-4ccb-abe1-2dd7f8e12807 req-03d3beee-4feb-48fb-b2b3-de68ef98421f tempest-TestShelveInstance-1986826358 None] Created reservations ['bafc7450-9ec9-48e9-9e94-40af16208e92', 'c4132c64-41a9-4a81-9cbd-584f717edaa9', '1e68217c-21da-4b6d-931f-30a060704ad5', '6300269d-15db-4543-9eb7-f10a2c7c2729'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:18:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-866ab5ef-ee4b-4ccb-abe1-2dd7f8e12807 req-03d3beee-4feb-48fb-b2b3-de68ef98421f tempest-TestShelveInstance-1986826358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:18:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-866ab5ef-ee4b-4ccb-abe1-2dd7f8e12807 req-03d3beee-4feb-48fb-b2b3-de68ef98421f tempest-TestShelveInstance-1986826358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:18:43 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [req-866ab5ef-ee4b-4ccb-abe1-2dd7f8e12807 req-03d3beee-4feb-48fb-b2b3-de68ef98421f tempest-TestShelveInstance-1986826358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:18:43 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [req-866ab5ef-ee4b-4ccb-abe1-2dd7f8e12807 req-03d3beee-4feb-48fb-b2b3-de68ef98421f tempest-TestShelveInstance-1986826358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:18:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-866ab5ef-ee4b-4ccb-abe1-2dd7f8e12807 req-03d3beee-4feb-48fb-b2b3-de68ef98421f tempest-TestShelveInstance-1986826358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:18:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-866ab5ef-ee4b-4ccb-abe1-2dd7f8e12807 req-03d3beee-4feb-48fb-b2b3-de68ef98421f tempest-TestShelveInstance-1986826358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:43 devstack sudo[102399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:18:43 devstack sudo[102399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:18:44 devstack sudo[102399]: pam_unix(sudo:session): session closed for user root
Nov 06 17:18:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [req-866ab5ef-ee4b-4ccb-abe1-2dd7f8e12807 req-03d3beee-4feb-48fb-b2b3-de68ef98421f tempest-TestShelveInstance-1986826358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.254s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:18:44 devstack cinder-volume[86856]: DEBUG cinder.manager [req-866ab5ef-ee4b-4ccb-abe1-2dd7f8e12807 req-03d3beee-4feb-48fb-b2b3-de68ef98421f tempest-TestShelveInstance-1986826358 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:18:44 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-866ab5ef-ee4b-4ccb-abe1-2dd7f8e12807 req-03d3beee-4feb-48fb-b2b3-de68ef98421f tempest-TestShelveInstance-1986826358 None] Deleted volume successfully.
Nov 06 17:18:44 devstack cinder-volume[86856]: DEBUG cinder.coordination [req-866ab5ef-ee4b-4ccb-abe1-2dd7f8e12807 req-03d3beee-4feb-48fb-b2b3-de68ef98421f tempest-TestShelveInstance-1986826358 None] Lock "cinder-baffa222-0540-494b-8557-e25f425666d6-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:18:44 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6bd05af-1a2d-466c-aaa7-a0fdeb376622 tempest-CreateVolumesFromSnapshotTest-91808084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:18:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b6bd05af-1a2d-466c-aaa7-a0fdeb376622 tempest-CreateVolumesFromSnapshotTest-91808084 None] Flow 'volume_create_manager' (70222377-5777-401a-9470-d94df29b1fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:18:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b6bd05af-1a2d-466c-aaa7-a0fdeb376622 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64c02efb-9062-4a4d-ad6e-a3ba8d67d87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:18:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b6bd05af-1a2d-466c-aaa7-a0fdeb376622 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64c02efb-9062-4a4d-ad6e-a3ba8d67d87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-728670456',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488466a5-4c10-446c-9fe7-db2ced01e7c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f646eb76a344cccb89d9d684f635908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:18:45Z,use_quota=True,user_id='d6db03b1506b4af9af717e89ba00a57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:18:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b6bd05af-1a2d-466c-aaa7-a0fdeb376622 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63080a5d-cdb8-40f8-b0b4-87e0bda57c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:18:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b6bd05af-1a2d-466c-aaa7-a0fdeb376622 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63080a5d-cdb8-40f8-b0b4-87e0bda57c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:18:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b6bd05af-1a2d-466c-aaa7-a0fdeb376622 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6a60270-11e5-4dae-bb2d-4ee1b6d93a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:18:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b6bd05af-1a2d-466c-aaa7-a0fdeb376622 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6a60270-11e5-4dae-bb2d-4ee1b6d93a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '488466a5-4c10-446c-9fe7-db2ced01e7c7', 'volume_name': 'volume-488466a5-4c10-446c-9fe7-db2ced01e7c7', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:18:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b6bd05af-1a2d-466c-aaa7-a0fdeb376622 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21f5d58a-c7e5-489a-aa54-23a2a9baee87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:18:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b6bd05af-1a2d-466c-aaa7-a0fdeb376622 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21f5d58a-c7e5-489a-aa54-23a2a9baee87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:18:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b6bd05af-1a2d-466c-aaa7-a0fdeb376622 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de5f2731-9dd8-417e-9db8-eaf5e8cb7864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:18:44 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-b6bd05af-1a2d-466c-aaa7-a0fdeb376622 tempest-CreateVolumesFromSnapshotTest-91808084 None] Volume 488466a5-4c10-446c-9fe7-db2ced01e7c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-488466a5-4c10-446c-9fe7-db2ced01e7c7', 'volume_size': 1}
Nov 06 17:18:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b6bd05af-1a2d-466c-aaa7-a0fdeb376622 tempest-CreateVolumesFromSnapshotTest-91808084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:18:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b6bd05af-1a2d-466c-aaa7-a0fdeb376622 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:18:44 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-b6bd05af-1a2d-466c-aaa7-a0fdeb376622 tempest-CreateVolumesFromSnapshotTest-91808084 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-728670456',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488466a5-4c10-446c-9fe7-db2ced01e7c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f646eb76a344cccb89d9d684f635908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:18:45Z,use_quota=True,user_id='d6db03b1506b4af9af717e89ba00a57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:18:44 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-b6bd05af-1a2d-466c-aaa7-a0fdeb376622 tempest-CreateVolumesFromSnapshotTest-91808084 None] Creating volume 488466a5-4c10-446c-9fe7-db2ced01e7c7 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:18:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b6bd05af-1a2d-466c-aaa7-a0fdeb376622 tempest-CreateVolumesFromSnapshotTest-91808084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:18:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b6bd05af-1a2d-466c-aaa7-a0fdeb376622 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:18:44 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-b6bd05af-1a2d-466c-aaa7-a0fdeb376622 tempest-CreateVolumesFromSnapshotTest-91808084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:18:44 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-b6bd05af-1a2d-466c-aaa7-a0fdeb376622 tempest-CreateVolumesFromSnapshotTest-91808084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:18:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b6bd05af-1a2d-466c-aaa7-a0fdeb376622 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:18:44 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-b6bd05af-1a2d-466c-aaa7-a0fdeb376622 tempest-CreateVolumesFromSnapshotTest-91808084 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:18:44 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-b6bd05af-1a2d-466c-aaa7-a0fdeb376622 tempest-CreateVolumesFromSnapshotTest-91808084 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:18:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b6bd05af-1a2d-466c-aaa7-a0fdeb376622 tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:44 devstack sudo[102402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7 1073741824
Nov 06 17:18:44 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:18:45 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root
Nov 06 17:18:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b6bd05af-1a2d-466c-aaa7-a0fdeb376622 tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7 1073741824" returned: 0 in 0.494s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:18:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b6bd05af-1a2d-466c-aaa7-a0fdeb376622 tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:45 devstack sudo[102408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7
Nov 06 17:18:45 devstack sudo[102408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:18:45 devstack sudo[102408]: pam_unix(sudo:session): session closed for user root
Nov 06 17:18:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b6bd05af-1a2d-466c-aaa7-a0fdeb376622 tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7" returned: 0 in 0.264s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:18:45 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-b6bd05af-1a2d-466c-aaa7-a0fdeb376622 tempest-CreateVolumesFromSnapshotTest-91808084 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:18:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b6bd05af-1a2d-466c-aaa7-a0fdeb376622 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:18:45 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b6bd05af-1a2d-466c-aaa7-a0fdeb376622 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de5f2731-9dd8-417e-9db8-eaf5e8cb7864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-488466a5-4c10-446c-9fe7-db2ced01e7c7', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:18:45 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b6bd05af-1a2d-466c-aaa7-a0fdeb376622 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85f7e9e6-60cf-457b-b9eb-1dc8377de1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:18:45 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-b6bd05af-1a2d-466c-aaa7-a0fdeb376622 tempest-CreateVolumesFromSnapshotTest-91808084 None] Volume volume-488466a5-4c10-446c-9fe7-db2ced01e7c7 (488466a5-4c10-446c-9fe7-db2ced01e7c7): created successfully
Nov 06 17:18:45 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b6bd05af-1a2d-466c-aaa7-a0fdeb376622 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85f7e9e6-60cf-457b-b9eb-1dc8377de1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:18:45 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b6bd05af-1a2d-466c-aaa7-a0fdeb376622 tempest-CreateVolumesFromSnapshotTest-91808084 None] Flow 'volume_create_manager' (70222377-5777-401a-9470-d94df29b1fb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:18:45 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-b6bd05af-1a2d-466c-aaa7-a0fdeb376622 tempest-CreateVolumesFromSnapshotTest-91808084 None] Created volume successfully.
Nov 06 17:18:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2734b240-1dd0-4614-b1a6-edd9e34b9936 tempest-CreateVolumesFromSnapshotTest-91808084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:18:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2734b240-1dd0-4614-b1a6-edd9e34b9936 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:18:46 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-2734b240-1dd0-4614-b1a6-edd9e34b9936 tempest-CreateVolumesFromSnapshotTest-91808084 None] Creating offline snapshot 578707d9-d94c-40ae-ae1d-5d8442b7a22f of volume 488466a5-4c10-446c-9fe7-db2ced01e7c7 {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:18:46 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f41f8b-b37f-407d-804b-955cbd8f5d14]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:18:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2734b240-1dd0-4614-b1a6-edd9e34b9936 tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:47 devstack sudo[102418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7
Nov 06 17:18:47 devstack sudo[102418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:18:47 devstack sudo[102418]: pam_unix(sudo:session): session closed for user root
Nov 06 17:18:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2734b240-1dd0-4614-b1a6-edd9e34b9936 tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7" returned: 0 in 0.422s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:18:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2734b240-1dd0-4614-b1a6-edd9e34b9936 tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7.578707d9-d94c-40ae-ae1d-5d8442b7a22f 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:47 devstack sudo[102423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7.578707d9-d94c-40ae-ae1d-5d8442b7a22f 1G
Nov 06 17:18:47 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:18:47 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root
Nov 06 17:18:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2734b240-1dd0-4614-b1a6-edd9e34b9936 tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7.578707d9-d94c-40ae-ae1d-5d8442b7a22f 1G" returned: 0 in 0.396s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:18:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2734b240-1dd0-4614-b1a6-edd9e34b9936 tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-488466a5-4c10-446c-9fe7-db2ced01e7c7 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7.578707d9-d94c-40ae-ae1d-5d8442b7a22f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:47 devstack sudo[102428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-488466a5-4c10-446c-9fe7-db2ced01e7c7 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7.578707d9-d94c-40ae-ae1d-5d8442b7a22f
Nov 06 17:18:47 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:18:48 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root
Nov 06 17:18:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2734b240-1dd0-4614-b1a6-edd9e34b9936 tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-488466a5-4c10-446c-9fe7-db2ced01e7c7 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7.578707d9-d94c-40ae-ae1d-5d8442b7a22f" returned: 0 in 0.290s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:18:48 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-2734b240-1dd0-4614-b1a6-edd9e34b9936 tempest-CreateVolumesFromSnapshotTest-91808084 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7.578707d9-d94c-40ae-ae1d-5d8442b7a22f is being set with open permissions: ugo+rw
Nov 06 17:18:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2734b240-1dd0-4614-b1a6-edd9e34b9936 tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7.578707d9-d94c-40ae-ae1d-5d8442b7a22f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:48 devstack sudo[102433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7.578707d9-d94c-40ae-ae1d-5d8442b7a22f
Nov 06 17:18:48 devstack sudo[102433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:18:48 devstack sudo[102433]: pam_unix(sudo:session): session closed for user root
Nov 06 17:18:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2734b240-1dd0-4614-b1a6-edd9e34b9936 tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7.578707d9-d94c-40ae-ae1d-5d8442b7a22f" returned: 0 in 0.312s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:18:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2734b240-1dd0-4614-b1a6-edd9e34b9936 tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:48 devstack sudo[102470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7.info
Nov 06 17:18:48 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:18:48 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root
Nov 06 17:18:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2734b240-1dd0-4614-b1a6-edd9e34b9936 tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7.info" returned: 0 in 0.288s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:18:48 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-2734b240-1dd0-4614-b1a6-edd9e34b9936 tempest-CreateVolumesFromSnapshotTest-91808084 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7.info is being set with open permissions: ugo+rw
Nov 06 17:18:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2734b240-1dd0-4614-b1a6-edd9e34b9936 tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:48 devstack sudo[102475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7.info
Nov 06 17:18:48 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:18:48 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root
Nov 06 17:18:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2734b240-1dd0-4614-b1a6-edd9e34b9936 tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7.info" returned: 0 in 0.265s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:18:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2734b240-1dd0-4614-b1a6-edd9e34b9936 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.107s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:18:49 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-2734b240-1dd0-4614-b1a6-edd9e34b9936 tempest-CreateVolumesFromSnapshotTest-91808084 None] Create snapshot completed successfully
Nov 06 17:18:50 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-865a7489-1d1e-4d98-93a1-5208ff72531e tempest-CreateVolumesFromSnapshotTest-91808084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:18:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-865a7489-1d1e-4d98-93a1-5208ff72531e tempest-CreateVolumesFromSnapshotTest-91808084 None] Flow 'volume_create_manager' (3a6471f0-b2a6-455b-894e-39c4af85171d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:18:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-865a7489-1d1e-4d98-93a1-5208ff72531e tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbe39a1c-5ef5-466a-b130-fce17f0f7ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:18:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-865a7489-1d1e-4d98-93a1-5208ff72531e tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbe39a1c-5ef5-466a-b130-fce17f0f7ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-13451404',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d83a4551-8317-446a-ade2-904055aa6c7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f646eb76a344cccb89d9d684f635908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:18:50Z,use_quota=True,user_id='d6db03b1506b4af9af717e89ba00a57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:18:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-865a7489-1d1e-4d98-93a1-5208ff72531e tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fbeef01-c9e0-47ac-80e9-6c1833d2c430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:18:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-865a7489-1d1e-4d98-93a1-5208ff72531e tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fbeef01-c9e0-47ac-80e9-6c1833d2c430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:18:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-865a7489-1d1e-4d98-93a1-5208ff72531e tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a1691a9-ffe1-46bf-9d0f-a2fb671ca4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:18:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-865a7489-1d1e-4d98-93a1-5208ff72531e tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a1691a9-ffe1-46bf-9d0f-a2fb671ca4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd83a4551-8317-446a-ade2-904055aa6c7d', 'volume_name': 'volume-d83a4551-8317-446a-ade2-904055aa6c7d', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:18:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-865a7489-1d1e-4d98-93a1-5208ff72531e tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df01d54a-fadb-4f5e-a6d4-79d3d5f4d756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:18:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-865a7489-1d1e-4d98-93a1-5208ff72531e tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df01d54a-fadb-4f5e-a6d4-79d3d5f4d756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:18:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-865a7489-1d1e-4d98-93a1-5208ff72531e tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (097a20a5-41fc-482f-ae73-280e786c9631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:18:50 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-865a7489-1d1e-4d98-93a1-5208ff72531e tempest-CreateVolumesFromSnapshotTest-91808084 None] Volume d83a4551-8317-446a-ade2-904055aa6c7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d83a4551-8317-446a-ade2-904055aa6c7d', 'volume_size': 1}
Nov 06 17:18:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-865a7489-1d1e-4d98-93a1-5208ff72531e tempest-CreateVolumesFromSnapshotTest-91808084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:18:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-865a7489-1d1e-4d98-93a1-5208ff72531e tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:18:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-865a7489-1d1e-4d98-93a1-5208ff72531e tempest-CreateVolumesFromSnapshotTest-91808084 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-13451404',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d83a4551-8317-446a-ade2-904055aa6c7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f646eb76a344cccb89d9d684f635908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:18:50Z,use_quota=True,user_id='d6db03b1506b4af9af717e89ba00a57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:18:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-865a7489-1d1e-4d98-93a1-5208ff72531e tempest-CreateVolumesFromSnapshotTest-91808084 None] Creating volume d83a4551-8317-446a-ade2-904055aa6c7d {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:18:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-865a7489-1d1e-4d98-93a1-5208ff72531e tempest-CreateVolumesFromSnapshotTest-91808084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:18:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-865a7489-1d1e-4d98-93a1-5208ff72531e tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:18:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-865a7489-1d1e-4d98-93a1-5208ff72531e tempest-CreateVolumesFromSnapshotTest-91808084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:18:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-865a7489-1d1e-4d98-93a1-5208ff72531e tempest-CreateVolumesFromSnapshotTest-91808084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:18:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-865a7489-1d1e-4d98-93a1-5208ff72531e tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:18:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-865a7489-1d1e-4d98-93a1-5208ff72531e tempest-CreateVolumesFromSnapshotTest-91808084 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:18:50 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-865a7489-1d1e-4d98-93a1-5208ff72531e tempest-CreateVolumesFromSnapshotTest-91808084 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:18:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-865a7489-1d1e-4d98-93a1-5208ff72531e tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d83a4551-8317-446a-ade2-904055aa6c7d 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:50 devstack sudo[102482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d83a4551-8317-446a-ade2-904055aa6c7d 1073741824
Nov 06 17:18:50 devstack sudo[102482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:18:50 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-308167e4-5751-4300-ab7c-3d87471ae9e6 tempest-CreateVolumesFromSnapshotTest-91808084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:18:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-308167e4-5751-4300-ab7c-3d87471ae9e6 tempest-CreateVolumesFromSnapshotTest-91808084 None] Flow 'volume_create_manager' (2c2e5c82-91fc-418e-9821-d8ed646647a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:18:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-308167e4-5751-4300-ab7c-3d87471ae9e6 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d239d8b-d771-424c-828a-ac522e8550b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:18:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-308167e4-5751-4300-ab7c-3d87471ae9e6 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d239d8b-d771-424c-828a-ac522e8550b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1203895362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c34cc15-3dc6-44ad-ae63-3961d47d8d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f646eb76a344cccb89d9d684f635908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:18:51Z,use_quota=True,user_id='d6db03b1506b4af9af717e89ba00a57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:18:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-308167e4-5751-4300-ab7c-3d87471ae9e6 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9687659c-57a2-4d45-a0c8-1a2408ddf410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:18:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-308167e4-5751-4300-ab7c-3d87471ae9e6 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9687659c-57a2-4d45-a0c8-1a2408ddf410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:18:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-308167e4-5751-4300-ab7c-3d87471ae9e6 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff997248-f423-4b15-8058-e2d3d59b598e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:18:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-308167e4-5751-4300-ab7c-3d87471ae9e6 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff997248-f423-4b15-8058-e2d3d59b598e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c34cc15-3dc6-44ad-ae63-3961d47d8d76', 'volume_name': 'volume-6c34cc15-3dc6-44ad-ae63-3961d47d8d76', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:18:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-308167e4-5751-4300-ab7c-3d87471ae9e6 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e55b1976-26db-4abb-a45c-086dabb0c4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:18:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-308167e4-5751-4300-ab7c-3d87471ae9e6 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e55b1976-26db-4abb-a45c-086dabb0c4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-308167e4-5751-4300-ab7c-3d87471ae9e6 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d357badf-65f0-410c-801b-57154071d74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:18:51 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-308167e4-5751-4300-ab7c-3d87471ae9e6 tempest-CreateVolumesFromSnapshotTest-91808084 None] Volume 6c34cc15-3dc6-44ad-ae63-3961d47d8d76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c34cc15-3dc6-44ad-ae63-3961d47d8d76', 'volume_size': 1}
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-308167e4-5751-4300-ab7c-3d87471ae9e6 tempest-CreateVolumesFromSnapshotTest-91808084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:18:51 devstack sudo[102482]: pam_unix(sudo:session): session closed for user root
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-865a7489-1d1e-4d98-93a1-5208ff72531e tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d83a4551-8317-446a-ade2-904055aa6c7d 1073741824" returned: 0 in 0.579s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-865a7489-1d1e-4d98-93a1-5208ff72531e tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d83a4551-8317-446a-ade2-904055aa6c7d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:51 devstack sudo[102488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d83a4551-8317-446a-ade2-904055aa6c7d
Nov 06 17:18:51 devstack sudo[102488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5270b8c-795d-4a20-b234-e49771deac9a tempest-CreateVolumesFromSnapshotTest-91808084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e5270b8c-795d-4a20-b234-e49771deac9a tempest-CreateVolumesFromSnapshotTest-91808084 None] Flow 'volume_create_manager' (00b28bad-8e47-4a3d-9ff0-081a941db264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e5270b8c-795d-4a20-b234-e49771deac9a tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe47c65e-696f-4c5b-83e7-48e81dfabe0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e5270b8c-795d-4a20-b234-e49771deac9a tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe47c65e-696f-4c5b-83e7-48e81dfabe0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1181219968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bc1b9d0-58f5-4327-a410-58f0246cbfa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f646eb76a344cccb89d9d684f635908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:18:51Z,use_quota=True,user_id='d6db03b1506b4af9af717e89ba00a57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e5270b8c-795d-4a20-b234-e49771deac9a tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f0f9af4-45fe-474e-98d9-2d146cd7d846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e5270b8c-795d-4a20-b234-e49771deac9a tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f0f9af4-45fe-474e-98d9-2d146cd7d846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e5270b8c-795d-4a20-b234-e49771deac9a tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25f5f980-fd86-46d9-a32c-24678e4f157a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e5270b8c-795d-4a20-b234-e49771deac9a tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25f5f980-fd86-46d9-a32c-24678e4f157a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bc1b9d0-58f5-4327-a410-58f0246cbfa3', 'volume_name': 'volume-0bc1b9d0-58f5-4327-a410-58f0246cbfa3', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e5270b8c-795d-4a20-b234-e49771deac9a tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa39ef4-09e1-4fce-a796-25b81ea1d2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e5270b8c-795d-4a20-b234-e49771deac9a tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa39ef4-09e1-4fce-a796-25b81ea1d2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e5270b8c-795d-4a20-b234-e49771deac9a tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5147e59-0618-4355-9c74-5e42aabb8a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:18:51 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-e5270b8c-795d-4a20-b234-e49771deac9a tempest-CreateVolumesFromSnapshotTest-91808084 None] Volume 0bc1b9d0-58f5-4327-a410-58f0246cbfa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bc1b9d0-58f5-4327-a410-58f0246cbfa3', 'volume_size': 1}
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e5270b8c-795d-4a20-b234-e49771deac9a tempest-CreateVolumesFromSnapshotTest-91808084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:18:51 devstack sudo[102488]: pam_unix(sudo:session): session closed for user root
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-865a7489-1d1e-4d98-93a1-5208ff72531e tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d83a4551-8317-446a-ade2-904055aa6c7d" returned: 0 in 0.316s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-865a7489-1d1e-4d98-93a1-5208ff72531e tempest-CreateVolumesFromSnapshotTest-91808084 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-865a7489-1d1e-4d98-93a1-5208ff72531e tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-308167e4-5751-4300-ab7c-3d87471ae9e6 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.503s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-308167e4-5751-4300-ab7c-3d87471ae9e6 tempest-CreateVolumesFromSnapshotTest-91808084 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1203895362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c34cc15-3dc6-44ad-ae63-3961d47d8d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f646eb76a344cccb89d9d684f635908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:18:51Z,use_quota=True,user_id='d6db03b1506b4af9af717e89ba00a57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-308167e4-5751-4300-ab7c-3d87471ae9e6 tempest-CreateVolumesFromSnapshotTest-91808084 None] Creating volume 6c34cc15-3dc6-44ad-ae63-3961d47d8d76 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-308167e4-5751-4300-ab7c-3d87471ae9e6 tempest-CreateVolumesFromSnapshotTest-91808084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-308167e4-5751-4300-ab7c-3d87471ae9e6 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-308167e4-5751-4300-ab7c-3d87471ae9e6 tempest-CreateVolumesFromSnapshotTest-91808084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-308167e4-5751-4300-ab7c-3d87471ae9e6 tempest-CreateVolumesFromSnapshotTest-91808084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-308167e4-5751-4300-ab7c-3d87471ae9e6 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-308167e4-5751-4300-ab7c-3d87471ae9e6 tempest-CreateVolumesFromSnapshotTest-91808084 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:18:51 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-308167e4-5751-4300-ab7c-3d87471ae9e6 tempest-CreateVolumesFromSnapshotTest-91808084 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-308167e4-5751-4300-ab7c-3d87471ae9e6 tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6c34cc15-3dc6-44ad-ae63-3961d47d8d76 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-865a7489-1d1e-4d98-93a1-5208ff72531e tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (097a20a5-41fc-482f-ae73-280e786c9631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d83a4551-8317-446a-ade2-904055aa6c7d', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-865a7489-1d1e-4d98-93a1-5208ff72531e tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e75c2a0-ce02-4858-99fb-af51c427021c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:18:51 devstack sudo[102492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6c34cc15-3dc6-44ad-ae63-3961d47d8d76 1073741824
Nov 06 17:18:51 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:18:51 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-865a7489-1d1e-4d98-93a1-5208ff72531e tempest-CreateVolumesFromSnapshotTest-91808084 None] Volume volume-d83a4551-8317-446a-ade2-904055aa6c7d (d83a4551-8317-446a-ade2-904055aa6c7d): created successfully
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-865a7489-1d1e-4d98-93a1-5208ff72531e tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e75c2a0-ce02-4858-99fb-af51c427021c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-865a7489-1d1e-4d98-93a1-5208ff72531e tempest-CreateVolumesFromSnapshotTest-91808084 None] Flow 'volume_create_manager' (3a6471f0-b2a6-455b-894e-39c4af85171d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:18:51 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-865a7489-1d1e-4d98-93a1-5208ff72531e tempest-CreateVolumesFromSnapshotTest-91808084 None] Created volume successfully.
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe3d283f-761e-4e68-894e-fbf29d7961a2 tempest-CreateVolumesFromSnapshotTest-91808084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fe3d283f-761e-4e68-894e-fbf29d7961a2 tempest-CreateVolumesFromSnapshotTest-91808084 None] Flow 'volume_create_manager' (535cdfdf-1aa4-4364-8b06-35d98baeb104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fe3d283f-761e-4e68-894e-fbf29d7961a2 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d32073-946a-4d52-b31e-d63b909ab20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fe3d283f-761e-4e68-894e-fbf29d7961a2 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d32073-946a-4d52-b31e-d63b909ab20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-423252345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cfe17b1-80b5-4d85-899e-fb8a77ed65ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f646eb76a344cccb89d9d684f635908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:18:52Z,use_quota=True,user_id='d6db03b1506b4af9af717e89ba00a57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fe3d283f-761e-4e68-894e-fbf29d7961a2 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c70f69f-612a-4c10-b318-58c197052a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fe3d283f-761e-4e68-894e-fbf29d7961a2 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c70f69f-612a-4c10-b318-58c197052a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fe3d283f-761e-4e68-894e-fbf29d7961a2 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9c0be1b-c872-4a9d-9f32-744ee3874430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fe3d283f-761e-4e68-894e-fbf29d7961a2 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9c0be1b-c872-4a9d-9f32-744ee3874430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cfe17b1-80b5-4d85-899e-fb8a77ed65ab', 'volume_name': 'volume-8cfe17b1-80b5-4d85-899e-fb8a77ed65ab', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fe3d283f-761e-4e68-894e-fbf29d7961a2 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddff5cca-bd4d-427d-b1e4-1daad1cb21af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fe3d283f-761e-4e68-894e-fbf29d7961a2 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddff5cca-bd4d-427d-b1e4-1daad1cb21af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fe3d283f-761e-4e68-894e-fbf29d7961a2 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36670df2-b9bc-4e2f-84e5-0bc316f67a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:18:51 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-fe3d283f-761e-4e68-894e-fbf29d7961a2 tempest-CreateVolumesFromSnapshotTest-91808084 None] Volume 8cfe17b1-80b5-4d85-899e-fb8a77ed65ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cfe17b1-80b5-4d85-899e-fb8a77ed65ab', 'volume_size': 1}
Nov 06 17:18:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-fe3d283f-761e-4e68-894e-fbf29d7961a2 tempest-CreateVolumesFromSnapshotTest-91808084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:18:52 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root
Nov 06 17:18:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-308167e4-5751-4300-ab7c-3d87471ae9e6 tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6c34cc15-3dc6-44ad-ae63-3961d47d8d76 1073741824" returned: 0 in 0.604s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:18:52 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-0912b5a3-0926-46ab-9410-8f87b5e8dec9 tempest-CreateVolumesFromSnapshotTest-91808084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:18:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0912b5a3-0926-46ab-9410-8f87b5e8dec9 tempest-CreateVolumesFromSnapshotTest-91808084 None] Flow 'volume_create_manager' (c07428d7-2678-4382-b6c3-c9a8d97c4809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:18:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0912b5a3-0926-46ab-9410-8f87b5e8dec9 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc334d4-219b-49fe-913d-4601926b224d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:18:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-308167e4-5751-4300-ab7c-3d87471ae9e6 tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6c34cc15-3dc6-44ad-ae63-3961d47d8d76 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0912b5a3-0926-46ab-9410-8f87b5e8dec9 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc334d4-219b-49fe-913d-4601926b224d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1128914677',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f36abc5a-deee-4a15-980f-74ff6208bd3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f646eb76a344cccb89d9d684f635908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:18:52Z,use_quota=True,user_id='d6db03b1506b4af9af717e89ba00a57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:18:52 devstack sudo[102498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6c34cc15-3dc6-44ad-ae63-3961d47d8d76
Nov 06 17:18:52 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:18:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0912b5a3-0926-46ab-9410-8f87b5e8dec9 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12ed6680-de27-42f1-979c-fc79be1db507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:18:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0912b5a3-0926-46ab-9410-8f87b5e8dec9 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12ed6680-de27-42f1-979c-fc79be1db507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:18:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0912b5a3-0926-46ab-9410-8f87b5e8dec9 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8217554-d249-4d0a-b9ee-fa09b89d5758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:18:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0912b5a3-0926-46ab-9410-8f87b5e8dec9 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8217554-d249-4d0a-b9ee-fa09b89d5758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f36abc5a-deee-4a15-980f-74ff6208bd3c', 'volume_name': 'volume-f36abc5a-deee-4a15-980f-74ff6208bd3c', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:18:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0912b5a3-0926-46ab-9410-8f87b5e8dec9 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f996e807-a6fc-47b9-9ff9-fbbdafccd6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:18:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0912b5a3-0926-46ab-9410-8f87b5e8dec9 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f996e807-a6fc-47b9-9ff9-fbbdafccd6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:18:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0912b5a3-0926-46ab-9410-8f87b5e8dec9 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690b9a08-bba7-4767-b14f-59a4f5c94c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:18:52 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-0912b5a3-0926-46ab-9410-8f87b5e8dec9 tempest-CreateVolumesFromSnapshotTest-91808084 None] Volume f36abc5a-deee-4a15-980f-74ff6208bd3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f36abc5a-deee-4a15-980f-74ff6208bd3c', 'volume_size': 1}
Nov 06 17:18:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0912b5a3-0926-46ab-9410-8f87b5e8dec9 tempest-CreateVolumesFromSnapshotTest-91808084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:18:52 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root
Nov 06 17:18:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-308167e4-5751-4300-ab7c-3d87471ae9e6 tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6c34cc15-3dc6-44ad-ae63-3961d47d8d76" returned: 0 in 0.259s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:18:52 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-308167e4-5751-4300-ab7c-3d87471ae9e6 tempest-CreateVolumesFromSnapshotTest-91808084 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:18:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-308167e4-5751-4300-ab7c-3d87471ae9e6 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:18:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e5270b8c-795d-4a20-b234-e49771deac9a tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.096s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:18:52 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e5270b8c-795d-4a20-b234-e49771deac9a tempest-CreateVolumesFromSnapshotTest-91808084 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1181219968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bc1b9d0-58f5-4327-a410-58f0246cbfa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f646eb76a344cccb89d9d684f635908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:18:51Z,use_quota=True,user_id='d6db03b1506b4af9af717e89ba00a57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:18:52 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-e5270b8c-795d-4a20-b234-e49771deac9a tempest-CreateVolumesFromSnapshotTest-91808084 None] Creating volume 0bc1b9d0-58f5-4327-a410-58f0246cbfa3 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:18:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e5270b8c-795d-4a20-b234-e49771deac9a tempest-CreateVolumesFromSnapshotTest-91808084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:18:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e5270b8c-795d-4a20-b234-e49771deac9a tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:18:52 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e5270b8c-795d-4a20-b234-e49771deac9a tempest-CreateVolumesFromSnapshotTest-91808084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:18:52 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e5270b8c-795d-4a20-b234-e49771deac9a tempest-CreateVolumesFromSnapshotTest-91808084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:18:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e5270b8c-795d-4a20-b234-e49771deac9a tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:18:52 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e5270b8c-795d-4a20-b234-e49771deac9a tempest-CreateVolumesFromSnapshotTest-91808084 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:18:52 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-e5270b8c-795d-4a20-b234-e49771deac9a tempest-CreateVolumesFromSnapshotTest-91808084 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:18:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e5270b8c-795d-4a20-b234-e49771deac9a tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0bc1b9d0-58f5-4327-a410-58f0246cbfa3 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:52 devstack sudo[102501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0bc1b9d0-58f5-4327-a410-58f0246cbfa3 1073741824
Nov 06 17:18:52 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:18:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-308167e4-5751-4300-ab7c-3d87471ae9e6 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d357badf-65f0-410c-801b-57154071d74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c34cc15-3dc6-44ad-ae63-3961d47d8d76', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:18:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-308167e4-5751-4300-ab7c-3d87471ae9e6 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4f1304a-62f9-417a-82b9-70ad25de6a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:18:52 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-308167e4-5751-4300-ab7c-3d87471ae9e6 tempest-CreateVolumesFromSnapshotTest-91808084 None] Volume volume-6c34cc15-3dc6-44ad-ae63-3961d47d8d76 (6c34cc15-3dc6-44ad-ae63-3961d47d8d76): created successfully
Nov 06 17:18:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-308167e4-5751-4300-ab7c-3d87471ae9e6 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4f1304a-62f9-417a-82b9-70ad25de6a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:18:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-308167e4-5751-4300-ab7c-3d87471ae9e6 tempest-CreateVolumesFromSnapshotTest-91808084 None] Flow 'volume_create_manager' (2c2e5c82-91fc-418e-9821-d8ed646647a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:18:52 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-308167e4-5751-4300-ab7c-3d87471ae9e6 tempest-CreateVolumesFromSnapshotTest-91808084 None] Created volume successfully.
Nov 06 17:18:53 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root
Nov 06 17:18:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e5270b8c-795d-4a20-b234-e49771deac9a tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0bc1b9d0-58f5-4327-a410-58f0246cbfa3 1073741824" returned: 0 in 0.495s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:18:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e5270b8c-795d-4a20-b234-e49771deac9a tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0bc1b9d0-58f5-4327-a410-58f0246cbfa3 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:53 devstack sudo[102507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0bc1b9d0-58f5-4327-a410-58f0246cbfa3
Nov 06 17:18:53 devstack sudo[102507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:18:53 devstack sudo[102507]: pam_unix(sudo:session): session closed for user root
Nov 06 17:18:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e5270b8c-795d-4a20-b234-e49771deac9a tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0bc1b9d0-58f5-4327-a410-58f0246cbfa3" returned: 0 in 0.272s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:18:53 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e5270b8c-795d-4a20-b234-e49771deac9a tempest-CreateVolumesFromSnapshotTest-91808084 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:18:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e5270b8c-795d-4a20-b234-e49771deac9a tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:18:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-fe3d283f-761e-4e68-894e-fbf29d7961a2 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.446s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:18:53 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-fe3d283f-761e-4e68-894e-fbf29d7961a2 tempest-CreateVolumesFromSnapshotTest-91808084 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-423252345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cfe17b1-80b5-4d85-899e-fb8a77ed65ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f646eb76a344cccb89d9d684f635908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:18:52Z,use_quota=True,user_id='d6db03b1506b4af9af717e89ba00a57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:18:53 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-fe3d283f-761e-4e68-894e-fbf29d7961a2 tempest-CreateVolumesFromSnapshotTest-91808084 None] Creating volume 8cfe17b1-80b5-4d85-899e-fb8a77ed65ab {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:18:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-fe3d283f-761e-4e68-894e-fbf29d7961a2 tempest-CreateVolumesFromSnapshotTest-91808084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:18:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-fe3d283f-761e-4e68-894e-fbf29d7961a2 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:18:53 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-fe3d283f-761e-4e68-894e-fbf29d7961a2 tempest-CreateVolumesFromSnapshotTest-91808084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:18:53 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-fe3d283f-761e-4e68-894e-fbf29d7961a2 tempest-CreateVolumesFromSnapshotTest-91808084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:18:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-fe3d283f-761e-4e68-894e-fbf29d7961a2 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:18:53 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-fe3d283f-761e-4e68-894e-fbf29d7961a2 tempest-CreateVolumesFromSnapshotTest-91808084 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:18:53 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-fe3d283f-761e-4e68-894e-fbf29d7961a2 tempest-CreateVolumesFromSnapshotTest-91808084 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:18:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fe3d283f-761e-4e68-894e-fbf29d7961a2 tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8cfe17b1-80b5-4d85-899e-fb8a77ed65ab 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e5270b8c-795d-4a20-b234-e49771deac9a tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5147e59-0618-4355-9c74-5e42aabb8a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bc1b9d0-58f5-4327-a410-58f0246cbfa3', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:18:53 devstack sudo[102510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8cfe17b1-80b5-4d85-899e-fb8a77ed65ab 1073741824
Nov 06 17:18:53 devstack sudo[102510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:18:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e5270b8c-795d-4a20-b234-e49771deac9a tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abd5dd79-c66f-473e-8894-0e7232c11518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:18:53 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-e5270b8c-795d-4a20-b234-e49771deac9a tempest-CreateVolumesFromSnapshotTest-91808084 None] Volume volume-0bc1b9d0-58f5-4327-a410-58f0246cbfa3 (0bc1b9d0-58f5-4327-a410-58f0246cbfa3): created successfully
Nov 06 17:18:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e5270b8c-795d-4a20-b234-e49771deac9a tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abd5dd79-c66f-473e-8894-0e7232c11518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:18:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e5270b8c-795d-4a20-b234-e49771deac9a tempest-CreateVolumesFromSnapshotTest-91808084 None] Flow 'volume_create_manager' (00b28bad-8e47-4a3d-9ff0-081a941db264) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:18:53 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-e5270b8c-795d-4a20-b234-e49771deac9a tempest-CreateVolumesFromSnapshotTest-91808084 None] Created volume successfully.
Nov 06 17:18:53 devstack sudo[102510]: pam_unix(sudo:session): session closed for user root
Nov 06 17:18:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fe3d283f-761e-4e68-894e-fbf29d7961a2 tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8cfe17b1-80b5-4d85-899e-fb8a77ed65ab 1073741824" returned: 0 in 0.524s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:18:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fe3d283f-761e-4e68-894e-fbf29d7961a2 tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8cfe17b1-80b5-4d85-899e-fb8a77ed65ab {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:53 devstack sudo[102517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8cfe17b1-80b5-4d85-899e-fb8a77ed65ab
Nov 06 17:18:53 devstack sudo[102517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:18:54 devstack sudo[102517]: pam_unix(sudo:session): session closed for user root
Nov 06 17:18:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fe3d283f-761e-4e68-894e-fbf29d7961a2 tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8cfe17b1-80b5-4d85-899e-fb8a77ed65ab" returned: 0 in 0.265s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:18:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-fe3d283f-761e-4e68-894e-fbf29d7961a2 tempest-CreateVolumesFromSnapshotTest-91808084 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:18:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-fe3d283f-761e-4e68-894e-fbf29d7961a2 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:18:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0912b5a3-0926-46ab-9410-8f87b5e8dec9 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.865s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:18:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0912b5a3-0926-46ab-9410-8f87b5e8dec9 tempest-CreateVolumesFromSnapshotTest-91808084 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1128914677',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f36abc5a-deee-4a15-980f-74ff6208bd3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f646eb76a344cccb89d9d684f635908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:18:52Z,use_quota=True,user_id='d6db03b1506b4af9af717e89ba00a57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:18:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-0912b5a3-0926-46ab-9410-8f87b5e8dec9 tempest-CreateVolumesFromSnapshotTest-91808084 None] Creating volume f36abc5a-deee-4a15-980f-74ff6208bd3c {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:18:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0912b5a3-0926-46ab-9410-8f87b5e8dec9 tempest-CreateVolumesFromSnapshotTest-91808084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:18:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0912b5a3-0926-46ab-9410-8f87b5e8dec9 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:18:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0912b5a3-0926-46ab-9410-8f87b5e8dec9 tempest-CreateVolumesFromSnapshotTest-91808084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:18:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0912b5a3-0926-46ab-9410-8f87b5e8dec9 tempest-CreateVolumesFromSnapshotTest-91808084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:18:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0912b5a3-0926-46ab-9410-8f87b5e8dec9 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:18:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0912b5a3-0926-46ab-9410-8f87b5e8dec9 tempest-CreateVolumesFromSnapshotTest-91808084 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:18:54 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-0912b5a3-0926-46ab-9410-8f87b5e8dec9 tempest-CreateVolumesFromSnapshotTest-91808084 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:18:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0912b5a3-0926-46ab-9410-8f87b5e8dec9 tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f36abc5a-deee-4a15-980f-74ff6208bd3c 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fe3d283f-761e-4e68-894e-fbf29d7961a2 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36670df2-b9bc-4e2f-84e5-0bc316f67a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cfe17b1-80b5-4d85-899e-fb8a77ed65ab', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:18:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fe3d283f-761e-4e68-894e-fbf29d7961a2 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c006cdf5-194f-4e41-9827-775266ebdfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:18:54 devstack sudo[102520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f36abc5a-deee-4a15-980f-74ff6208bd3c 1073741824
Nov 06 17:18:54 devstack sudo[102520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:18:54 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-fe3d283f-761e-4e68-894e-fbf29d7961a2 tempest-CreateVolumesFromSnapshotTest-91808084 None] Volume volume-8cfe17b1-80b5-4d85-899e-fb8a77ed65ab (8cfe17b1-80b5-4d85-899e-fb8a77ed65ab): created successfully
Nov 06 17:18:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fe3d283f-761e-4e68-894e-fbf29d7961a2 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c006cdf5-194f-4e41-9827-775266ebdfdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:18:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fe3d283f-761e-4e68-894e-fbf29d7961a2 tempest-CreateVolumesFromSnapshotTest-91808084 None] Flow 'volume_create_manager' (535cdfdf-1aa4-4364-8b06-35d98baeb104) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:18:54 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-fe3d283f-761e-4e68-894e-fbf29d7961a2 tempest-CreateVolumesFromSnapshotTest-91808084 None] Created volume successfully.
Nov 06 17:18:54 devstack sudo[102520]: pam_unix(sudo:session): session closed for user root
Nov 06 17:18:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0912b5a3-0926-46ab-9410-8f87b5e8dec9 tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f36abc5a-deee-4a15-980f-74ff6208bd3c 1073741824" returned: 0 in 0.465s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:18:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0912b5a3-0926-46ab-9410-8f87b5e8dec9 tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f36abc5a-deee-4a15-980f-74ff6208bd3c {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:54 devstack sudo[102526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f36abc5a-deee-4a15-980f-74ff6208bd3c
Nov 06 17:18:54 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:18:54 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root
Nov 06 17:18:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0912b5a3-0926-46ab-9410-8f87b5e8dec9 tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f36abc5a-deee-4a15-980f-74ff6208bd3c" returned: 0 in 0.255s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:18:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0912b5a3-0926-46ab-9410-8f87b5e8dec9 tempest-CreateVolumesFromSnapshotTest-91808084 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:18:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0912b5a3-0926-46ab-9410-8f87b5e8dec9 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:18:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0912b5a3-0926-46ab-9410-8f87b5e8dec9 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690b9a08-bba7-4767-b14f-59a4f5c94c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f36abc5a-deee-4a15-980f-74ff6208bd3c', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:18:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0912b5a3-0926-46ab-9410-8f87b5e8dec9 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f31e0f8b-a5f2-4a1c-b0c6-a1e884aea87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:18:54 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-0912b5a3-0926-46ab-9410-8f87b5e8dec9 tempest-CreateVolumesFromSnapshotTest-91808084 None] Volume volume-f36abc5a-deee-4a15-980f-74ff6208bd3c (f36abc5a-deee-4a15-980f-74ff6208bd3c): created successfully
Nov 06 17:18:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0912b5a3-0926-46ab-9410-8f87b5e8dec9 tempest-CreateVolumesFromSnapshotTest-91808084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f31e0f8b-a5f2-4a1c-b0c6-a1e884aea87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:18:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0912b5a3-0926-46ab-9410-8f87b5e8dec9 tempest-CreateVolumesFromSnapshotTest-91808084 None] Flow 'volume_create_manager' (c07428d7-2678-4382-b6c3-c9a8d97c4809) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:18:55 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-0912b5a3-0926-46ab-9410-8f87b5e8dec9 tempest-CreateVolumesFromSnapshotTest-91808084 None] Created volume successfully.
Nov 06 17:18:55 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-164b5a14-a0f1-4017-8ffd-021a950a7478 tempest-CreateVolumesFromSnapshotTest-91808084 None] Acquiring lock "cinder-f36abc5a-deee-4a15-980f-74ff6208bd3c-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:18:55 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-164b5a14-a0f1-4017-8ffd-021a950a7478 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "cinder-f36abc5a-deee-4a15-980f-74ff6208bd3c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:18:55 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-164b5a14-a0f1-4017-8ffd-021a950a7478 tempest-CreateVolumesFromSnapshotTest-91808084 None] Acquiring lock "cinder-quobyte-f36abc5a-deee-4a15-980f-74ff6208bd3c" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:18:55 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-164b5a14-a0f1-4017-8ffd-021a950a7478 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "cinder-quobyte-f36abc5a-deee-4a15-980f-74ff6208bd3c" acquired by "delete_volume" :: waited 0.022s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:18:55 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c47e93b-8876-420b-8b32-9c68e51aecf8]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:18:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-164b5a14-a0f1-4017-8ffd-021a950a7478 tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f36abc5a-deee-4a15-980f-74ff6208bd3c {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:55 devstack sudo[102530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f36abc5a-deee-4a15-980f-74ff6208bd3c
Nov 06 17:18:55 devstack sudo[102530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:18:56 devstack sudo[102530]: pam_unix(sudo:session): session closed for user root
Nov 06 17:18:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-164b5a14-a0f1-4017-8ffd-021a950a7478 tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f36abc5a-deee-4a15-980f-74ff6208bd3c" returned: 0 in 0.365s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:18:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-164b5a14-a0f1-4017-8ffd-021a950a7478 tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f36abc5a-deee-4a15-980f-74ff6208bd3c {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:56 devstack sudo[102536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f36abc5a-deee-4a15-980f-74ff6208bd3c
Nov 06 17:18:56 devstack sudo[102536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:18:56 devstack sudo[102536]: pam_unix(sudo:session): session closed for user root
Nov 06 17:18:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-164b5a14-a0f1-4017-8ffd-021a950a7478 tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f36abc5a-deee-4a15-980f-74ff6208bd3c" returned: 0 in 0.260s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:18:56 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-164b5a14-a0f1-4017-8ffd-021a950a7478 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "cinder-quobyte-f36abc5a-deee-4a15-980f-74ff6208bd3c" released by "delete_volume" :: held 0.681s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:18:56 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-164b5a14-a0f1-4017-8ffd-021a950a7478 tempest-CreateVolumesFromSnapshotTest-91808084 None] Created reservations ['b73f1d52-13f3-42a8-9d70-4ea6a73402fe', '51b2a285-865c-4fc3-9440-f169b9fdd760', 'f2f57f23-1313-415f-8ffe-01608e44d0e2', '4f74ad91-aeff-4a14-bafd-ab5343c8deb6'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:18:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-164b5a14-a0f1-4017-8ffd-021a950a7478 tempest-CreateVolumesFromSnapshotTest-91808084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:18:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-164b5a14-a0f1-4017-8ffd-021a950a7478 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:18:56 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-164b5a14-a0f1-4017-8ffd-021a950a7478 tempest-CreateVolumesFromSnapshotTest-91808084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:18:56 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-164b5a14-a0f1-4017-8ffd-021a950a7478 tempest-CreateVolumesFromSnapshotTest-91808084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:18:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-164b5a14-a0f1-4017-8ffd-021a950a7478 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:18:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-164b5a14-a0f1-4017-8ffd-021a950a7478 tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:56 devstack sudo[102539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:18:56 devstack sudo[102539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:18:56 devstack sudo[102539]: pam_unix(sudo:session): session closed for user root
Nov 06 17:18:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-164b5a14-a0f1-4017-8ffd-021a950a7478 tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.268s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:18:56 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-164b5a14-a0f1-4017-8ffd-021a950a7478 tempest-CreateVolumesFromSnapshotTest-91808084 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:18:56 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-164b5a14-a0f1-4017-8ffd-021a950a7478 tempest-CreateVolumesFromSnapshotTest-91808084 None] Deleted volume successfully.
Nov 06 17:18:56 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-032e6171-c777-4a6c-bb41-964afe4ba943 tempest-CreateVolumesFromSnapshotTest-91808084 None] Acquiring lock "cinder-8cfe17b1-80b5-4d85-899e-fb8a77ed65ab-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:18:56 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-164b5a14-a0f1-4017-8ffd-021a950a7478 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "cinder-f36abc5a-deee-4a15-980f-74ff6208bd3c-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:18:56 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-032e6171-c777-4a6c-bb41-964afe4ba943 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "cinder-8cfe17b1-80b5-4d85-899e-fb8a77ed65ab-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:18:56 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-032e6171-c777-4a6c-bb41-964afe4ba943 tempest-CreateVolumesFromSnapshotTest-91808084 None] Acquiring lock "cinder-quobyte-8cfe17b1-80b5-4d85-899e-fb8a77ed65ab" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:18:56 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-032e6171-c777-4a6c-bb41-964afe4ba943 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "cinder-quobyte-8cfe17b1-80b5-4d85-899e-fb8a77ed65ab" acquired by "delete_volume" :: waited 0.017s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:18:56 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc9ae18-450c-4864-8106-0b68908ea4cb]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:18:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-032e6171-c777-4a6c-bb41-964afe4ba943 tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8cfe17b1-80b5-4d85-899e-fb8a77ed65ab {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:57 devstack sudo[102542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8cfe17b1-80b5-4d85-899e-fb8a77ed65ab
Nov 06 17:18:57 devstack sudo[102542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:18:57 devstack sudo[102542]: pam_unix(sudo:session): session closed for user root
Nov 06 17:18:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-032e6171-c777-4a6c-bb41-964afe4ba943 tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8cfe17b1-80b5-4d85-899e-fb8a77ed65ab" returned: 0 in 0.390s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:18:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-032e6171-c777-4a6c-bb41-964afe4ba943 tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8cfe17b1-80b5-4d85-899e-fb8a77ed65ab {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:57 devstack sudo[102547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8cfe17b1-80b5-4d85-899e-fb8a77ed65ab
Nov 06 17:18:57 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:18:57 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root
Nov 06 17:18:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-032e6171-c777-4a6c-bb41-964afe4ba943 tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8cfe17b1-80b5-4d85-899e-fb8a77ed65ab" returned: 0 in 0.272s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:18:57 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-032e6171-c777-4a6c-bb41-964afe4ba943 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "cinder-quobyte-8cfe17b1-80b5-4d85-899e-fb8a77ed65ab" released by "delete_volume" :: held 0.714s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:18:57 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-032e6171-c777-4a6c-bb41-964afe4ba943 tempest-CreateVolumesFromSnapshotTest-91808084 None] Created reservations ['1b13cd65-659c-4485-8031-7f210616bbf1', 'cf05ac83-f80c-4080-9f00-8edcb1151ee5', '449262ad-4c4e-4935-8407-263c75618590', '5d11f8ba-b458-48df-91c0-4c5f285531e5'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:18:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-032e6171-c777-4a6c-bb41-964afe4ba943 tempest-CreateVolumesFromSnapshotTest-91808084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:18:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-032e6171-c777-4a6c-bb41-964afe4ba943 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:18:57 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-032e6171-c777-4a6c-bb41-964afe4ba943 tempest-CreateVolumesFromSnapshotTest-91808084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:18:57 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-032e6171-c777-4a6c-bb41-964afe4ba943 tempest-CreateVolumesFromSnapshotTest-91808084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:18:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-032e6171-c777-4a6c-bb41-964afe4ba943 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:18:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-032e6171-c777-4a6c-bb41-964afe4ba943 tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:57 devstack sudo[102550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:18:57 devstack sudo[102550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:18:58 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9eedb345-5ef6-413b-af9b-fc8ca9acd957 tempest-CreateVolumesFromSnapshotTest-91808084 None] Acquiring lock "cinder-0bc1b9d0-58f5-4327-a410-58f0246cbfa3-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:18:58 devstack sudo[102550]: pam_unix(sudo:session): session closed for user root
Nov 06 17:18:58 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9eedb345-5ef6-413b-af9b-fc8ca9acd957 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "cinder-0bc1b9d0-58f5-4327-a410-58f0246cbfa3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:18:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-032e6171-c777-4a6c-bb41-964afe4ba943 tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.302s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:18:58 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-032e6171-c777-4a6c-bb41-964afe4ba943 tempest-CreateVolumesFromSnapshotTest-91808084 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:18:58 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-032e6171-c777-4a6c-bb41-964afe4ba943 tempest-CreateVolumesFromSnapshotTest-91808084 None] Deleted volume successfully.
Nov 06 17:18:58 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-032e6171-c777-4a6c-bb41-964afe4ba943 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "cinder-8cfe17b1-80b5-4d85-899e-fb8a77ed65ab-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:18:58 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9eedb345-5ef6-413b-af9b-fc8ca9acd957 tempest-CreateVolumesFromSnapshotTest-91808084 None] Acquiring lock "cinder-quobyte-0bc1b9d0-58f5-4327-a410-58f0246cbfa3" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:18:58 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9eedb345-5ef6-413b-af9b-fc8ca9acd957 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "cinder-quobyte-0bc1b9d0-58f5-4327-a410-58f0246cbfa3" acquired by "delete_volume" :: waited 0.017s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:18:58 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e57aaa3-0a2a-42b2-a845-644e4dcd8c7f]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:18:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9eedb345-5ef6-413b-af9b-fc8ca9acd957 tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0bc1b9d0-58f5-4327-a410-58f0246cbfa3 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:58 devstack sudo[102553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0bc1b9d0-58f5-4327-a410-58f0246cbfa3
Nov 06 17:18:58 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:18:58 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root
Nov 06 17:18:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9eedb345-5ef6-413b-af9b-fc8ca9acd957 tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0bc1b9d0-58f5-4327-a410-58f0246cbfa3" returned: 0 in 0.398s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:18:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9eedb345-5ef6-413b-af9b-fc8ca9acd957 tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0bc1b9d0-58f5-4327-a410-58f0246cbfa3 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:58 devstack sudo[102558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0bc1b9d0-58f5-4327-a410-58f0246cbfa3
Nov 06 17:18:58 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:18:58 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root
Nov 06 17:18:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9eedb345-5ef6-413b-af9b-fc8ca9acd957 tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0bc1b9d0-58f5-4327-a410-58f0246cbfa3" returned: 0 in 0.259s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:18:58 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9eedb345-5ef6-413b-af9b-fc8ca9acd957 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "cinder-quobyte-0bc1b9d0-58f5-4327-a410-58f0246cbfa3" released by "delete_volume" :: held 0.706s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:18:58 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-9eedb345-5ef6-413b-af9b-fc8ca9acd957 tempest-CreateVolumesFromSnapshotTest-91808084 None] Created reservations ['bd076f14-a503-4a34-9dae-c84dc2975505', '58a7bd8a-b589-4ff4-8e71-a5c4896c3ca1', 'd14e68e8-0a4d-481f-8c36-4fab17702a81', '0e3026a0-d6f2-4503-b30b-10701b97082e'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:18:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9eedb345-5ef6-413b-af9b-fc8ca9acd957 tempest-CreateVolumesFromSnapshotTest-91808084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:18:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9eedb345-5ef6-413b-af9b-fc8ca9acd957 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:18:59 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-9eedb345-5ef6-413b-af9b-fc8ca9acd957 tempest-CreateVolumesFromSnapshotTest-91808084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:18:59 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-9eedb345-5ef6-413b-af9b-fc8ca9acd957 tempest-CreateVolumesFromSnapshotTest-91808084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:18:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9eedb345-5ef6-413b-af9b-fc8ca9acd957 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:18:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9eedb345-5ef6-413b-af9b-fc8ca9acd957 tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:59 devstack sudo[102561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:18:59 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:18:59 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root
Nov 06 17:18:59 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-dded77cd-1931-4249-8654-e3d2a1dd562e tempest-CreateVolumesFromSnapshotTest-91808084 None] Acquiring lock "cinder-6c34cc15-3dc6-44ad-ae63-3961d47d8d76-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:18:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9eedb345-5ef6-413b-af9b-fc8ca9acd957 tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.269s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:18:59 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-9eedb345-5ef6-413b-af9b-fc8ca9acd957 tempest-CreateVolumesFromSnapshotTest-91808084 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:18:59 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-9eedb345-5ef6-413b-af9b-fc8ca9acd957 tempest-CreateVolumesFromSnapshotTest-91808084 None] Deleted volume successfully.
Nov 06 17:18:59 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-dded77cd-1931-4249-8654-e3d2a1dd562e tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "cinder-6c34cc15-3dc6-44ad-ae63-3961d47d8d76-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:18:59 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9eedb345-5ef6-413b-af9b-fc8ca9acd957 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "cinder-0bc1b9d0-58f5-4327-a410-58f0246cbfa3-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:18:59 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-dded77cd-1931-4249-8654-e3d2a1dd562e tempest-CreateVolumesFromSnapshotTest-91808084 None] Acquiring lock "cinder-quobyte-6c34cc15-3dc6-44ad-ae63-3961d47d8d76" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:18:59 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-dded77cd-1931-4249-8654-e3d2a1dd562e tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "cinder-quobyte-6c34cc15-3dc6-44ad-ae63-3961d47d8d76" acquired by "delete_volume" :: waited 0.017s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:18:59 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e052f9-f9b9-4801-b5a7-77aaf3bd584d]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:18:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-dded77cd-1931-4249-8654-e3d2a1dd562e tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6c34cc15-3dc6-44ad-ae63-3961d47d8d76 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:59 devstack sudo[102564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6c34cc15-3dc6-44ad-ae63-3961d47d8d76
Nov 06 17:18:59 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:18:59 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root
Nov 06 17:18:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-dded77cd-1931-4249-8654-e3d2a1dd562e tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6c34cc15-3dc6-44ad-ae63-3961d47d8d76" returned: 0 in 0.387s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:18:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-dded77cd-1931-4249-8654-e3d2a1dd562e tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6c34cc15-3dc6-44ad-ae63-3961d47d8d76 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:18:59 devstack sudo[102569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6c34cc15-3dc6-44ad-ae63-3961d47d8d76
Nov 06 17:18:59 devstack sudo[102569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:00 devstack sudo[102569]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-dded77cd-1931-4249-8654-e3d2a1dd562e tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6c34cc15-3dc6-44ad-ae63-3961d47d8d76" returned: 0 in 0.255s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:00 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-dded77cd-1931-4249-8654-e3d2a1dd562e tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "cinder-quobyte-6c34cc15-3dc6-44ad-ae63-3961d47d8d76" released by "delete_volume" :: held 0.721s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:19:00 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-dded77cd-1931-4249-8654-e3d2a1dd562e tempest-CreateVolumesFromSnapshotTest-91808084 None] Created reservations ['a1ab4e8b-2b06-470d-963a-3136171b4022', '94200c18-748a-4ccc-a10b-7d92575f625f', 'dddbcb5d-7850-43fd-bb58-4d30980b25ce', 'ff8b2951-043f-44b5-90d4-e1a95fa89cda'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:19:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-dded77cd-1931-4249-8654-e3d2a1dd562e tempest-CreateVolumesFromSnapshotTest-91808084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:19:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-dded77cd-1931-4249-8654-e3d2a1dd562e tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:19:00 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-dded77cd-1931-4249-8654-e3d2a1dd562e tempest-CreateVolumesFromSnapshotTest-91808084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:19:00 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-dded77cd-1931-4249-8654-e3d2a1dd562e tempest-CreateVolumesFromSnapshotTest-91808084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:19:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-dded77cd-1931-4249-8654-e3d2a1dd562e tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:19:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-dded77cd-1931-4249-8654-e3d2a1dd562e tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:00 devstack sudo[102572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:19:00 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:00 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-dded77cd-1931-4249-8654-e3d2a1dd562e tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.257s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:00 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-dded77cd-1931-4249-8654-e3d2a1dd562e tempest-CreateVolumesFromSnapshotTest-91808084 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:19:00 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-54650567-11e9-41b3-bc7f-164614106fca tempest-CreateVolumesFromSnapshotTest-91808084 None] Acquiring lock "cinder-d83a4551-8317-446a-ade2-904055aa6c7d-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:19:00 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-dded77cd-1931-4249-8654-e3d2a1dd562e tempest-CreateVolumesFromSnapshotTest-91808084 None] Deleted volume successfully.
Nov 06 17:19:00 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-54650567-11e9-41b3-bc7f-164614106fca tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "cinder-d83a4551-8317-446a-ade2-904055aa6c7d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:19:00 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-dded77cd-1931-4249-8654-e3d2a1dd562e tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "cinder-6c34cc15-3dc6-44ad-ae63-3961d47d8d76-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:19:00 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-54650567-11e9-41b3-bc7f-164614106fca tempest-CreateVolumesFromSnapshotTest-91808084 None] Acquiring lock "cinder-quobyte-d83a4551-8317-446a-ade2-904055aa6c7d" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:19:00 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-54650567-11e9-41b3-bc7f-164614106fca tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "cinder-quobyte-d83a4551-8317-446a-ade2-904055aa6c7d" acquired by "delete_volume" :: waited 0.018s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:19:00 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cee59a-8e4d-4906-bf87-8b32db01ba8d]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:19:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-54650567-11e9-41b3-bc7f-164614106fca tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d83a4551-8317-446a-ade2-904055aa6c7d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:00 devstack sudo[102575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d83a4551-8317-446a-ade2-904055aa6c7d
Nov 06 17:19:00 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:00 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-54650567-11e9-41b3-bc7f-164614106fca tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d83a4551-8317-446a-ade2-904055aa6c7d" returned: 0 in 0.370s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-54650567-11e9-41b3-bc7f-164614106fca tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d83a4551-8317-446a-ade2-904055aa6c7d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:01 devstack sudo[102581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d83a4551-8317-446a-ade2-904055aa6c7d
Nov 06 17:19:01 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:01 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-54650567-11e9-41b3-bc7f-164614106fca tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-d83a4551-8317-446a-ade2-904055aa6c7d" returned: 0 in 0.260s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:01 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-54650567-11e9-41b3-bc7f-164614106fca tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "cinder-quobyte-d83a4551-8317-446a-ade2-904055aa6c7d" released by "delete_volume" :: held 0.684s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:19:01 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-54650567-11e9-41b3-bc7f-164614106fca tempest-CreateVolumesFromSnapshotTest-91808084 None] Created reservations ['13073b53-5a34-4cc5-bf2c-879261c751a3', '60edcd03-e485-463d-863b-0098178c7100', '95c7d103-5ea4-4929-94e7-5d141f292c83', 'd046b865-301f-4106-8ca6-5337f2324835'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:19:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-54650567-11e9-41b3-bc7f-164614106fca tempest-CreateVolumesFromSnapshotTest-91808084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:19:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-54650567-11e9-41b3-bc7f-164614106fca tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:19:01 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-54650567-11e9-41b3-bc7f-164614106fca tempest-CreateVolumesFromSnapshotTest-91808084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:19:01 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-54650567-11e9-41b3-bc7f-164614106fca tempest-CreateVolumesFromSnapshotTest-91808084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:19:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-54650567-11e9-41b3-bc7f-164614106fca tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:19:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-54650567-11e9-41b3-bc7f-164614106fca tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:01 devstack sudo[102584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:19:01 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:01 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-39267756-0a70-418c-a251-d2f28f80aa42 tempest-CreateVolumesFromSnapshotTest-91808084 None] Acquiring lock "cinder-578707d9-d94c-40ae-ae1d-5d8442b7a22f-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:19:01 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-39267756-0a70-418c-a251-d2f28f80aa42 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "cinder-578707d9-d94c-40ae-ae1d-5d8442b7a22f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:19:01 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-39267756-0a70-418c-a251-d2f28f80aa42 tempest-CreateVolumesFromSnapshotTest-91808084 None] Acquiring lock "cinder-quobyte-488466a5-4c10-446c-9fe7-db2ced01e7c7" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:19:01 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-39267756-0a70-418c-a251-d2f28f80aa42 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "cinder-quobyte-488466a5-4c10-446c-9fe7-db2ced01e7c7" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:19:01 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-39267756-0a70-418c-a251-d2f28f80aa42 tempest-CreateVolumesFromSnapshotTest-91808084 None] Acquiring lock "cinder-quobyte-578707d9-d94c-40ae-ae1d-5d8442b7a22f" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:19:01 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-39267756-0a70-418c-a251-d2f28f80aa42 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "cinder-quobyte-578707d9-d94c-40ae-ae1d-5d8442b7a22f" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:19:01 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-39267756-0a70-418c-a251-d2f28f80aa42 tempest-CreateVolumesFromSnapshotTest-91808084 None] Deleting offline snapshot 578707d9-d94c-40ae-ae1d-5d8442b7a22f of volume 488466a5-4c10-446c-9fe7-db2ced01e7c7 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:19:01 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:01 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-39267756-0a70-418c-a251-d2f28f80aa42 tempest-CreateVolumesFromSnapshotTest-91808084 None] snapshot_file for this snap is: volume-488466a5-4c10-446c-9fe7-db2ced01e7c7.578707d9-d94c-40ae-ae1d-5d8442b7a22f {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:19:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-54650567-11e9-41b3-bc7f-164614106fca tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.448s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:01 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-54650567-11e9-41b3-bc7f-164614106fca tempest-CreateVolumesFromSnapshotTest-91808084 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:19:01 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-54650567-11e9-41b3-bc7f-164614106fca tempest-CreateVolumesFromSnapshotTest-91808084 None] Deleted volume successfully.
Nov 06 17:19:01 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c712577-002d-44c0-a886-c08d78d37d54]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:19:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-39267756-0a70-418c-a251-d2f28f80aa42 tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7.578707d9-d94c-40ae-ae1d-5d8442b7a22f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:01 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-54650567-11e9-41b3-bc7f-164614106fca tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "cinder-d83a4551-8317-446a-ade2-904055aa6c7d-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:19:02 devstack sudo[102588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7.578707d9-d94c-40ae-ae1d-5d8442b7a22f
Nov 06 17:19:02 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:02 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-39267756-0a70-418c-a251-d2f28f80aa42 tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7.578707d9-d94c-40ae-ae1d-5d8442b7a22f" returned: 0 in 0.385s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:02 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-39267756-0a70-418c-a251-d2f28f80aa42 tempest-CreateVolumesFromSnapshotTest-91808084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-488466a5-4c10-446c-9fe7-db2ced01e7c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:19:02 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[097dc328-a690-4f19-81b3-f4c34c70cbdc]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:19:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-39267756-0a70-418c-a251-d2f28f80aa42 tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:02 devstack sudo[102593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7
Nov 06 17:19:02 devstack sudo[102593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:02 devstack sudo[102593]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-39267756-0a70-418c-a251-d2f28f80aa42 tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7" returned: 0 in 0.378s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-39267756-0a70-418c-a251-d2f28f80aa42 tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7.578707d9-d94c-40ae-ae1d-5d8442b7a22f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:02 devstack sudo[102598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7.578707d9-d94c-40ae-ae1d-5d8442b7a22f
Nov 06 17:19:02 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:03 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-39267756-0a70-418c-a251-d2f28f80aa42 tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7.578707d9-d94c-40ae-ae1d-5d8442b7a22f" returned: 0 in 0.371s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-39267756-0a70-418c-a251-d2f28f80aa42 tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7.578707d9-d94c-40ae-ae1d-5d8442b7a22f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:03 devstack sudo[102604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7.578707d9-d94c-40ae-ae1d-5d8442b7a22f
Nov 06 17:19:03 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:03 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-39267756-0a70-418c-a251-d2f28f80aa42 tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7.578707d9-d94c-40ae-ae1d-5d8442b7a22f" returned: 0 in 0.261s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:03 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-39267756-0a70-418c-a251-d2f28f80aa42 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "cinder-quobyte-578707d9-d94c-40ae-ae1d-5d8442b7a22f" released by "_delete_snapshot" :: held 1.545s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:19:03 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-39267756-0a70-418c-a251-d2f28f80aa42 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "cinder-quobyte-488466a5-4c10-446c-9fe7-db2ced01e7c7" released by "delete_snapshot" :: held 1.579s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:19:03 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-39267756-0a70-418c-a251-d2f28f80aa42 tempest-CreateVolumesFromSnapshotTest-91808084 None] Created reservations ['66f68762-5e7e-4591-9360-e2852e9d3510', '460fadcd-7092-4efc-b5d8-d25bb1f26719', '0c1f7ae9-b877-4ed1-a74b-f2c09ebb85b4', '5c54eb90-dfab-4b84-9608-af9cd63dfb70'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:19:03 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-39267756-0a70-418c-a251-d2f28f80aa42 tempest-CreateVolumesFromSnapshotTest-91808084 None] Delete snapshot completed successfully.
Nov 06 17:19:03 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-39267756-0a70-418c-a251-d2f28f80aa42 tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "cinder-578707d9-d94c-40ae-ae1d-5d8442b7a22f-delete_snapshot" released by "delete_snapshot" :: held 1.735s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:19:03 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-0b95186e-6cca-4443-976b-38a44fb3437c tempest-CreateVolumesFromSnapshotTest-91808084 None] Acquiring lock "cinder-488466a5-4c10-446c-9fe7-db2ced01e7c7-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:19:03 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-0b95186e-6cca-4443-976b-38a44fb3437c tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "cinder-488466a5-4c10-446c-9fe7-db2ced01e7c7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:19:03 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-0b95186e-6cca-4443-976b-38a44fb3437c tempest-CreateVolumesFromSnapshotTest-91808084 None] Acquiring lock "cinder-quobyte-488466a5-4c10-446c-9fe7-db2ced01e7c7" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:19:04 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-0b95186e-6cca-4443-976b-38a44fb3437c tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "cinder-quobyte-488466a5-4c10-446c-9fe7-db2ced01e7c7" acquired by "delete_volume" :: waited 0.024s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:19:04 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[6104dcd6-7404-4077-8af2-c25c95b1f869]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:19:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0b95186e-6cca-4443-976b-38a44fb3437c tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:04 devstack sudo[102607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7
Nov 06 17:19:04 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:04 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0b95186e-6cca-4443-976b-38a44fb3437c tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7" returned: 0 in 0.395s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0b95186e-6cca-4443-976b-38a44fb3437c tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:04 devstack sudo[102613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7
Nov 06 17:19:04 devstack sudo[102613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:04 devstack sudo[102613]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0b95186e-6cca-4443-976b-38a44fb3437c tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-488466a5-4c10-446c-9fe7-db2ced01e7c7" returned: 0 in 0.249s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:04 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-0b95186e-6cca-4443-976b-38a44fb3437c tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "cinder-quobyte-488466a5-4c10-446c-9fe7-db2ced01e7c7" released by "delete_volume" :: held 0.727s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:19:04 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-0b95186e-6cca-4443-976b-38a44fb3437c tempest-CreateVolumesFromSnapshotTest-91808084 None] Created reservations ['8bc87920-8f97-4d58-8daa-516ddf84ef7d', '5f7dc124-682b-4a7c-9ba9-1e7381fb64a2', '38e7b723-4ffb-4fcc-b9c6-c60779b67858', '70cfca54-473b-4751-be58-cbbacf9ec04d'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:19:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0b95186e-6cca-4443-976b-38a44fb3437c tempest-CreateVolumesFromSnapshotTest-91808084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:19:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0b95186e-6cca-4443-976b-38a44fb3437c tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:19:04 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0b95186e-6cca-4443-976b-38a44fb3437c tempest-CreateVolumesFromSnapshotTest-91808084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:19:04 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0b95186e-6cca-4443-976b-38a44fb3437c tempest-CreateVolumesFromSnapshotTest-91808084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:19:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0b95186e-6cca-4443-976b-38a44fb3437c tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:19:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0b95186e-6cca-4443-976b-38a44fb3437c tempest-CreateVolumesFromSnapshotTest-91808084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:04 devstack sudo[102616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:19:04 devstack sudo[102616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:05 devstack sudo[102616]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0b95186e-6cca-4443-976b-38a44fb3437c tempest-CreateVolumesFromSnapshotTest-91808084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.284s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:05 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-0b95186e-6cca-4443-976b-38a44fb3437c tempest-CreateVolumesFromSnapshotTest-91808084 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:19:05 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-0b95186e-6cca-4443-976b-38a44fb3437c tempest-CreateVolumesFromSnapshotTest-91808084 None] Deleted volume successfully.
Nov 06 17:19:05 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-0b95186e-6cca-4443-976b-38a44fb3437c tempest-CreateVolumesFromSnapshotTest-91808084 None] Lock "cinder-488466a5-4c10-446c-9fe7-db2ced01e7c7-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:19:09 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-aff8b2c1-39c1-4b97-85cd-cffdc8700202 tempest-ProjectReaderTests-876868834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:19:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-aff8b2c1-39c1-4b97-85cd-cffdc8700202 tempest-ProjectReaderTests-876868834 None] Flow 'volume_create_manager' (f08bea11-01cb-4ba7-b5be-0522bbd6b428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:19:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-aff8b2c1-39c1-4b97-85cd-cffdc8700202 tempest-ProjectReaderTests-876868834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aa0ed55-fe09-44f6-b482-7184a544f6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:19:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-aff8b2c1-39c1-4b97-85cd-cffdc8700202 tempest-ProjectReaderTests-876868834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aa0ed55-fe09-44f6-b482-7184a544f6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-866243267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3e4aa47-0f88-4ee5-acd3-bc69baca12f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6bb74112a574f2ca77a8c7f4123aaef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:19:09Z,use_quota=True,user_id='7cb04ca1b49147b8b3ec9ce4fbf23662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:19:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-aff8b2c1-39c1-4b97-85cd-cffdc8700202 tempest-ProjectReaderTests-876868834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6794a65-9dca-4fb8-ae8f-90b3a472e846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:19:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-aff8b2c1-39c1-4b97-85cd-cffdc8700202 tempest-ProjectReaderTests-876868834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6794a65-9dca-4fb8-ae8f-90b3a472e846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:19:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-aff8b2c1-39c1-4b97-85cd-cffdc8700202 tempest-ProjectReaderTests-876868834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d35242e2-2d0b-4a42-8fd0-36b8f0f2b8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:19:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-aff8b2c1-39c1-4b97-85cd-cffdc8700202 tempest-ProjectReaderTests-876868834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d35242e2-2d0b-4a42-8fd0-36b8f0f2b8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3e4aa47-0f88-4ee5-acd3-bc69baca12f2', 'volume_name': 'volume-e3e4aa47-0f88-4ee5-acd3-bc69baca12f2', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:19:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-aff8b2c1-39c1-4b97-85cd-cffdc8700202 tempest-ProjectReaderTests-876868834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31d71f9d-bd9f-4127-a3f6-9105c1252121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:19:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-aff8b2c1-39c1-4b97-85cd-cffdc8700202 tempest-ProjectReaderTests-876868834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31d71f9d-bd9f-4127-a3f6-9105c1252121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:19:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-aff8b2c1-39c1-4b97-85cd-cffdc8700202 tempest-ProjectReaderTests-876868834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc04f28b-f26d-409b-9edd-a980a8d7214d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:19:09 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-aff8b2c1-39c1-4b97-85cd-cffdc8700202 tempest-ProjectReaderTests-876868834 None] Volume e3e4aa47-0f88-4ee5-acd3-bc69baca12f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3e4aa47-0f88-4ee5-acd3-bc69baca12f2', 'volume_size': 1}
Nov 06 17:19:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-aff8b2c1-39c1-4b97-85cd-cffdc8700202 tempest-ProjectReaderTests-876868834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:19:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-aff8b2c1-39c1-4b97-85cd-cffdc8700202 tempest-ProjectReaderTests-876868834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:19:09 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-aff8b2c1-39c1-4b97-85cd-cffdc8700202 tempest-ProjectReaderTests-876868834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-866243267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3e4aa47-0f88-4ee5-acd3-bc69baca12f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6bb74112a574f2ca77a8c7f4123aaef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:19:09Z,use_quota=True,user_id='7cb04ca1b49147b8b3ec9ce4fbf23662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:19:09 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-aff8b2c1-39c1-4b97-85cd-cffdc8700202 tempest-ProjectReaderTests-876868834 None] Creating volume e3e4aa47-0f88-4ee5-acd3-bc69baca12f2 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:19:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-aff8b2c1-39c1-4b97-85cd-cffdc8700202 tempest-ProjectReaderTests-876868834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:19:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-aff8b2c1-39c1-4b97-85cd-cffdc8700202 tempest-ProjectReaderTests-876868834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:19:09 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-aff8b2c1-39c1-4b97-85cd-cffdc8700202 tempest-ProjectReaderTests-876868834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:19:09 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-aff8b2c1-39c1-4b97-85cd-cffdc8700202 tempest-ProjectReaderTests-876868834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:19:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-aff8b2c1-39c1-4b97-85cd-cffdc8700202 tempest-ProjectReaderTests-876868834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:19:09 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-aff8b2c1-39c1-4b97-85cd-cffdc8700202 tempest-ProjectReaderTests-876868834 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:19:09 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-aff8b2c1-39c1-4b97-85cd-cffdc8700202 tempest-ProjectReaderTests-876868834 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:19:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-aff8b2c1-39c1-4b97-85cd-cffdc8700202 tempest-ProjectReaderTests-876868834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e3e4aa47-0f88-4ee5-acd3-bc69baca12f2 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:09 devstack sudo[102619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e3e4aa47-0f88-4ee5-acd3-bc69baca12f2 1073741824
Nov 06 17:19:09 devstack sudo[102619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:09 devstack sudo[102619]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-aff8b2c1-39c1-4b97-85cd-cffdc8700202 tempest-ProjectReaderTests-876868834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e3e4aa47-0f88-4ee5-acd3-bc69baca12f2 1073741824" returned: 0 in 0.515s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-aff8b2c1-39c1-4b97-85cd-cffdc8700202 tempest-ProjectReaderTests-876868834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e3e4aa47-0f88-4ee5-acd3-bc69baca12f2 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:09 devstack sudo[102625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e3e4aa47-0f88-4ee5-acd3-bc69baca12f2
Nov 06 17:19:09 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:09 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-aff8b2c1-39c1-4b97-85cd-cffdc8700202 tempest-ProjectReaderTests-876868834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e3e4aa47-0f88-4ee5-acd3-bc69baca12f2" returned: 0 in 0.255s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:09 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-aff8b2c1-39c1-4b97-85cd-cffdc8700202 tempest-ProjectReaderTests-876868834 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:19:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-aff8b2c1-39c1-4b97-85cd-cffdc8700202 tempest-ProjectReaderTests-876868834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:19:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-aff8b2c1-39c1-4b97-85cd-cffdc8700202 tempest-ProjectReaderTests-876868834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc04f28b-f26d-409b-9edd-a980a8d7214d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3e4aa47-0f88-4ee5-acd3-bc69baca12f2', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:19:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-aff8b2c1-39c1-4b97-85cd-cffdc8700202 tempest-ProjectReaderTests-876868834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01b5ae52-0dfb-44cd-8118-8948c0e2a23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:19:09 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-aff8b2c1-39c1-4b97-85cd-cffdc8700202 tempest-ProjectReaderTests-876868834 None] Volume volume-e3e4aa47-0f88-4ee5-acd3-bc69baca12f2 (e3e4aa47-0f88-4ee5-acd3-bc69baca12f2): created successfully
Nov 06 17:19:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-aff8b2c1-39c1-4b97-85cd-cffdc8700202 tempest-ProjectReaderTests-876868834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01b5ae52-0dfb-44cd-8118-8948c0e2a23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:19:09 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-aff8b2c1-39c1-4b97-85cd-cffdc8700202 tempest-ProjectReaderTests-876868834 None] Flow 'volume_create_manager' (f08bea11-01cb-4ba7-b5be-0522bbd6b428) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:19:10 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-aff8b2c1-39c1-4b97-85cd-cffdc8700202 tempest-ProjectReaderTests-876868834 None] Created volume successfully.
Nov 06 17:19:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ab0de55f-9793-4af5-9f6b-8310217a7b6a tempest-ProjectReaderTests-876868834 None] Acquiring lock "cinder-e3e4aa47-0f88-4ee5-acd3-bc69baca12f2-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:19:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ab0de55f-9793-4af5-9f6b-8310217a7b6a tempest-ProjectReaderTests-876868834 None] Lock "cinder-e3e4aa47-0f88-4ee5-acd3-bc69baca12f2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:19:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ab0de55f-9793-4af5-9f6b-8310217a7b6a tempest-ProjectReaderTests-876868834 None] Acquiring lock "cinder-quobyte-e3e4aa47-0f88-4ee5-acd3-bc69baca12f2" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:19:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ab0de55f-9793-4af5-9f6b-8310217a7b6a tempest-ProjectReaderTests-876868834 None] Lock "cinder-quobyte-e3e4aa47-0f88-4ee5-acd3-bc69baca12f2" acquired by "delete_volume" :: waited 0.015s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:19:11 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d23049-d43b-44e0-a7f3-1ce2959c3592]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:19:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab0de55f-9793-4af5-9f6b-8310217a7b6a tempest-ProjectReaderTests-876868834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e3e4aa47-0f88-4ee5-acd3-bc69baca12f2 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:11 devstack sudo[102629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e3e4aa47-0f88-4ee5-acd3-bc69baca12f2
Nov 06 17:19:11 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:11 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab0de55f-9793-4af5-9f6b-8310217a7b6a tempest-ProjectReaderTests-876868834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e3e4aa47-0f88-4ee5-acd3-bc69baca12f2" returned: 0 in 0.365s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab0de55f-9793-4af5-9f6b-8310217a7b6a tempest-ProjectReaderTests-876868834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e3e4aa47-0f88-4ee5-acd3-bc69baca12f2 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:11 devstack sudo[102634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e3e4aa47-0f88-4ee5-acd3-bc69baca12f2
Nov 06 17:19:11 devstack sudo[102634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:12 devstack sudo[102634]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab0de55f-9793-4af5-9f6b-8310217a7b6a tempest-ProjectReaderTests-876868834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e3e4aa47-0f88-4ee5-acd3-bc69baca12f2" returned: 0 in 0.251s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:12 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ab0de55f-9793-4af5-9f6b-8310217a7b6a tempest-ProjectReaderTests-876868834 None] Lock "cinder-quobyte-e3e4aa47-0f88-4ee5-acd3-bc69baca12f2" released by "delete_volume" :: held 0.671s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:19:12 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-ab0de55f-9793-4af5-9f6b-8310217a7b6a tempest-ProjectReaderTests-876868834 None] Created reservations ['fce82c45-922f-41a5-9910-eb1c9fecd1df', 'd688adc2-9605-4acb-9873-d4c2bf32c04d', 'f92e9ea0-a597-40b4-85c6-d2683099b9af', '6351a934-416e-4f18-9954-bba57e4ad370'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:19:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ab0de55f-9793-4af5-9f6b-8310217a7b6a tempest-ProjectReaderTests-876868834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:19:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ab0de55f-9793-4af5-9f6b-8310217a7b6a tempest-ProjectReaderTests-876868834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:19:12 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ab0de55f-9793-4af5-9f6b-8310217a7b6a tempest-ProjectReaderTests-876868834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:19:12 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ab0de55f-9793-4af5-9f6b-8310217a7b6a tempest-ProjectReaderTests-876868834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:19:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ab0de55f-9793-4af5-9f6b-8310217a7b6a tempest-ProjectReaderTests-876868834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:19:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab0de55f-9793-4af5-9f6b-8310217a7b6a tempest-ProjectReaderTests-876868834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:12 devstack sudo[102637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:19:12 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:12 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab0de55f-9793-4af5-9f6b-8310217a7b6a tempest-ProjectReaderTests-876868834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.259s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:12 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-ab0de55f-9793-4af5-9f6b-8310217a7b6a tempest-ProjectReaderTests-876868834 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:19:12 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-ab0de55f-9793-4af5-9f6b-8310217a7b6a tempest-ProjectReaderTests-876868834 None] Deleted volume successfully.
Nov 06 17:19:12 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ab0de55f-9793-4af5-9f6b-8310217a7b6a tempest-ProjectReaderTests-876868834 None] Lock "cinder-e3e4aa47-0f88-4ee5-acd3-bc69baca12f2-delete_volume" released by "delete_volume" :: held 1.156s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:19:13 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab749b52-9e65-4c62-9d57-5aadea029035 tempest-ProjectReaderTests-876868834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:19:13 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ab749b52-9e65-4c62-9d57-5aadea029035 tempest-ProjectReaderTests-876868834 None] Flow 'volume_create_manager' (50d3ec01-0a9b-4df7-8d4b-68f6c030d1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:19:13 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ab749b52-9e65-4c62-9d57-5aadea029035 tempest-ProjectReaderTests-876868834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1583c80e-7c37-40f6-ba58-1b1c4c9a5ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:19:13 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ab749b52-9e65-4c62-9d57-5aadea029035 tempest-ProjectReaderTests-876868834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1583c80e-7c37-40f6-ba58-1b1c4c9a5ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2031976115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=614abf33-03a2-484c-9cd4-421f822f2521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6bb74112a574f2ca77a8c7f4123aaef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:19:13Z,use_quota=True,user_id='7cb04ca1b49147b8b3ec9ce4fbf23662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:19:13 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ab749b52-9e65-4c62-9d57-5aadea029035 tempest-ProjectReaderTests-876868834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5eddb72-46e5-4421-8e18-ccdc8c66901e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:19:13 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ab749b52-9e65-4c62-9d57-5aadea029035 tempest-ProjectReaderTests-876868834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5eddb72-46e5-4421-8e18-ccdc8c66901e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:19:13 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ab749b52-9e65-4c62-9d57-5aadea029035 tempest-ProjectReaderTests-876868834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa966956-f19a-4d83-91bd-54b21f8653bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:19:13 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ab749b52-9e65-4c62-9d57-5aadea029035 tempest-ProjectReaderTests-876868834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa966956-f19a-4d83-91bd-54b21f8653bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '614abf33-03a2-484c-9cd4-421f822f2521', 'volume_name': 'volume-614abf33-03a2-484c-9cd4-421f822f2521', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:19:13 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ab749b52-9e65-4c62-9d57-5aadea029035 tempest-ProjectReaderTests-876868834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d31fb6f0-1d50-42bd-a864-8f60642b54bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:19:13 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ab749b52-9e65-4c62-9d57-5aadea029035 tempest-ProjectReaderTests-876868834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d31fb6f0-1d50-42bd-a864-8f60642b54bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:19:13 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ab749b52-9e65-4c62-9d57-5aadea029035 tempest-ProjectReaderTests-876868834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (954c089e-92ef-4c12-9c5f-eaf3d9abf8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:19:13 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-ab749b52-9e65-4c62-9d57-5aadea029035 tempest-ProjectReaderTests-876868834 None] Volume 614abf33-03a2-484c-9cd4-421f822f2521: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-614abf33-03a2-484c-9cd4-421f822f2521', 'volume_size': 1}
Nov 06 17:19:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ab749b52-9e65-4c62-9d57-5aadea029035 tempest-ProjectReaderTests-876868834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:19:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ab749b52-9e65-4c62-9d57-5aadea029035 tempest-ProjectReaderTests-876868834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:19:13 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ab749b52-9e65-4c62-9d57-5aadea029035 tempest-ProjectReaderTests-876868834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2031976115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=614abf33-03a2-484c-9cd4-421f822f2521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6bb74112a574f2ca77a8c7f4123aaef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:19:13Z,use_quota=True,user_id='7cb04ca1b49147b8b3ec9ce4fbf23662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:19:13 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-ab749b52-9e65-4c62-9d57-5aadea029035 tempest-ProjectReaderTests-876868834 None] Creating volume 614abf33-03a2-484c-9cd4-421f822f2521 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:19:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ab749b52-9e65-4c62-9d57-5aadea029035 tempest-ProjectReaderTests-876868834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:19:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ab749b52-9e65-4c62-9d57-5aadea029035 tempest-ProjectReaderTests-876868834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:19:13 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ab749b52-9e65-4c62-9d57-5aadea029035 tempest-ProjectReaderTests-876868834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:19:13 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ab749b52-9e65-4c62-9d57-5aadea029035 tempest-ProjectReaderTests-876868834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:19:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ab749b52-9e65-4c62-9d57-5aadea029035 tempest-ProjectReaderTests-876868834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:19:13 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ab749b52-9e65-4c62-9d57-5aadea029035 tempest-ProjectReaderTests-876868834 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:19:13 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-ab749b52-9e65-4c62-9d57-5aadea029035 tempest-ProjectReaderTests-876868834 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:19:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab749b52-9e65-4c62-9d57-5aadea029035 tempest-ProjectReaderTests-876868834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-614abf33-03a2-484c-9cd4-421f822f2521 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:13 devstack sudo[102640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-614abf33-03a2-484c-9cd4-421f822f2521 1073741824
Nov 06 17:19:13 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:13 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab749b52-9e65-4c62-9d57-5aadea029035 tempest-ProjectReaderTests-876868834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-614abf33-03a2-484c-9cd4-421f822f2521 1073741824" returned: 0 in 0.499s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab749b52-9e65-4c62-9d57-5aadea029035 tempest-ProjectReaderTests-876868834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-614abf33-03a2-484c-9cd4-421f822f2521 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:13 devstack sudo[102647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-614abf33-03a2-484c-9cd4-421f822f2521
Nov 06 17:19:13 devstack sudo[102647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:14 devstack sudo[102647]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab749b52-9e65-4c62-9d57-5aadea029035 tempest-ProjectReaderTests-876868834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-614abf33-03a2-484c-9cd4-421f822f2521" returned: 0 in 0.249s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:14 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ab749b52-9e65-4c62-9d57-5aadea029035 tempest-ProjectReaderTests-876868834 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:19:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ab749b52-9e65-4c62-9d57-5aadea029035 tempest-ProjectReaderTests-876868834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:19:14 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ab749b52-9e65-4c62-9d57-5aadea029035 tempest-ProjectReaderTests-876868834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (954c089e-92ef-4c12-9c5f-eaf3d9abf8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-614abf33-03a2-484c-9cd4-421f822f2521', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:19:14 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ab749b52-9e65-4c62-9d57-5aadea029035 tempest-ProjectReaderTests-876868834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a1e9a80-6441-4576-aa04-4d38accde109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:19:14 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-ab749b52-9e65-4c62-9d57-5aadea029035 tempest-ProjectReaderTests-876868834 None] Volume volume-614abf33-03a2-484c-9cd4-421f822f2521 (614abf33-03a2-484c-9cd4-421f822f2521): created successfully
Nov 06 17:19:14 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ab749b52-9e65-4c62-9d57-5aadea029035 tempest-ProjectReaderTests-876868834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a1e9a80-6441-4576-aa04-4d38accde109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:19:14 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ab749b52-9e65-4c62-9d57-5aadea029035 tempest-ProjectReaderTests-876868834 None] Flow 'volume_create_manager' (50d3ec01-0a9b-4df7-8d4b-68f6c030d1a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:19:14 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-ab749b52-9e65-4c62-9d57-5aadea029035 tempest-ProjectReaderTests-876868834 None] Created volume successfully.
Nov 06 17:19:15 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-02eb1064-4086-4c73-a38e-144f96d9d347 tempest-ProjectReaderTests-876868834 None] Acquiring lock "cinder-614abf33-03a2-484c-9cd4-421f822f2521-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:19:15 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-02eb1064-4086-4c73-a38e-144f96d9d347 tempest-ProjectReaderTests-876868834 None] Lock "cinder-614abf33-03a2-484c-9cd4-421f822f2521-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:19:15 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-02eb1064-4086-4c73-a38e-144f96d9d347 tempest-ProjectReaderTests-876868834 None] Acquiring lock "cinder-quobyte-614abf33-03a2-484c-9cd4-421f822f2521" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:19:15 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-02eb1064-4086-4c73-a38e-144f96d9d347 tempest-ProjectReaderTests-876868834 None] Lock "cinder-quobyte-614abf33-03a2-484c-9cd4-421f822f2521" acquired by "delete_volume" :: waited 0.025s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:19:15 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7c1afa-a888-4ed8-a055-b2ff109a2f9a]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:19:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-02eb1064-4086-4c73-a38e-144f96d9d347 tempest-ProjectReaderTests-876868834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-614abf33-03a2-484c-9cd4-421f822f2521 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:15 devstack sudo[102650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-614abf33-03a2-484c-9cd4-421f822f2521
Nov 06 17:19:15 devstack sudo[102650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:15 devstack sudo[102650]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-02eb1064-4086-4c73-a38e-144f96d9d347 tempest-ProjectReaderTests-876868834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-614abf33-03a2-484c-9cd4-421f822f2521" returned: 0 in 0.391s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-02eb1064-4086-4c73-a38e-144f96d9d347 tempest-ProjectReaderTests-876868834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-614abf33-03a2-484c-9cd4-421f822f2521 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:15 devstack sudo[102655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-614abf33-03a2-484c-9cd4-421f822f2521
Nov 06 17:19:15 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:16 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-02eb1064-4086-4c73-a38e-144f96d9d347 tempest-ProjectReaderTests-876868834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-614abf33-03a2-484c-9cd4-421f822f2521" returned: 0 in 0.267s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:16 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-02eb1064-4086-4c73-a38e-144f96d9d347 tempest-ProjectReaderTests-876868834 None] Lock "cinder-quobyte-614abf33-03a2-484c-9cd4-421f822f2521" released by "delete_volume" :: held 0.709s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:19:16 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-02eb1064-4086-4c73-a38e-144f96d9d347 tempest-ProjectReaderTests-876868834 None] Created reservations ['25f4e189-517e-463d-87bd-c4c493077042', 'b8bdcde8-e17c-46b9-9c0c-30de8339b5ee', 'd0b04855-34cd-4f6e-b34e-678940d2a800', 'fba92de2-cf9b-431b-828f-e90bc449d9c8'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:19:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-02eb1064-4086-4c73-a38e-144f96d9d347 tempest-ProjectReaderTests-876868834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:19:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-02eb1064-4086-4c73-a38e-144f96d9d347 tempest-ProjectReaderTests-876868834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:19:16 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-02eb1064-4086-4c73-a38e-144f96d9d347 tempest-ProjectReaderTests-876868834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:19:16 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-02eb1064-4086-4c73-a38e-144f96d9d347 tempest-ProjectReaderTests-876868834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:19:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-02eb1064-4086-4c73-a38e-144f96d9d347 tempest-ProjectReaderTests-876868834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:19:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-02eb1064-4086-4c73-a38e-144f96d9d347 tempest-ProjectReaderTests-876868834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:16 devstack sudo[102658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:19:16 devstack sudo[102658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:16 devstack sudo[102658]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-02eb1064-4086-4c73-a38e-144f96d9d347 tempest-ProjectReaderTests-876868834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.280s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:16 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-02eb1064-4086-4c73-a38e-144f96d9d347 tempest-ProjectReaderTests-876868834 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:19:16 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-02eb1064-4086-4c73-a38e-144f96d9d347 tempest-ProjectReaderTests-876868834 None] Deleted volume successfully.
Nov 06 17:19:16 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-02eb1064-4086-4c73-a38e-144f96d9d347 tempest-ProjectReaderTests-876868834 None] Lock "cinder-614abf33-03a2-484c-9cd4-421f822f2521-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:19:22 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-55852dd0-2322-42f6-a83f-a34b5a6ca7f8 tempest-TestStampPattern-1009918079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:19:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-55852dd0-2322-42f6-a83f-a34b5a6ca7f8 tempest-TestStampPattern-1009918079 None] Flow 'volume_create_manager' (eab94124-371b-47d5-90b8-d2055b8c0c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:19:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-55852dd0-2322-42f6-a83f-a34b5a6ca7f8 tempest-TestStampPattern-1009918079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d51d0d9-4341-4fda-b021-2e6fcf4c621f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:19:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-55852dd0-2322-42f6-a83f-a34b5a6ca7f8 tempest-TestStampPattern-1009918079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d51d0d9-4341-4fda-b021-2e6fcf4c621f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1777948959',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59dcfba4-41a4-46f5-a86a-7b2bc2a58862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8ec80594d394c1eb22f575d0c697d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:19:22Z,use_quota=True,user_id='0445cdff95734588a3ba94031f83d217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:19:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-55852dd0-2322-42f6-a83f-a34b5a6ca7f8 tempest-TestStampPattern-1009918079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ab82648-38e7-4a45-bf97-6d221fa9ab30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:19:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-55852dd0-2322-42f6-a83f-a34b5a6ca7f8 tempest-TestStampPattern-1009918079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ab82648-38e7-4a45-bf97-6d221fa9ab30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:19:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-55852dd0-2322-42f6-a83f-a34b5a6ca7f8 tempest-TestStampPattern-1009918079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1adbd93-dba7-4a0a-a833-bd987130a3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:19:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-55852dd0-2322-42f6-a83f-a34b5a6ca7f8 tempest-TestStampPattern-1009918079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1adbd93-dba7-4a0a-a833-bd987130a3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59dcfba4-41a4-46f5-a86a-7b2bc2a58862', 'volume_name': 'volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:19:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-55852dd0-2322-42f6-a83f-a34b5a6ca7f8 tempest-TestStampPattern-1009918079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28db6434-79f6-427a-9cb9-e2bf96634d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:19:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-55852dd0-2322-42f6-a83f-a34b5a6ca7f8 tempest-TestStampPattern-1009918079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28db6434-79f6-427a-9cb9-e2bf96634d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:19:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-55852dd0-2322-42f6-a83f-a34b5a6ca7f8 tempest-TestStampPattern-1009918079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11588e80-6758-45ec-aa90-ad294d66cd8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:19:22 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-55852dd0-2322-42f6-a83f-a34b5a6ca7f8 tempest-TestStampPattern-1009918079 None] Volume 59dcfba4-41a4-46f5-a86a-7b2bc2a58862: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862', 'volume_size': 1}
Nov 06 17:19:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-55852dd0-2322-42f6-a83f-a34b5a6ca7f8 tempest-TestStampPattern-1009918079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:19:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-55852dd0-2322-42f6-a83f-a34b5a6ca7f8 tempest-TestStampPattern-1009918079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:19:22 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-55852dd0-2322-42f6-a83f-a34b5a6ca7f8 tempest-TestStampPattern-1009918079 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1777948959',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59dcfba4-41a4-46f5-a86a-7b2bc2a58862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8ec80594d394c1eb22f575d0c697d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:19:22Z,use_quota=True,user_id='0445cdff95734588a3ba94031f83d217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:19:22 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-55852dd0-2322-42f6-a83f-a34b5a6ca7f8 tempest-TestStampPattern-1009918079 None] Creating volume 59dcfba4-41a4-46f5-a86a-7b2bc2a58862 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:19:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-55852dd0-2322-42f6-a83f-a34b5a6ca7f8 tempest-TestStampPattern-1009918079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:19:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-55852dd0-2322-42f6-a83f-a34b5a6ca7f8 tempest-TestStampPattern-1009918079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:19:22 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-55852dd0-2322-42f6-a83f-a34b5a6ca7f8 tempest-TestStampPattern-1009918079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:19:22 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-55852dd0-2322-42f6-a83f-a34b5a6ca7f8 tempest-TestStampPattern-1009918079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:19:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-55852dd0-2322-42f6-a83f-a34b5a6ca7f8 tempest-TestStampPattern-1009918079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:19:22 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-55852dd0-2322-42f6-a83f-a34b5a6ca7f8 tempest-TestStampPattern-1009918079 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:19:22 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-55852dd0-2322-42f6-a83f-a34b5a6ca7f8 tempest-TestStampPattern-1009918079 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:19:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-55852dd0-2322-42f6-a83f-a34b5a6ca7f8 tempest-TestStampPattern-1009918079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:22 devstack sudo[102662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862 1073741824
Nov 06 17:19:22 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:22 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-55852dd0-2322-42f6-a83f-a34b5a6ca7f8 tempest-TestStampPattern-1009918079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862 1073741824" returned: 0 in 0.527s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-55852dd0-2322-42f6-a83f-a34b5a6ca7f8 tempest-TestStampPattern-1009918079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:22 devstack sudo[102669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862
Nov 06 17:19:22 devstack sudo[102669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:23 devstack sudo[102669]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-55852dd0-2322-42f6-a83f-a34b5a6ca7f8 tempest-TestStampPattern-1009918079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862" returned: 0 in 0.313s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:23 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-55852dd0-2322-42f6-a83f-a34b5a6ca7f8 tempest-TestStampPattern-1009918079 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:19:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-55852dd0-2322-42f6-a83f-a34b5a6ca7f8 tempest-TestStampPattern-1009918079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:19:23 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-55852dd0-2322-42f6-a83f-a34b5a6ca7f8 tempest-TestStampPattern-1009918079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11588e80-6758-45ec-aa90-ad294d66cd8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:19:23 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-55852dd0-2322-42f6-a83f-a34b5a6ca7f8 tempest-TestStampPattern-1009918079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c5975b2-f6d2-485f-bce7-14e063b535e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:19:23 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-55852dd0-2322-42f6-a83f-a34b5a6ca7f8 tempest-TestStampPattern-1009918079 None] Volume volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862 (59dcfba4-41a4-46f5-a86a-7b2bc2a58862): created successfully
Nov 06 17:19:23 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-55852dd0-2322-42f6-a83f-a34b5a6ca7f8 tempest-TestStampPattern-1009918079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c5975b2-f6d2-485f-bce7-14e063b535e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:19:23 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-55852dd0-2322-42f6-a83f-a34b5a6ca7f8 tempest-TestStampPattern-1009918079 None] Flow 'volume_create_manager' (eab94124-371b-47d5-90b8-d2055b8c0c11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:19:23 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-55852dd0-2322-42f6-a83f-a34b5a6ca7f8 tempest-TestStampPattern-1009918079 None] Created volume successfully.
Nov 06 17:19:33 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=81,cinder:INSERT=23,cinder:UPDATE=109,cinder:DELETE=10 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:19:33 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=65,cinder:UPDATE=103,cinder:INSERT=27,cinder:DELETE=9 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:19:41 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-5329d780-bebf-4a9e-b859-b8307afe50d4 tempest-SnapshotDependencyTests-1520712453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:19:41 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5329d780-bebf-4a9e-b859-b8307afe50d4 tempest-SnapshotDependencyTests-1520712453 None] Flow 'volume_create_manager' (898a82fa-d19a-486c-a16c-03510fbb3511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:19:41 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5329d780-bebf-4a9e-b859-b8307afe50d4 tempest-SnapshotDependencyTests-1520712453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2fd748c-d19c-4dda-866f-79e0a035d014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:19:41 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5329d780-bebf-4a9e-b859-b8307afe50d4 tempest-SnapshotDependencyTests-1520712453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2fd748c-d19c-4dda-866f-79e0a035d014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-375271900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fbf03c9-bea8-4068-934d-85efd970301a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd58045364d5466ab3fa855ddda83559',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:19:41Z,use_quota=True,user_id='b3a12c4339db484fa07ed446869f11e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:19:41 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5329d780-bebf-4a9e-b859-b8307afe50d4 tempest-SnapshotDependencyTests-1520712453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee45135f-c2ee-419c-828d-286238b4cba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:19:41 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5329d780-bebf-4a9e-b859-b8307afe50d4 tempest-SnapshotDependencyTests-1520712453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee45135f-c2ee-419c-828d-286238b4cba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:19:41 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5329d780-bebf-4a9e-b859-b8307afe50d4 tempest-SnapshotDependencyTests-1520712453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (808021c3-16a8-4ac2-b691-5ad776c7bd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:19:41 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5329d780-bebf-4a9e-b859-b8307afe50d4 tempest-SnapshotDependencyTests-1520712453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (808021c3-16a8-4ac2-b691-5ad776c7bd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fbf03c9-bea8-4068-934d-85efd970301a', 'volume_name': 'volume-2fbf03c9-bea8-4068-934d-85efd970301a', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:19:41 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5329d780-bebf-4a9e-b859-b8307afe50d4 tempest-SnapshotDependencyTests-1520712453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2e903c4-376c-479c-8177-55e568f89022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:19:41 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5329d780-bebf-4a9e-b859-b8307afe50d4 tempest-SnapshotDependencyTests-1520712453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2e903c4-376c-479c-8177-55e568f89022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:19:41 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5329d780-bebf-4a9e-b859-b8307afe50d4 tempest-SnapshotDependencyTests-1520712453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cba00db-6c00-45c8-bc10-9502fbe9d2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:19:41 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-5329d780-bebf-4a9e-b859-b8307afe50d4 tempest-SnapshotDependencyTests-1520712453 None] Volume 2fbf03c9-bea8-4068-934d-85efd970301a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fbf03c9-bea8-4068-934d-85efd970301a', 'volume_size': 1}
Nov 06 17:19:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5329d780-bebf-4a9e-b859-b8307afe50d4 tempest-SnapshotDependencyTests-1520712453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:19:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5329d780-bebf-4a9e-b859-b8307afe50d4 tempest-SnapshotDependencyTests-1520712453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:19:41 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5329d780-bebf-4a9e-b859-b8307afe50d4 tempest-SnapshotDependencyTests-1520712453 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-375271900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fbf03c9-bea8-4068-934d-85efd970301a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd58045364d5466ab3fa855ddda83559',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:19:41Z,use_quota=True,user_id='b3a12c4339db484fa07ed446869f11e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:19:41 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-5329d780-bebf-4a9e-b859-b8307afe50d4 tempest-SnapshotDependencyTests-1520712453 None] Creating volume 2fbf03c9-bea8-4068-934d-85efd970301a {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:19:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5329d780-bebf-4a9e-b859-b8307afe50d4 tempest-SnapshotDependencyTests-1520712453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:19:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5329d780-bebf-4a9e-b859-b8307afe50d4 tempest-SnapshotDependencyTests-1520712453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:19:41 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5329d780-bebf-4a9e-b859-b8307afe50d4 tempest-SnapshotDependencyTests-1520712453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:19:41 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5329d780-bebf-4a9e-b859-b8307afe50d4 tempest-SnapshotDependencyTests-1520712453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:19:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5329d780-bebf-4a9e-b859-b8307afe50d4 tempest-SnapshotDependencyTests-1520712453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:19:41 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5329d780-bebf-4a9e-b859-b8307afe50d4 tempest-SnapshotDependencyTests-1520712453 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:19:41 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-5329d780-bebf-4a9e-b859-b8307afe50d4 tempest-SnapshotDependencyTests-1520712453 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:19:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5329d780-bebf-4a9e-b859-b8307afe50d4 tempest-SnapshotDependencyTests-1520712453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:41 devstack sudo[102767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a 1073741824
Nov 06 17:19:41 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:41 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5329d780-bebf-4a9e-b859-b8307afe50d4 tempest-SnapshotDependencyTests-1520712453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a 1073741824" returned: 0 in 0.430s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5329d780-bebf-4a9e-b859-b8307afe50d4 tempest-SnapshotDependencyTests-1520712453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:41 devstack sudo[102773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a
Nov 06 17:19:41 devstack sudo[102773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:42 devstack sudo[102773]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5329d780-bebf-4a9e-b859-b8307afe50d4 tempest-SnapshotDependencyTests-1520712453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a" returned: 0 in 0.248s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5329d780-bebf-4a9e-b859-b8307afe50d4 tempest-SnapshotDependencyTests-1520712453 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:19:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5329d780-bebf-4a9e-b859-b8307afe50d4 tempest-SnapshotDependencyTests-1520712453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:19:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5329d780-bebf-4a9e-b859-b8307afe50d4 tempest-SnapshotDependencyTests-1520712453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cba00db-6c00-45c8-bc10-9502fbe9d2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fbf03c9-bea8-4068-934d-85efd970301a', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:19:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5329d780-bebf-4a9e-b859-b8307afe50d4 tempest-SnapshotDependencyTests-1520712453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddb36f9b-2d1d-48dc-96fe-6620405ff8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:19:42 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-5329d780-bebf-4a9e-b859-b8307afe50d4 tempest-SnapshotDependencyTests-1520712453 None] Volume volume-2fbf03c9-bea8-4068-934d-85efd970301a (2fbf03c9-bea8-4068-934d-85efd970301a): created successfully
Nov 06 17:19:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5329d780-bebf-4a9e-b859-b8307afe50d4 tempest-SnapshotDependencyTests-1520712453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddb36f9b-2d1d-48dc-96fe-6620405ff8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:19:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5329d780-bebf-4a9e-b859-b8307afe50d4 tempest-SnapshotDependencyTests-1520712453 None] Flow 'volume_create_manager' (898a82fa-d19a-486c-a16c-03510fbb3511) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:19:42 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-5329d780-bebf-4a9e-b859-b8307afe50d4 tempest-SnapshotDependencyTests-1520712453 None] Created volume successfully.
Nov 06 17:19:42 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:19:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:19:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:19:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:19:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:19:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:19:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:42 devstack sudo[102776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:19:42 devstack sudo[102776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-28372983-45af-4578-a9f4-8671c91cfb20 tempest-SnapshotDependencyTests-1520712453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:19:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-28372983-45af-4578-a9f4-8671c91cfb20 tempest-SnapshotDependencyTests-1520712453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:19:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-28372983-45af-4578-a9f4-8671c91cfb20 tempest-SnapshotDependencyTests-1520712453 None] Creating offline snapshot bbd3a507-7fd6-4434-b114-35d4a9835cd1 of volume 2fbf03c9-bea8-4068-934d-85efd970301a {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:19:42 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddad315-c761-4b8b-87cd-77123898052b]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:19:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-28372983-45af-4578-a9f4-8671c91cfb20 tempest-SnapshotDependencyTests-1520712453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:42 devstack sudo[102778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a
Nov 06 17:19:42 devstack sudo[102778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:42 devstack sudo[102776]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.268s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:42 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:19:42 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager._thread_info {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:19:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread count: 28 {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 17:19:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread info: [<_MainThread(MainThread, started 125183137599616)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125183027608256)>, <Thread(Thread-3 (stat_writer), started daemon 125183025243776)>, <Thread(Rabbit-heartbeat, started daemon 125183023512896)>, <Thread(Thread-5 (_runner), started daemon 125183023357120)>, <Thread(Thread-7 (_runner), started daemon 125183021306496)>, <Thread(fd_logger, started daemon 125183018711616)>, <Thread(privsep_reader, started daemon 125183017484224)>, <Thread(tpool_thread_0, started daemon 125183013742272)>, <Thread(tpool_thread_1, started daemon 125183005349568)>, <Thread(tpool_thread_2, started daemon 125182996956864)>, <Thread(tpool_thread_3, started daemon 125182988564160)>, <Thread(tpool_thread_4, started daemon 125182980171456)>, <Thread(tpool_thread_5, started daemon 125182971778752)>, <Thread(tpool_thread_6, started daemon 125182963386048)>, <Thread(tpool_thread_7, started daemon 125182954993344)>, <Thread(tpool_thread_8, started daemon 125182946600640)>, <Thread(tpool_thread_9, started daemon 125182938207936)>, <Thread(tpool_thread_10, started daemon 125182929815232)>, <Thread(tpool_thread_11, started daemon 125182921422528)>, <Thread(tpool_thread_12, started daemon 125182913013440)>, <Thread(tpool_thread_13, started daemon 125182904604352)>, <Thread(tpool_thread_14, started daemon 125182896195264)>, <Thread(tpool_thread_15, started daemon 125182887786176)>, <Thread(tpool_thread_16, started daemon 125182879377088)>, <Thread(tpool_thread_17, started daemon 125182870968000)>, <Thread(tpool_thread_18, started daemon 125182862558912)>, <Thread(tpool_thread_19, started daemon 125182854149824)>] {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 17:19:43 devstack sudo[102778]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-28372983-45af-4578-a9f4-8671c91cfb20 tempest-SnapshotDependencyTests-1520712453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a" returned: 0 in 0.396s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-28372983-45af-4578-a9f4-8671c91cfb20 tempest-SnapshotDependencyTests-1520712453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a.bbd3a507-7fd6-4434-b114-35d4a9835cd1 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:43 devstack sudo[102784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a.bbd3a507-7fd6-4434-b114-35d4a9835cd1 1G
Nov 06 17:19:43 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:43 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-28372983-45af-4578-a9f4-8671c91cfb20 tempest-SnapshotDependencyTests-1520712453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a.bbd3a507-7fd6-4434-b114-35d4a9835cd1 1G" returned: 0 in 0.410s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-28372983-45af-4578-a9f4-8671c91cfb20 tempest-SnapshotDependencyTests-1520712453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fbf03c9-bea8-4068-934d-85efd970301a -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a.bbd3a507-7fd6-4434-b114-35d4a9835cd1 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:43 devstack sudo[102789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fbf03c9-bea8-4068-934d-85efd970301a -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a.bbd3a507-7fd6-4434-b114-35d4a9835cd1
Nov 06 17:19:43 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:43 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-28372983-45af-4578-a9f4-8671c91cfb20 tempest-SnapshotDependencyTests-1520712453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fbf03c9-bea8-4068-934d-85efd970301a -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a.bbd3a507-7fd6-4434-b114-35d4a9835cd1" returned: 0 in 0.284s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:43 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-28372983-45af-4578-a9f4-8671c91cfb20 tempest-SnapshotDependencyTests-1520712453 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a.bbd3a507-7fd6-4434-b114-35d4a9835cd1 is being set with open permissions: ugo+rw
Nov 06 17:19:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-28372983-45af-4578-a9f4-8671c91cfb20 tempest-SnapshotDependencyTests-1520712453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a.bbd3a507-7fd6-4434-b114-35d4a9835cd1 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:43 devstack sudo[102794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a.bbd3a507-7fd6-4434-b114-35d4a9835cd1
Nov 06 17:19:43 devstack sudo[102794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:43 devstack sudo[102794]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-28372983-45af-4578-a9f4-8671c91cfb20 tempest-SnapshotDependencyTests-1520712453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a.bbd3a507-7fd6-4434-b114-35d4a9835cd1" returned: 0 in 0.254s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-28372983-45af-4578-a9f4-8671c91cfb20 tempest-SnapshotDependencyTests-1520712453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:44 devstack sudo[102797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a.info
Nov 06 17:19:44 devstack sudo[102797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:44 devstack sudo[102797]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-28372983-45af-4578-a9f4-8671c91cfb20 tempest-SnapshotDependencyTests-1520712453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a.info" returned: 0 in 0.260s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:44 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-28372983-45af-4578-a9f4-8671c91cfb20 tempest-SnapshotDependencyTests-1520712453 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a.info is being set with open permissions: ugo+rw
Nov 06 17:19:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-28372983-45af-4578-a9f4-8671c91cfb20 tempest-SnapshotDependencyTests-1520712453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:44 devstack sudo[102816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a.info
Nov 06 17:19:44 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:44 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-28372983-45af-4578-a9f4-8671c91cfb20 tempest-SnapshotDependencyTests-1520712453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a.info" returned: 0 in 0.253s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-28372983-45af-4578-a9f4-8671c91cfb20 tempest-SnapshotDependencyTests-1520712453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.969s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:19:44 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-28372983-45af-4578-a9f4-8671c91cfb20 tempest-SnapshotDependencyTests-1520712453 None] Create snapshot completed successfully
Nov 06 17:19:46 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:19:46 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Flow 'volume_create_manager' (ebfad4d4-17c6-4246-8d32-0c9f966eb57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:19:46 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (195a6643-fb53-4b1d-8e81-cdb49482d519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:19:46 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (195a6643-fb53-4b1d-8e81-cdb49482d519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83fb0708-8301-4ac9-ba8b-6e0808d82a53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd58045364d5466ab3fa855ddda83559',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bbd3a507-7fd6-4434-b114-35d4a9835cd1,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:19:46Z,use_quota=True,user_id='b3a12c4339db484fa07ed446869f11e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:19:46 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38b63e58-763e-4b8a-96f0-f90243364001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:19:46 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38b63e58-763e-4b8a-96f0-f90243364001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:19:46 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f377a0cd-c3ed-4d2d-a568-abd7a1c5ae6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:19:46 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f377a0cd-c3ed-4d2d-a568-abd7a1c5ae6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '83fb0708-8301-4ac9-ba8b-6e0808d82a53', 'volume_name': 'volume-83fb0708-8301-4ac9-ba8b-6e0808d82a53', 'volume_size': 1, 'snapshot_id': 'bbd3a507-7fd6-4434-b114-35d4a9835cd1'}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:19:46 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcb0b4d8-6c04-4f86-b444-209ed3023ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:19:46 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcb0b4d8-6c04-4f86-b444-209ed3023ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:19:46 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8def90e-b528-413c-b43d-f6255426c2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:19:46 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Volume 83fb0708-8301-4ac9-ba8b-6e0808d82a53: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-83fb0708-8301-4ac9-ba8b-6e0808d82a53', 'volume_size': 1, 'snapshot_id': 'bbd3a507-7fd6-4434-b114-35d4a9835cd1'}
Nov 06 17:19:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:19:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:19:46 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Acquiring lock "cinder-quobyte-bbd3a507-7fd6-4434-b114-35d4a9835cd1-83fb0708-8301-4ac9-ba8b-6e0808d82a53" by "_create_volume_from_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:19:46 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Lock "cinder-quobyte-bbd3a507-7fd6-4434-b114-35d4a9835cd1-83fb0708-8301-4ac9-ba8b-6e0808d82a53" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:19:46 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Creating volume 83fb0708-8301-4ac9-ba8b-6e0808d82a53 from snapshot bbd3a507-7fd6-4434-b114-35d4a9835cd1 {{(pid=86856) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 06 17:19:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:19:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:19:46 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:19:46 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:19:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:19:46 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:19:46 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Acquiring lock "cinder-quobyte-83fb0708-8301-4ac9-ba8b-6e0808d82a53" by "_copy_volume_from_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:19:46 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Lock "cinder-quobyte-83fb0708-8301-4ac9-ba8b-6e0808d82a53" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:19:46 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] snapshot: bbd3a507-7fd6-4434-b114-35d4a9835cd1, volume: 83fb0708-8301-4ac9-ba8b-6e0808d82a53,  {{(pid=86856) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 06 17:19:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:19:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:19:46 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:19:46 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:19:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:19:46 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d458ecc-5ed9-40ef-93ea-9a10d0f409fb]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:19:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a.bbd3a507-7fd6-4434-b114-35d4a9835cd1 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:46 devstack sudo[102825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a.bbd3a507-7fd6-4434-b114-35d4a9835cd1
Nov 06 17:19:46 devstack sudo[102825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:46 devstack sudo[102825]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a.bbd3a507-7fd6-4434-b114-35d4a9835cd1" returned: 0 in 0.371s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:46 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fbf03c9-bea8-4068-934d-85efd970301a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:19:46 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[abef82b1-4f92-4675-a148-3475c6c35690]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:19:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:46 devstack sudo[102830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a
Nov 06 17:19:46 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:47 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a" returned: 0 in 0.374s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a {{(pid=86856) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 06 17:19:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Creating direct copy from snapshot {{(pid=86856) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 06 17:19:47 devstack cinder-volume[86856]: DEBUG cinder.utils [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Path /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-83fb0708-8301-4ac9-ba8b-6e0808d82a53 not found in is_blk_device check {{(pid=86856) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 06 17:19:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-83fb0708-8301-4ac9-ba8b-6e0808d82a53 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:47 devstack sudo[102836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-83fb0708-8301-4ac9-ba8b-6e0808d82a53
Nov 06 17:19:47 devstack sudo[102836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:53 devstack sudo[102836]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-83fb0708-8301-4ac9-ba8b-6e0808d82a53" returned: 0 in 6.565s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:53 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Image conversion details: src /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a, size 1024.00 MB, duration 6.57 sec, destination /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-83fb0708-8301-4ac9-ba8b-6e0808d82a53 {{(pid=86856) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 17:19:53 devstack cinder-volume[86856]: INFO cinder.image.image_utils [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Converted 1024.00 MB image at 155.94 MB/s
Nov 06 17:19:53 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-83fb0708-8301-4ac9-ba8b-6e0808d82a53 is being set with open permissions: ugo+rw
Nov 06 17:19:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-83fb0708-8301-4ac9-ba8b-6e0808d82a53 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:53 devstack sudo[102894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-83fb0708-8301-4ac9-ba8b-6e0808d82a53
Nov 06 17:19:53 devstack sudo[102894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:53 devstack sudo[102894]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-83fb0708-8301-4ac9-ba8b-6e0808d82a53" returned: 0 in 0.237s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:54 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Lock "cinder-quobyte-83fb0708-8301-4ac9-ba8b-6e0808d82a53" released by "_copy_volume_from_snapshot" :: held 7.646s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:19:54 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Lock "cinder-quobyte-bbd3a507-7fd6-4434-b114-35d4a9835cd1-83fb0708-8301-4ac9-ba8b-6e0808d82a53" released by "_create_volume_from_snapshot" :: held 7.707s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:19:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.722s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:19:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8def90e-b528-413c-b43d-f6255426c2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83fb0708-8301-4ac9-ba8b-6e0808d82a53', 'volume_size': 1, 'snapshot_id': 'bbd3a507-7fd6-4434-b114-35d4a9835cd1'}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:19:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c42e519-512f-42c4-a50c-f75e6c8f33cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:19:54 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Volume volume-83fb0708-8301-4ac9-ba8b-6e0808d82a53 (83fb0708-8301-4ac9-ba8b-6e0808d82a53): created successfully
Nov 06 17:19:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c42e519-512f-42c4-a50c-f75e6c8f33cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:19:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Flow 'volume_create_manager' (ebfad4d4-17c6-4246-8d32-0c9f966eb57e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:19:54 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-d7fb6c79-830f-4798-b9df-6ac0735ec6bc tempest-SnapshotDependencyTests-1520712453 None] Created volume successfully.
Nov 06 17:19:54 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-62800781-d618-4b67-8ebc-1ca01d079678 tempest-SnapshotDependencyTests-1520712453 None] Acquiring lock "cinder-bbd3a507-7fd6-4434-b114-35d4a9835cd1-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:19:54 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-62800781-d618-4b67-8ebc-1ca01d079678 tempest-SnapshotDependencyTests-1520712453 None] Lock "cinder-bbd3a507-7fd6-4434-b114-35d4a9835cd1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:19:54 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-62800781-d618-4b67-8ebc-1ca01d079678 tempest-SnapshotDependencyTests-1520712453 None] Acquiring lock "cinder-quobyte-2fbf03c9-bea8-4068-934d-85efd970301a" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:19:54 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-62800781-d618-4b67-8ebc-1ca01d079678 tempest-SnapshotDependencyTests-1520712453 None] Lock "cinder-quobyte-2fbf03c9-bea8-4068-934d-85efd970301a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:19:54 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-62800781-d618-4b67-8ebc-1ca01d079678 tempest-SnapshotDependencyTests-1520712453 None] Acquiring lock "cinder-quobyte-bbd3a507-7fd6-4434-b114-35d4a9835cd1" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:19:54 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-62800781-d618-4b67-8ebc-1ca01d079678 tempest-SnapshotDependencyTests-1520712453 None] Lock "cinder-quobyte-bbd3a507-7fd6-4434-b114-35d4a9835cd1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:19:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-62800781-d618-4b67-8ebc-1ca01d079678 tempest-SnapshotDependencyTests-1520712453 None] Deleting offline snapshot bbd3a507-7fd6-4434-b114-35d4a9835cd1 of volume 2fbf03c9-bea8-4068-934d-85efd970301a {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:19:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-62800781-d618-4b67-8ebc-1ca01d079678 tempest-SnapshotDependencyTests-1520712453 None] snapshot_file for this snap is: volume-2fbf03c9-bea8-4068-934d-85efd970301a.bbd3a507-7fd6-4434-b114-35d4a9835cd1 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:19:54 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[c178e26b-1c50-4dfc-9f59-a8beb7c636df]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:19:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-62800781-d618-4b67-8ebc-1ca01d079678 tempest-SnapshotDependencyTests-1520712453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a.bbd3a507-7fd6-4434-b114-35d4a9835cd1 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:55 devstack sudo[102897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a.bbd3a507-7fd6-4434-b114-35d4a9835cd1
Nov 06 17:19:55 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:55 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-62800781-d618-4b67-8ebc-1ca01d079678 tempest-SnapshotDependencyTests-1520712453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a.bbd3a507-7fd6-4434-b114-35d4a9835cd1" returned: 0 in 0.347s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:55 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-62800781-d618-4b67-8ebc-1ca01d079678 tempest-SnapshotDependencyTests-1520712453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fbf03c9-bea8-4068-934d-85efd970301a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:19:55 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[72520a66-7993-4068-8835-9a9a438a3084]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:19:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-62800781-d618-4b67-8ebc-1ca01d079678 tempest-SnapshotDependencyTests-1520712453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:55 devstack sudo[102902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a
Nov 06 17:19:55 devstack sudo[102902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:55 devstack sudo[102902]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-62800781-d618-4b67-8ebc-1ca01d079678 tempest-SnapshotDependencyTests-1520712453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a" returned: 0 in 0.510s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-62800781-d618-4b67-8ebc-1ca01d079678 tempest-SnapshotDependencyTests-1520712453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a.bbd3a507-7fd6-4434-b114-35d4a9835cd1 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:55 devstack sudo[102908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a.bbd3a507-7fd6-4434-b114-35d4a9835cd1
Nov 06 17:19:55 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:56 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-62800781-d618-4b67-8ebc-1ca01d079678 tempest-SnapshotDependencyTests-1520712453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a.bbd3a507-7fd6-4434-b114-35d4a9835cd1" returned: 0 in 0.321s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-62800781-d618-4b67-8ebc-1ca01d079678 tempest-SnapshotDependencyTests-1520712453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a.bbd3a507-7fd6-4434-b114-35d4a9835cd1 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:56 devstack sudo[102914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a.bbd3a507-7fd6-4434-b114-35d4a9835cd1
Nov 06 17:19:56 devstack sudo[102914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:56 devstack sudo[102914]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-62800781-d618-4b67-8ebc-1ca01d079678 tempest-SnapshotDependencyTests-1520712453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a.bbd3a507-7fd6-4434-b114-35d4a9835cd1" returned: 0 in 0.240s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:56 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-62800781-d618-4b67-8ebc-1ca01d079678 tempest-SnapshotDependencyTests-1520712453 None] Lock "cinder-quobyte-bbd3a507-7fd6-4434-b114-35d4a9835cd1" released by "_delete_snapshot" :: held 1.518s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:19:56 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-62800781-d618-4b67-8ebc-1ca01d079678 tempest-SnapshotDependencyTests-1520712453 None] Lock "cinder-quobyte-2fbf03c9-bea8-4068-934d-85efd970301a" released by "delete_snapshot" :: held 1.540s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:19:56 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-62800781-d618-4b67-8ebc-1ca01d079678 tempest-SnapshotDependencyTests-1520712453 None] Created reservations ['f2943acc-0372-4703-a90f-c994706ec2bf', 'fe40e5d6-3808-472b-96e7-654f7d3f7188', 'b16f3c5c-b6d7-4a16-a0a5-4af90ebc7ea3', '22734cce-5a5c-4bda-9a58-1f0bc98bae4b'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:19:56 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-62800781-d618-4b67-8ebc-1ca01d079678 tempest-SnapshotDependencyTests-1520712453 None] Delete snapshot completed successfully.
Nov 06 17:19:56 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-62800781-d618-4b67-8ebc-1ca01d079678 tempest-SnapshotDependencyTests-1520712453 None] Lock "cinder-bbd3a507-7fd6-4434-b114-35d4a9835cd1-delete_snapshot" released by "delete_snapshot" :: held 1.668s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:19:57 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-571dd1e3-34ec-4cbd-a1c4-77bd7f763d21 tempest-SnapshotDependencyTests-1520712453 None] Acquiring lock "cinder-2fbf03c9-bea8-4068-934d-85efd970301a-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:19:57 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-571dd1e3-34ec-4cbd-a1c4-77bd7f763d21 tempest-SnapshotDependencyTests-1520712453 None] Lock "cinder-2fbf03c9-bea8-4068-934d-85efd970301a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:19:57 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-571dd1e3-34ec-4cbd-a1c4-77bd7f763d21 tempest-SnapshotDependencyTests-1520712453 None] Acquiring lock "cinder-quobyte-2fbf03c9-bea8-4068-934d-85efd970301a" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:19:57 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-571dd1e3-34ec-4cbd-a1c4-77bd7f763d21 tempest-SnapshotDependencyTests-1520712453 None] Lock "cinder-quobyte-2fbf03c9-bea8-4068-934d-85efd970301a" acquired by "delete_volume" :: waited 0.016s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:19:57 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48d071f-4873-43d6-b8f3-8385ee4be818]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:19:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-571dd1e3-34ec-4cbd-a1c4-77bd7f763d21 tempest-SnapshotDependencyTests-1520712453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:57 devstack sudo[102921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a
Nov 06 17:19:57 devstack sudo[102921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:57 devstack sudo[102921]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-571dd1e3-34ec-4cbd-a1c4-77bd7f763d21 tempest-SnapshotDependencyTests-1520712453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a" returned: 0 in 0.382s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-571dd1e3-34ec-4cbd-a1c4-77bd7f763d21 tempest-SnapshotDependencyTests-1520712453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:57 devstack sudo[102929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a
Nov 06 17:19:57 devstack sudo[102929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:57 devstack sudo[102929]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-571dd1e3-34ec-4cbd-a1c4-77bd7f763d21 tempest-SnapshotDependencyTests-1520712453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2fbf03c9-bea8-4068-934d-85efd970301a" returned: 0 in 0.273s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:57 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-571dd1e3-34ec-4cbd-a1c4-77bd7f763d21 tempest-SnapshotDependencyTests-1520712453 None] Lock "cinder-quobyte-2fbf03c9-bea8-4068-934d-85efd970301a" released by "delete_volume" :: held 0.723s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:19:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-9f8b125f-f507-44bc-aaf1-8a049f7a0ebe req-ad39c424-7840-4d28-b9ca-621378198fee tempest-TestStampPattern-1009918079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:19:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-9f8b125f-f507-44bc-aaf1-8a049f7a0ebe req-ad39c424-7840-4d28-b9ca-621378198fee tempest-TestStampPattern-1009918079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:19:57 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-571dd1e3-34ec-4cbd-a1c4-77bd7f763d21 tempest-SnapshotDependencyTests-1520712453 None] Created reservations ['b1e5c3e6-3b49-4a9e-99ba-ef5ceb199456', '3398570d-9198-4255-9a3d-477db170ea07', 'd6a9d6fa-b55f-4bd0-8933-0235769f7dc7', 'cfcc936b-9a96-484e-b67c-fc4711bdc1e7'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:19:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-9f8b125f-f507-44bc-aaf1-8a049f7a0ebe req-ad39c424-7840-4d28-b9ca-621378198fee tempest-TestStampPattern-1009918079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:19:57 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-9f8b125f-f507-44bc-aaf1-8a049f7a0ebe req-ad39c424-7840-4d28-b9ca-621378198fee tempest-TestStampPattern-1009918079 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316', 'name': 'volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '77fb651a-b9eb-4205-bb87-e2a1e11da98a', 'enforce_multipath': True} {{(pid=86856) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 17:19:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-571dd1e3-34ec-4cbd-a1c4-77bd7f763d21 tempest-SnapshotDependencyTests-1520712453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:19:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-571dd1e3-34ec-4cbd-a1c4-77bd7f763d21 tempest-SnapshotDependencyTests-1520712453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:19:57 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-571dd1e3-34ec-4cbd-a1c4-77bd7f763d21 tempest-SnapshotDependencyTests-1520712453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:19:57 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-571dd1e3-34ec-4cbd-a1c4-77bd7f763d21 tempest-SnapshotDependencyTests-1520712453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:19:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-571dd1e3-34ec-4cbd-a1c4-77bd7f763d21 tempest-SnapshotDependencyTests-1520712453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:19:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-571dd1e3-34ec-4cbd-a1c4-77bd7f763d21 tempest-SnapshotDependencyTests-1520712453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:57 devstack sudo[102940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:19:57 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:58 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-9f8b125f-f507-44bc-aaf1-8a049f7a0ebe req-ad39c424-7840-4d28-b9ca-621378198fee tempest-TestStampPattern-1009918079 None] attachment_update completed successfully.
Nov 06 17:19:58 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1798bf12-e57c-453b-bf37-2e8b74e2279a tempest-SnapshotDependencyTests-1520712453 None] Acquiring lock "cinder-83fb0708-8301-4ac9-ba8b-6e0808d82a53-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:19:58 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1798bf12-e57c-453b-bf37-2e8b74e2279a tempest-SnapshotDependencyTests-1520712453 None] Lock "cinder-83fb0708-8301-4ac9-ba8b-6e0808d82a53-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:19:58 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-571dd1e3-34ec-4cbd-a1c4-77bd7f763d21 tempest-SnapshotDependencyTests-1520712453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.288s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:58 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-571dd1e3-34ec-4cbd-a1c4-77bd7f763d21 tempest-SnapshotDependencyTests-1520712453 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:19:58 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-571dd1e3-34ec-4cbd-a1c4-77bd7f763d21 tempest-SnapshotDependencyTests-1520712453 None] Deleted volume successfully.
Nov 06 17:19:58 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1798bf12-e57c-453b-bf37-2e8b74e2279a tempest-SnapshotDependencyTests-1520712453 None] Acquiring lock "cinder-quobyte-83fb0708-8301-4ac9-ba8b-6e0808d82a53" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:19:58 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1798bf12-e57c-453b-bf37-2e8b74e2279a tempest-SnapshotDependencyTests-1520712453 None] Lock "cinder-quobyte-83fb0708-8301-4ac9-ba8b-6e0808d82a53" acquired by "delete_volume" :: waited 0.023s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:19:58 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-571dd1e3-34ec-4cbd-a1c4-77bd7f763d21 tempest-SnapshotDependencyTests-1520712453 None] Lock "cinder-2fbf03c9-bea8-4068-934d-85efd970301a-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:19:58 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e8188f-319e-456b-abd7-8737c2ff561a]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:19:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1798bf12-e57c-453b-bf37-2e8b74e2279a tempest-SnapshotDependencyTests-1520712453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-83fb0708-8301-4ac9-ba8b-6e0808d82a53 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:58 devstack sudo[103068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-83fb0708-8301-4ac9-ba8b-6e0808d82a53
Nov 06 17:19:58 devstack sudo[103068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:58 devstack sudo[103068]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1798bf12-e57c-453b-bf37-2e8b74e2279a tempest-SnapshotDependencyTests-1520712453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-83fb0708-8301-4ac9-ba8b-6e0808d82a53" returned: 0 in 0.413s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1798bf12-e57c-453b-bf37-2e8b74e2279a tempest-SnapshotDependencyTests-1520712453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-83fb0708-8301-4ac9-ba8b-6e0808d82a53 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:58 devstack sudo[103364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-83fb0708-8301-4ac9-ba8b-6e0808d82a53
Nov 06 17:19:58 devstack sudo[103364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:59 devstack sudo[103364]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1798bf12-e57c-453b-bf37-2e8b74e2279a tempest-SnapshotDependencyTests-1520712453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-83fb0708-8301-4ac9-ba8b-6e0808d82a53" returned: 0 in 0.254s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:59 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1798bf12-e57c-453b-bf37-2e8b74e2279a tempest-SnapshotDependencyTests-1520712453 None] Lock "cinder-quobyte-83fb0708-8301-4ac9-ba8b-6e0808d82a53" released by "delete_volume" :: held 0.708s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:19:59 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-1798bf12-e57c-453b-bf37-2e8b74e2279a tempest-SnapshotDependencyTests-1520712453 None] Created reservations ['7bc5af58-1887-40c4-8c3a-dd2173577d41', 'c37fb3f7-5d07-47dc-9f8b-4935ffb57c7f', '63e9e26b-8365-47fe-85e7-74f2bc960a88', '64e3a9e4-7858-4616-ab76-a1615c2938ce'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:19:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1798bf12-e57c-453b-bf37-2e8b74e2279a tempest-SnapshotDependencyTests-1520712453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:19:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1798bf12-e57c-453b-bf37-2e8b74e2279a tempest-SnapshotDependencyTests-1520712453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:19:59 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1798bf12-e57c-453b-bf37-2e8b74e2279a tempest-SnapshotDependencyTests-1520712453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:19:59 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1798bf12-e57c-453b-bf37-2e8b74e2279a tempest-SnapshotDependencyTests-1520712453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:19:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1798bf12-e57c-453b-bf37-2e8b74e2279a tempest-SnapshotDependencyTests-1520712453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:19:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1798bf12-e57c-453b-bf37-2e8b74e2279a tempest-SnapshotDependencyTests-1520712453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:19:59 devstack sudo[103367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:19:59 devstack sudo[103367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:19:59 devstack sudo[103367]: pam_unix(sudo:session): session closed for user root
Nov 06 17:19:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1798bf12-e57c-453b-bf37-2e8b74e2279a tempest-SnapshotDependencyTests-1520712453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.257s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:19:59 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-1798bf12-e57c-453b-bf37-2e8b74e2279a tempest-SnapshotDependencyTests-1520712453 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:19:59 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-1798bf12-e57c-453b-bf37-2e8b74e2279a tempest-SnapshotDependencyTests-1520712453 None] Deleted volume successfully.
Nov 06 17:19:59 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1798bf12-e57c-453b-bf37-2e8b74e2279a tempest-SnapshotDependencyTests-1520712453 None] Lock "cinder-83fb0708-8301-4ac9-ba8b-6e0808d82a53-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:20:03 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-31c51111-b5bc-4910-975a-56c58c666742 req-30242f38-fb20-4c1b-9958-80e667fa3aed tempest-TestStampPattern-1009918079 None] Terminate volume connection completed successfully.
Nov 06 17:20:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-31c51111-b5bc-4910-975a-56c58c666742 req-30242f38-fb20-4c1b-9958-80e667fa3aed tempest-TestStampPattern-1009918079 None] Deleting attachment 77fb651a-b9eb-4205-bb87-e2a1e11da98a. {{(pid=86856) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 17:20:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-38b84c3c-e748-44ec-9fdb-3cea86abf801 tempest-TestStampPattern-1009918079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:20:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-38b84c3c-e748-44ec-9fdb-3cea86abf801 tempest-TestStampPattern-1009918079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:20:04 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-38b84c3c-e748-44ec-9fdb-3cea86abf801 tempest-TestStampPattern-1009918079 None] Creating offline snapshot 21581e58-50eb-441f-8d83-3c6d5527c955 of volume 59dcfba4-41a4-46f5-a86a-7b2bc2a58862 {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:20:04 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[967e3054-9507-4529-866a-6c5234e7e848]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:20:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-38b84c3c-e748-44ec-9fdb-3cea86abf801 tempest-TestStampPattern-1009918079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:20:04 devstack sudo[103424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862
Nov 06 17:20:04 devstack sudo[103424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:20:04 devstack sudo[103424]: pam_unix(sudo:session): session closed for user root
Nov 06 17:20:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-38b84c3c-e748-44ec-9fdb-3cea86abf801 tempest-TestStampPattern-1009918079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862" returned: 0 in 0.402s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:20:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-38b84c3c-e748-44ec-9fdb-3cea86abf801 tempest-TestStampPattern-1009918079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862.21581e58-50eb-441f-8d83-3c6d5527c955 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:20:04 devstack sudo[103429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862.21581e58-50eb-441f-8d83-3c6d5527c955 1G
Nov 06 17:20:04 devstack sudo[103429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:20:05 devstack sudo[103429]: pam_unix(sudo:session): session closed for user root
Nov 06 17:20:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-38b84c3c-e748-44ec-9fdb-3cea86abf801 tempest-TestStampPattern-1009918079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862.21581e58-50eb-441f-8d83-3c6d5527c955 1G" returned: 0 in 0.479s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:20:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-38b84c3c-e748-44ec-9fdb-3cea86abf801 tempest-TestStampPattern-1009918079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862.21581e58-50eb-441f-8d83-3c6d5527c955 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:20:05 devstack sudo[103435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862.21581e58-50eb-441f-8d83-3c6d5527c955
Nov 06 17:20:05 devstack sudo[103435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:20:05 devstack sudo[103435]: pam_unix(sudo:session): session closed for user root
Nov 06 17:20:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-38b84c3c-e748-44ec-9fdb-3cea86abf801 tempest-TestStampPattern-1009918079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862.21581e58-50eb-441f-8d83-3c6d5527c955" returned: 0 in 0.418s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:20:05 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-38b84c3c-e748-44ec-9fdb-3cea86abf801 tempest-TestStampPattern-1009918079 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862.21581e58-50eb-441f-8d83-3c6d5527c955 is being set with open permissions: ugo+rw
Nov 06 17:20:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-38b84c3c-e748-44ec-9fdb-3cea86abf801 tempest-TestStampPattern-1009918079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862.21581e58-50eb-441f-8d83-3c6d5527c955 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:20:05 devstack sudo[103441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862.21581e58-50eb-441f-8d83-3c6d5527c955
Nov 06 17:20:05 devstack sudo[103441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:20:05 devstack sudo[103441]: pam_unix(sudo:session): session closed for user root
Nov 06 17:20:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-38b84c3c-e748-44ec-9fdb-3cea86abf801 tempest-TestStampPattern-1009918079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862.21581e58-50eb-441f-8d83-3c6d5527c955" returned: 0 in 0.252s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:20:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-38b84c3c-e748-44ec-9fdb-3cea86abf801 tempest-TestStampPattern-1009918079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:20:05 devstack sudo[103444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862.info
Nov 06 17:20:05 devstack sudo[103444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:20:05 devstack sudo[103444]: pam_unix(sudo:session): session closed for user root
Nov 06 17:20:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-38b84c3c-e748-44ec-9fdb-3cea86abf801 tempest-TestStampPattern-1009918079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862.info" returned: 0 in 0.272s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:20:05 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-38b84c3c-e748-44ec-9fdb-3cea86abf801 tempest-TestStampPattern-1009918079 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862.info is being set with open permissions: ugo+rw
Nov 06 17:20:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-38b84c3c-e748-44ec-9fdb-3cea86abf801 tempest-TestStampPattern-1009918079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:20:06 devstack sudo[103447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862.info
Nov 06 17:20:06 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:20:06 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root
Nov 06 17:20:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-38b84c3c-e748-44ec-9fdb-3cea86abf801 tempest-TestStampPattern-1009918079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862.info" returned: 0 in 0.254s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:20:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-38b84c3c-e748-44ec-9fdb-3cea86abf801 tempest-TestStampPattern-1009918079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.178s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:20:06 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-38b84c3c-e748-44ec-9fdb-3cea86abf801 tempest-TestStampPattern-1009918079 None] Create snapshot completed successfully
Nov 06 17:20:14 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:20:14 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Flow 'volume_create_manager' (8132fc4c-e2d5-4d4f-87cb-21533575bcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:20:14 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0ca5f2a-2b30-453c-8041-a8884e243622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:20:14 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0ca5f2a-2b30-453c-8041-a8884e243622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-427102332',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf4bd327-5e37-45a7-b00f-a7e8ee8cf55b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8ec80594d394c1eb22f575d0c697d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=21581e58-50eb-441f-8d83-3c6d5527c955,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:20:14Z,use_quota=True,user_id='0445cdff95734588a3ba94031f83d217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:20:14 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fffbd36-c496-420c-9e44-98203ea779d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:20:14 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fffbd36-c496-420c-9e44-98203ea779d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:20:14 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8583a1f4-4e94-41c1-a683-1f67a824b06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:20:14 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8583a1f4-4e94-41c1-a683-1f67a824b06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cf4bd327-5e37-45a7-b00f-a7e8ee8cf55b', 'volume_name': 'volume-cf4bd327-5e37-45a7-b00f-a7e8ee8cf55b', 'volume_size': 1, 'snapshot_id': '21581e58-50eb-441f-8d83-3c6d5527c955'}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:20:14 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f998b9c3-72c4-418e-bcfe-74091096b474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:20:14 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f998b9c3-72c4-418e-bcfe-74091096b474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:20:14 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a1d9ac4-f1bd-4f97-994d-6843721ecdde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:20:14 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Volume cf4bd327-5e37-45a7-b00f-a7e8ee8cf55b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cf4bd327-5e37-45a7-b00f-a7e8ee8cf55b', 'volume_size': 1, 'snapshot_id': '21581e58-50eb-441f-8d83-3c6d5527c955'}
Nov 06 17:20:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:20:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:20:14 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Acquiring lock "cinder-quobyte-21581e58-50eb-441f-8d83-3c6d5527c955-cf4bd327-5e37-45a7-b00f-a7e8ee8cf55b" by "_create_volume_from_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:20:14 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Lock "cinder-quobyte-21581e58-50eb-441f-8d83-3c6d5527c955-cf4bd327-5e37-45a7-b00f-a7e8ee8cf55b" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:20:14 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Creating volume cf4bd327-5e37-45a7-b00f-a7e8ee8cf55b from snapshot 21581e58-50eb-441f-8d83-3c6d5527c955 {{(pid=86856) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 06 17:20:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:20:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:20:14 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:20:14 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:20:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:20:14 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:20:14 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Acquiring lock "cinder-quobyte-cf4bd327-5e37-45a7-b00f-a7e8ee8cf55b" by "_copy_volume_from_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:20:14 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Lock "cinder-quobyte-cf4bd327-5e37-45a7-b00f-a7e8ee8cf55b" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:20:14 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] snapshot: 21581e58-50eb-441f-8d83-3c6d5527c955, volume: cf4bd327-5e37-45a7-b00f-a7e8ee8cf55b,  {{(pid=86856) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 06 17:20:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:20:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:20:14 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:20:14 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:20:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:20:14 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a77642-453c-45e0-a5ae-dc89584fcf75]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:20:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862.21581e58-50eb-441f-8d83-3c6d5527c955 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:20:14 devstack sudo[103475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862.21581e58-50eb-441f-8d83-3c6d5527c955
Nov 06 17:20:14 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:20:14 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root
Nov 06 17:20:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862.21581e58-50eb-441f-8d83-3c6d5527c955" returned: 0 in 0.377s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:20:14 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:20:14 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0c3df7-7ab8-4228-b37b-319fe90e793e]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:20:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:20:14 devstack sudo[103480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862
Nov 06 17:20:14 devstack sudo[103480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:20:15 devstack sudo[103480]: pam_unix(sudo:session): session closed for user root
Nov 06 17:20:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862" returned: 0 in 0.366s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:20:15 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862 {{(pid=86856) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 06 17:20:15 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Creating direct copy from snapshot {{(pid=86856) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 06 17:20:15 devstack cinder-volume[86856]: DEBUG cinder.utils [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Path /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cf4bd327-5e37-45a7-b00f-a7e8ee8cf55b not found in is_blk_device check {{(pid=86856) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 06 17:20:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cf4bd327-5e37-45a7-b00f-a7e8ee8cf55b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:20:15 devstack sudo[103488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cf4bd327-5e37-45a7-b00f-a7e8ee8cf55b
Nov 06 17:20:15 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:20:22 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root
Nov 06 17:20:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cf4bd327-5e37-45a7-b00f-a7e8ee8cf55b" returned: 0 in 7.787s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:20:22 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Image conversion details: src /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862, size 1024.00 MB, duration 7.79 sec, destination /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cf4bd327-5e37-45a7-b00f-a7e8ee8cf55b {{(pid=86856) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 17:20:22 devstack cinder-volume[86856]: INFO cinder.image.image_utils [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Converted 1024.00 MB image at 131.47 MB/s
Nov 06 17:20:22 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cf4bd327-5e37-45a7-b00f-a7e8ee8cf55b is being set with open permissions: ugo+rw
Nov 06 17:20:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cf4bd327-5e37-45a7-b00f-a7e8ee8cf55b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:20:22 devstack sudo[103522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cf4bd327-5e37-45a7-b00f-a7e8ee8cf55b
Nov 06 17:20:22 devstack sudo[103522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:20:23 devstack sudo[103522]: pam_unix(sudo:session): session closed for user root
Nov 06 17:20:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cf4bd327-5e37-45a7-b00f-a7e8ee8cf55b" returned: 0 in 0.261s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:20:23 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Lock "cinder-quobyte-cf4bd327-5e37-45a7-b00f-a7e8ee8cf55b" released by "_copy_volume_from_snapshot" :: held 8.872s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:20:23 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Lock "cinder-quobyte-21581e58-50eb-441f-8d83-3c6d5527c955-cf4bd327-5e37-45a7-b00f-a7e8ee8cf55b" released by "_create_volume_from_snapshot" :: held 8.935s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:20:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.948s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:20:23 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a1d9ac4-f1bd-4f97-994d-6843721ecdde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf4bd327-5e37-45a7-b00f-a7e8ee8cf55b', 'volume_size': 1, 'snapshot_id': '21581e58-50eb-441f-8d83-3c6d5527c955'}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:20:23 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec5342a-893c-41d2-81e8-b2e1468c5f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:20:23 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Volume volume-cf4bd327-5e37-45a7-b00f-a7e8ee8cf55b (cf4bd327-5e37-45a7-b00f-a7e8ee8cf55b): created successfully
Nov 06 17:20:23 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec5342a-893c-41d2-81e8-b2e1468c5f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:20:23 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Flow 'volume_create_manager' (8132fc4c-e2d5-4d4f-87cb-21533575bcd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:20:23 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-73117128-4c25-41a2-a7ca-9b6289ea1c48 tempest-TestStampPattern-1009918079 None] Created volume successfully.
Nov 06 17:20:33 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=41,cinder:UPDATE=38,cinder:INSERT=9,cinder:DELETE=1 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:20:33 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:UPDATE=33,cinder:SELECT=38,cinder:INSERT=8,cinder:DELETE=6 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:20:42 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:20:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:20:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:20:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:20:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:20:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:20:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:20:42 devstack sudo[103594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:20:42 devstack sudo[103594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:20:42 devstack sudo[103594]: pam_unix(sudo:session): session closed for user root
Nov 06 17:20:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.239s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:20:42 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:20:42 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager._thread_info {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:20:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread count: 28 {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 17:20:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread info: [<_MainThread(MainThread, started 125183137599616)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125183027608256)>, <Thread(Thread-3 (stat_writer), started daemon 125183025243776)>, <Thread(Rabbit-heartbeat, started daemon 125183023512896)>, <Thread(Thread-5 (_runner), started daemon 125183023357120)>, <Thread(Thread-7 (_runner), started daemon 125183021306496)>, <Thread(fd_logger, started daemon 125183018711616)>, <Thread(privsep_reader, started daemon 125183017484224)>, <Thread(tpool_thread_0, started daemon 125183013742272)>, <Thread(tpool_thread_1, started daemon 125183005349568)>, <Thread(tpool_thread_2, started daemon 125182996956864)>, <Thread(tpool_thread_3, started daemon 125182988564160)>, <Thread(tpool_thread_4, started daemon 125182980171456)>, <Thread(tpool_thread_5, started daemon 125182971778752)>, <Thread(tpool_thread_6, started daemon 125182963386048)>, <Thread(tpool_thread_7, started daemon 125182954993344)>, <Thread(tpool_thread_8, started daemon 125182946600640)>, <Thread(tpool_thread_9, started daemon 125182938207936)>, <Thread(tpool_thread_10, started daemon 125182929815232)>, <Thread(tpool_thread_11, started daemon 125182921422528)>, <Thread(tpool_thread_12, started daemon 125182913013440)>, <Thread(tpool_thread_13, started daemon 125182904604352)>, <Thread(tpool_thread_14, started daemon 125182896195264)>, <Thread(tpool_thread_15, started daemon 125182887786176)>, <Thread(tpool_thread_16, started daemon 125182879377088)>, <Thread(tpool_thread_17, started daemon 125182870968000)>, <Thread(tpool_thread_18, started daemon 125182862558912)>, <Thread(tpool_thread_19, started daemon 125182854149824)>] {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 17:21:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-0b3602fe-0f79-49d9-a4f6-48401c91efe1 req-f3d59c78-188a-4b26-80e6-978fb50dbbc6 tempest-TestStampPattern-1009918079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:21:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-0b3602fe-0f79-49d9-a4f6-48401c91efe1 req-f3d59c78-188a-4b26-80e6-978fb50dbbc6 tempest-TestStampPattern-1009918079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:21:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [req-0b3602fe-0f79-49d9-a4f6-48401c91efe1 req-f3d59c78-188a-4b26-80e6-978fb50dbbc6 tempest-TestStampPattern-1009918079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:21:04 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-0b3602fe-0f79-49d9-a4f6-48401c91efe1 req-f3d59c78-188a-4b26-80e6-978fb50dbbc6 tempest-TestStampPattern-1009918079 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316', 'name': 'volume-cf4bd327-5e37-45a7-b00f-a7e8ee8cf55b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1efcbda6-84ff-4c9d-9487-525d8d25d0fc', 'enforce_multipath': True} {{(pid=86856) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 17:21:04 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-0b3602fe-0f79-49d9-a4f6-48401c91efe1 req-f3d59c78-188a-4b26-80e6-978fb50dbbc6 tempest-TestStampPattern-1009918079 None] attachment_update completed successfully.
Nov 06 17:21:06 devstack cinder-volume[86856]: INFO cinder.volume.manager [req-b53b94e3-7c9b-4549-a7ad-ab9fb72722b1 req-da056313-7493-4ebb-87d1-192114624c7f tempest-TestStampPattern-1009918079 None] Terminate volume connection completed successfully.
Nov 06 17:21:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [req-b53b94e3-7c9b-4549-a7ad-ab9fb72722b1 req-da056313-7493-4ebb-87d1-192114624c7f tempest-TestStampPattern-1009918079 None] Deleting attachment 1efcbda6-84ff-4c9d-9487-525d8d25d0fc. {{(pid=86856) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 17:21:10 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a9f49abc-3654-437c-98a8-77c1214cdd3f tempest-TestStampPattern-1009918079 None] Acquiring lock "cinder-cf4bd327-5e37-45a7-b00f-a7e8ee8cf55b-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:21:10 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a9f49abc-3654-437c-98a8-77c1214cdd3f tempest-TestStampPattern-1009918079 None] Lock "cinder-cf4bd327-5e37-45a7-b00f-a7e8ee8cf55b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:21:10 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a9f49abc-3654-437c-98a8-77c1214cdd3f tempest-TestStampPattern-1009918079 None] Acquiring lock "cinder-quobyte-cf4bd327-5e37-45a7-b00f-a7e8ee8cf55b" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:21:10 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a9f49abc-3654-437c-98a8-77c1214cdd3f tempest-TestStampPattern-1009918079 None] Lock "cinder-quobyte-cf4bd327-5e37-45a7-b00f-a7e8ee8cf55b" acquired by "delete_volume" :: waited 0.015s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:21:10 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e525c5-a289-46b4-b416-02a5a3e02fc9]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:21:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a9f49abc-3654-437c-98a8-77c1214cdd3f tempest-TestStampPattern-1009918079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cf4bd327-5e37-45a7-b00f-a7e8ee8cf55b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:10 devstack sudo[104157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cf4bd327-5e37-45a7-b00f-a7e8ee8cf55b
Nov 06 17:21:10 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:11 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a9f49abc-3654-437c-98a8-77c1214cdd3f tempest-TestStampPattern-1009918079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cf4bd327-5e37-45a7-b00f-a7e8ee8cf55b" returned: 0 in 0.365s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a9f49abc-3654-437c-98a8-77c1214cdd3f tempest-TestStampPattern-1009918079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cf4bd327-5e37-45a7-b00f-a7e8ee8cf55b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:11 devstack sudo[104162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cf4bd327-5e37-45a7-b00f-a7e8ee8cf55b
Nov 06 17:21:11 devstack sudo[104162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:11 devstack sudo[104162]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a9f49abc-3654-437c-98a8-77c1214cdd3f tempest-TestStampPattern-1009918079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cf4bd327-5e37-45a7-b00f-a7e8ee8cf55b" returned: 0 in 0.241s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a9f49abc-3654-437c-98a8-77c1214cdd3f tempest-TestStampPattern-1009918079 None] Lock "cinder-quobyte-cf4bd327-5e37-45a7-b00f-a7e8ee8cf55b" released by "delete_volume" :: held 0.644s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:21:11 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-a9f49abc-3654-437c-98a8-77c1214cdd3f tempest-TestStampPattern-1009918079 None] Created reservations ['54351786-f604-492c-85f4-a9135787da2d', '06681132-ba47-43cc-8b25-91235dd2dcc7', 'e3120a99-44a9-49c5-b7a6-cdf2edf9096e', 'c9851ee0-1ae3-491e-9d32-16f4d448ba33'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:21:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a9f49abc-3654-437c-98a8-77c1214cdd3f tempest-TestStampPattern-1009918079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:21:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a9f49abc-3654-437c-98a8-77c1214cdd3f tempest-TestStampPattern-1009918079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:21:11 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a9f49abc-3654-437c-98a8-77c1214cdd3f tempest-TestStampPattern-1009918079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:21:11 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a9f49abc-3654-437c-98a8-77c1214cdd3f tempest-TestStampPattern-1009918079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:21:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a9f49abc-3654-437c-98a8-77c1214cdd3f tempest-TestStampPattern-1009918079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:21:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a9f49abc-3654-437c-98a8-77c1214cdd3f tempest-TestStampPattern-1009918079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:11 devstack sudo[104165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:21:11 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:11 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a9f49abc-3654-437c-98a8-77c1214cdd3f tempest-TestStampPattern-1009918079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.243s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:11 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-a9f49abc-3654-437c-98a8-77c1214cdd3f tempest-TestStampPattern-1009918079 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:21:11 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-a9f49abc-3654-437c-98a8-77c1214cdd3f tempest-TestStampPattern-1009918079 None] Deleted volume successfully.
Nov 06 17:21:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a9f49abc-3654-437c-98a8-77c1214cdd3f tempest-TestStampPattern-1009918079 None] Lock "cinder-cf4bd327-5e37-45a7-b00f-a7e8ee8cf55b-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:21:12 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-523378f2-fe14-4dcd-9ed7-9c065e4c9492 tempest-TestStampPattern-1009918079 None] Acquiring lock "cinder-21581e58-50eb-441f-8d83-3c6d5527c955-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:21:12 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-523378f2-fe14-4dcd-9ed7-9c065e4c9492 tempest-TestStampPattern-1009918079 None] Lock "cinder-21581e58-50eb-441f-8d83-3c6d5527c955-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:21:12 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-523378f2-fe14-4dcd-9ed7-9c065e4c9492 tempest-TestStampPattern-1009918079 None] Acquiring lock "cinder-quobyte-59dcfba4-41a4-46f5-a86a-7b2bc2a58862" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:21:12 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-523378f2-fe14-4dcd-9ed7-9c065e4c9492 tempest-TestStampPattern-1009918079 None] Lock "cinder-quobyte-59dcfba4-41a4-46f5-a86a-7b2bc2a58862" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:21:12 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-523378f2-fe14-4dcd-9ed7-9c065e4c9492 tempest-TestStampPattern-1009918079 None] Acquiring lock "cinder-quobyte-21581e58-50eb-441f-8d83-3c6d5527c955" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:21:12 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-523378f2-fe14-4dcd-9ed7-9c065e4c9492 tempest-TestStampPattern-1009918079 None] Lock "cinder-quobyte-21581e58-50eb-441f-8d83-3c6d5527c955" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:21:12 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-523378f2-fe14-4dcd-9ed7-9c065e4c9492 tempest-TestStampPattern-1009918079 None] Deleting offline snapshot 21581e58-50eb-441f-8d83-3c6d5527c955 of volume 59dcfba4-41a4-46f5-a86a-7b2bc2a58862 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:21:12 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-523378f2-fe14-4dcd-9ed7-9c065e4c9492 tempest-TestStampPattern-1009918079 None] snapshot_file for this snap is: volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862.21581e58-50eb-441f-8d83-3c6d5527c955 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:21:12 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[df543bdc-1c9e-41ce-bc09-de046c7ca957]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:21:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-523378f2-fe14-4dcd-9ed7-9c065e4c9492 tempest-TestStampPattern-1009918079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862.21581e58-50eb-441f-8d83-3c6d5527c955 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:12 devstack sudo[104169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862.21581e58-50eb-441f-8d83-3c6d5527c955
Nov 06 17:21:12 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:12 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-523378f2-fe14-4dcd-9ed7-9c065e4c9492 tempest-TestStampPattern-1009918079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862.21581e58-50eb-441f-8d83-3c6d5527c955" returned: 0 in 0.354s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:12 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-523378f2-fe14-4dcd-9ed7-9c065e4c9492 tempest-TestStampPattern-1009918079 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:21:12 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[669b36f9-484e-49d3-9988-379880662c46]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:21:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-523378f2-fe14-4dcd-9ed7-9c065e4c9492 tempest-TestStampPattern-1009918079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:12 devstack sudo[104174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862
Nov 06 17:21:12 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:12 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-523378f2-fe14-4dcd-9ed7-9c065e4c9492 tempest-TestStampPattern-1009918079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862" returned: 0 in 0.517s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-523378f2-fe14-4dcd-9ed7-9c065e4c9492 tempest-TestStampPattern-1009918079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862.21581e58-50eb-441f-8d83-3c6d5527c955 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:13 devstack sudo[104179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862.21581e58-50eb-441f-8d83-3c6d5527c955
Nov 06 17:21:13 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:13 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-523378f2-fe14-4dcd-9ed7-9c065e4c9492 tempest-TestStampPattern-1009918079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862.21581e58-50eb-441f-8d83-3c6d5527c955" returned: 0 in 0.353s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-523378f2-fe14-4dcd-9ed7-9c065e4c9492 tempest-TestStampPattern-1009918079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862.21581e58-50eb-441f-8d83-3c6d5527c955 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:13 devstack sudo[104184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862.21581e58-50eb-441f-8d83-3c6d5527c955
Nov 06 17:21:13 devstack sudo[104184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:13 devstack sudo[104184]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-523378f2-fe14-4dcd-9ed7-9c065e4c9492 tempest-TestStampPattern-1009918079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862.21581e58-50eb-441f-8d83-3c6d5527c955" returned: 0 in 0.252s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:13 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-523378f2-fe14-4dcd-9ed7-9c065e4c9492 tempest-TestStampPattern-1009918079 None] Lock "cinder-quobyte-21581e58-50eb-441f-8d83-3c6d5527c955" released by "_delete_snapshot" :: held 1.581s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:21:13 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-523378f2-fe14-4dcd-9ed7-9c065e4c9492 tempest-TestStampPattern-1009918079 None] Lock "cinder-quobyte-59dcfba4-41a4-46f5-a86a-7b2bc2a58862" released by "delete_snapshot" :: held 1.602s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:21:13 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-523378f2-fe14-4dcd-9ed7-9c065e4c9492 tempest-TestStampPattern-1009918079 None] Created reservations ['643856b8-95c0-4860-b16b-3e213e707612', '7cb662f6-60a9-4f4c-ad02-23ef32490300', 'fc200bd7-1478-4bc4-8b46-c3c6e085e868', '593627dc-a2ae-472a-8340-43b4c132688c'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:21:13 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-523378f2-fe14-4dcd-9ed7-9c065e4c9492 tempest-TestStampPattern-1009918079 None] Delete snapshot completed successfully.
Nov 06 17:21:13 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-523378f2-fe14-4dcd-9ed7-9c065e4c9492 tempest-TestStampPattern-1009918079 None] Lock "cinder-21581e58-50eb-441f-8d83-3c6d5527c955-delete_snapshot" released by "delete_snapshot" :: held 1.734s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:21:17 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-23cce29a-8eb1-4838-96d5-9dea91d8e4d3 tempest-TestStampPattern-1009918079 None] Acquiring lock "cinder-59dcfba4-41a4-46f5-a86a-7b2bc2a58862-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:21:17 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-23cce29a-8eb1-4838-96d5-9dea91d8e4d3 tempest-TestStampPattern-1009918079 None] Lock "cinder-59dcfba4-41a4-46f5-a86a-7b2bc2a58862-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:21:17 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-23cce29a-8eb1-4838-96d5-9dea91d8e4d3 tempest-TestStampPattern-1009918079 None] Acquiring lock "cinder-quobyte-59dcfba4-41a4-46f5-a86a-7b2bc2a58862" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:21:17 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-23cce29a-8eb1-4838-96d5-9dea91d8e4d3 tempest-TestStampPattern-1009918079 None] Lock "cinder-quobyte-59dcfba4-41a4-46f5-a86a-7b2bc2a58862" acquired by "delete_volume" :: waited 0.013s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:21:17 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd076f03-e1b6-4c5e-ba72-79b26f79d5dd]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:21:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-23cce29a-8eb1-4838-96d5-9dea91d8e4d3 tempest-TestStampPattern-1009918079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:17 devstack sudo[104213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862
Nov 06 17:21:17 devstack sudo[104213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:18 devstack sudo[104213]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-23cce29a-8eb1-4838-96d5-9dea91d8e4d3 tempest-TestStampPattern-1009918079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862" returned: 0 in 0.352s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-23cce29a-8eb1-4838-96d5-9dea91d8e4d3 tempest-TestStampPattern-1009918079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:18 devstack sudo[104218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862
Nov 06 17:21:18 devstack sudo[104218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:18 devstack sudo[104218]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-23cce29a-8eb1-4838-96d5-9dea91d8e4d3 tempest-TestStampPattern-1009918079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-59dcfba4-41a4-46f5-a86a-7b2bc2a58862" returned: 0 in 0.237s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:18 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-23cce29a-8eb1-4838-96d5-9dea91d8e4d3 tempest-TestStampPattern-1009918079 None] Lock "cinder-quobyte-59dcfba4-41a4-46f5-a86a-7b2bc2a58862" released by "delete_volume" :: held 0.651s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:21:18 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-23cce29a-8eb1-4838-96d5-9dea91d8e4d3 tempest-TestStampPattern-1009918079 None] Created reservations ['a507f0fe-8658-4525-84e8-80fca7ea7d18', '271a90b5-44a4-4ae9-8165-5887c7b99234', 'fb5c7d18-3889-4b3d-a72f-7e15ee687494', '2cdc383d-a2ba-4ae7-bd62-d88e835f1e19'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:21:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-23cce29a-8eb1-4838-96d5-9dea91d8e4d3 tempest-TestStampPattern-1009918079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:21:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-23cce29a-8eb1-4838-96d5-9dea91d8e4d3 tempest-TestStampPattern-1009918079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:21:18 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-23cce29a-8eb1-4838-96d5-9dea91d8e4d3 tempest-TestStampPattern-1009918079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:21:18 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-23cce29a-8eb1-4838-96d5-9dea91d8e4d3 tempest-TestStampPattern-1009918079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:21:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-23cce29a-8eb1-4838-96d5-9dea91d8e4d3 tempest-TestStampPattern-1009918079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:21:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-23cce29a-8eb1-4838-96d5-9dea91d8e4d3 tempest-TestStampPattern-1009918079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:18 devstack sudo[104221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:21:18 devstack sudo[104221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:18 devstack sudo[104221]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-23cce29a-8eb1-4838-96d5-9dea91d8e4d3 tempest-TestStampPattern-1009918079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.250s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:18 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-23cce29a-8eb1-4838-96d5-9dea91d8e4d3 tempest-TestStampPattern-1009918079 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:21:18 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-23cce29a-8eb1-4838-96d5-9dea91d8e4d3 tempest-TestStampPattern-1009918079 None] Deleted volume successfully.
Nov 06 17:21:18 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-23cce29a-8eb1-4838-96d5-9dea91d8e4d3 tempest-TestStampPattern-1009918079 None] Lock "cinder-59dcfba4-41a4-46f5-a86a-7b2bc2a58862-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:21:28 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=23,cinder:UPDATE=21,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:21:28 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=23,cinder:UPDATE=25,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:21:32 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:21:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Flow 'volume_create_manager' (7451aca6-bd00-4ee2-8bab-fe2dbc1478a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:21:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2556aeb-aba8-4649-9873-704f21854217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:21:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2556aeb-aba8-4649-9873-704f21854217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a609f1d-e1dd-420f-81fd-39e01e0f46f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91cd76df85444d668638370a8bf407ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:21:33Z,use_quota=True,user_id='600bac5e584643a29f14f9239ecacdd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(347fa647-38ea-461d-bae1-99a07463fee3),volume_type_id=347fa647-38ea-461d-bae1-99a07463fee3)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:21:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a0978bd-9089-4b89-81ca-753734ef916a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:21:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a0978bd-9089-4b89-81ca-753734ef916a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:21:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cad38b2-e6b7-4051-ad16-3e5632c93178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:21:32 devstack cinder-volume[86856]: DEBUG cinder.image.glance [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Creating Keystone auth plugin from conf {{(pid=86856) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 06 17:21:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cad38b2-e6b7-4051-ad16-3e5632c93178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6a609f1d-e1dd-420f-81fd-39e01e0f46f2', 'volume_name': 'volume-6a609f1d-e1dd-420f-81fd-39e01e0f46f2', 'volume_size': 1, 'image_id': '4655efcf-8b7f-461f-be74-2e56da0235c5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4655efcf-8b7f-461f-be74-2e56da0235c5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '86d42eb1c11a5775099c9f3acfa7a9ba', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '91cd76df85444d668638370a8bf407ef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b61a220a7895c0f67d7fc88fd785d5c7f18cc470b4d3a4f1fc73713c87f2cace6487a0de00c2ea79db04cf207516b27049562589e60aeec2232c4211a35134b5', 'id': '4655efcf-8b7f-461f-be74-2e56da0235c5', 'created_at': datetime.datetime(2026, 11, 6, 16, 21, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 16, 21, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4655efcf-8b7f-461f-be74-2e56da0235c5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x71da66d71790>}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:21:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31117aa2-2ac0-4142-9153-fdee855c704d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:21:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31117aa2-2ac0-4142-9153-fdee855c704d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:21:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1716cb9-0a90-4a6f-9084-54be496a969b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:21:33 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Volume 6a609f1d-e1dd-420f-81fd-39e01e0f46f2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6a609f1d-e1dd-420f-81fd-39e01e0f46f2', 'volume_size': 1, 'image_id': '4655efcf-8b7f-461f-be74-2e56da0235c5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4655efcf-8b7f-461f-be74-2e56da0235c5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '86d42eb1c11a5775099c9f3acfa7a9ba', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '91cd76df85444d668638370a8bf407ef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b61a220a7895c0f67d7fc88fd785d5c7f18cc470b4d3a4f1fc73713c87f2cace6487a0de00c2ea79db04cf207516b27049562589e60aeec2232c4211a35134b5', 'id': '4655efcf-8b7f-461f-be74-2e56da0235c5', 'created_at': datetime.datetime(2026, 11, 6, 16, 21, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 16, 21, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4655efcf-8b7f-461f-be74-2e56da0235c5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x71da66d71790>}
Nov 06 17:21:33 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Trying to clone 6a609f1d-e1dd-420f-81fd-39e01e0f46f2 from image 4655efcf-8b7f-461f-be74-2e56da0235c5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4655efcf-8b7f-461f-be74-2e56da0235c5', 'metadata': {}}]). {{(pid=86856) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 06 17:21:33 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4655efcf-8b7f-461f-be74-2e56da0235c5_8gz9cpcldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86856) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 06 17:21:33 devstack cinder-volume[86856]: INFO cinder.image.image_utils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Image download 0.00 MB at 0.00 MB/s
Nov 06 17:21:33 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffa3ba9-eb00-4f93-96dd-604781860312]: (4, 'raw') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:21:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4655efcf-8b7f-461f-be74-2e56da0235c5_8gz9cpcldevstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:33 devstack sudo[104233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4655efcf-8b7f-461f-be74-2e56da0235c5_8gz9cpcldevstack@QuobyteHD
Nov 06 17:21:33 devstack sudo[104233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:33 devstack sudo[104233]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4655efcf-8b7f-461f-be74-2e56da0235c5_8gz9cpcldevstack@QuobyteHD" returned: 0 in 0.326s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4655efcf-8b7f-461f-be74-2e56da0235c5_8gz9cpcldevstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:33 devstack sudo[104237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4655efcf-8b7f-461f-be74-2e56da0235c5_8gz9cpcldevstack@QuobyteHD
Nov 06 17:21:33 devstack sudo[104237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:33 devstack sudo[104237]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4655efcf-8b7f-461f-be74-2e56da0235c5_8gz9cpcldevstack@QuobyteHD" returned: 1 in 0.317s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4655efcf-8b7f-461f-be74-2e56da0235c5_8gz9cpcldevstack@QuobyteHD' failed. Not Retrying. {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 17:21:33 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Temporary image 4655efcf-8b7f-461f-be74-2e56da0235c5 is fetched for user 600bac5e584643a29f14f9239ecacdd4. {{(pid=86856) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 06 17:21:33 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec860ad0-bbf2-47f6-b842-7d7811f53870]: (4, 'raw') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:21:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4655efcf-8b7f-461f-be74-2e56da0235c5_8gz9cpcldevstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:34 devstack sudo[104242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4655efcf-8b7f-461f-be74-2e56da0235c5_8gz9cpcldevstack@QuobyteHD
Nov 06 17:21:34 devstack sudo[104242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:34 devstack sudo[104242]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4655efcf-8b7f-461f-be74-2e56da0235c5_8gz9cpcldevstack@QuobyteHD" returned: 0 in 0.322s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4655efcf-8b7f-461f-be74-2e56da0235c5_8gz9cpcldevstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:34 devstack sudo[104246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4655efcf-8b7f-461f-be74-2e56da0235c5_8gz9cpcldevstack@QuobyteHD
Nov 06 17:21:34 devstack sudo[104246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:34 devstack sudo[104246]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4655efcf-8b7f-461f-be74-2e56da0235c5_8gz9cpcldevstack@QuobyteHD" returned: 1 in 0.321s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4655efcf-8b7f-461f-be74-2e56da0235c5_8gz9cpcldevstack@QuobyteHD' failed. Not Retrying. {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 17:21:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:21:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:21:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a609f1d-e1dd-420f-81fd-39e01e0f46f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91cd76df85444d668638370a8bf407ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:21:33Z,use_quota=True,user_id='600bac5e584643a29f14f9239ecacdd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(347fa647-38ea-461d-bae1-99a07463fee3),volume_type_id=347fa647-38ea-461d-bae1-99a07463fee3)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:21:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Creating volume 6a609f1d-e1dd-420f-81fd-39e01e0f46f2 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:21:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:21:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:21:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:21:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:21:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:21:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:21:34 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:21:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6a609f1d-e1dd-420f-81fd-39e01e0f46f2 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:34 devstack sudo[104251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6a609f1d-e1dd-420f-81fd-39e01e0f46f2 1073741824
Nov 06 17:21:34 devstack sudo[104251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:35 devstack sudo[104251]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6a609f1d-e1dd-420f-81fd-39e01e0f46f2 1073741824" returned: 0 in 0.428s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6a609f1d-e1dd-420f-81fd-39e01e0f46f2 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:35 devstack sudo[104256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6a609f1d-e1dd-420f-81fd-39e01e0f46f2
Nov 06 17:21:35 devstack sudo[104256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:35 devstack sudo[104256]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6a609f1d-e1dd-420f-81fd-39e01e0f46f2" returned: 0 in 0.246s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:21:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:21:35 devstack cinder-volume[86856]: DEBUG cinder.volume.volume_utils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Attempting download of 4655efcf-8b7f-461f-be74-2e56da0235c5 ((None, [{'url': 'file:///opt/stack/data/glance/images/4655efcf-8b7f-461f-be74-2e56da0235c5', 'metadata': {}}])) to volume 6a609f1d-e1dd-420f-81fd-39e01e0f46f2. {{(pid=86856) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 06 17:21:35 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf07655-4fe5-4fc2-8424-35b24b1ffdbb]: (4, 'raw') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:21:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4655efcf-8b7f-461f-be74-2e56da0235c5_p1s3jjck {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:35 devstack sudo[104259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4655efcf-8b7f-461f-be74-2e56da0235c5_p1s3jjck
Nov 06 17:21:35 devstack sudo[104259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:35 devstack sudo[104259]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4655efcf-8b7f-461f-be74-2e56da0235c5_p1s3jjck" returned: 0 in 0.327s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4655efcf-8b7f-461f-be74-2e56da0235c5_p1s3jjck {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:35 devstack sudo[104263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4655efcf-8b7f-461f-be74-2e56da0235c5_p1s3jjck
Nov 06 17:21:35 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:36 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4655efcf-8b7f-461f-be74-2e56da0235c5_p1s3jjck" returned: 1 in 0.320s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4655efcf-8b7f-461f-be74-2e56da0235c5_p1s3jjck' failed. Not Retrying. {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 17:21:36 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5fa3a1-973a-42c0-9832-54792ab988a9]: (4, 'raw') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:21:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4655efcf-8b7f-461f-be74-2e56da0235c5_8gz9cpcldevstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:36 devstack sudo[104267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4655efcf-8b7f-461f-be74-2e56da0235c5_8gz9cpcldevstack@QuobyteHD
Nov 06 17:21:36 devstack sudo[104267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:36 devstack sudo[104267]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4655efcf-8b7f-461f-be74-2e56da0235c5_8gz9cpcldevstack@QuobyteHD" returned: 0 in 0.317s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4655efcf-8b7f-461f-be74-2e56da0235c5_8gz9cpcldevstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:36 devstack sudo[104271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4655efcf-8b7f-461f-be74-2e56da0235c5_8gz9cpcldevstack@QuobyteHD
Nov 06 17:21:36 devstack sudo[104271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:36 devstack sudo[104271]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4655efcf-8b7f-461f-be74-2e56da0235c5_8gz9cpcldevstack@QuobyteHD" returned: 1 in 0.316s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4655efcf-8b7f-461f-be74-2e56da0235c5_8gz9cpcldevstack@QuobyteHD' failed. Not Retrying. {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 17:21:36 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] 4655efcf-8b7f-461f-be74-2e56da0235c5 was raw, converting to qcow2 {{(pid=86856) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 06 17:21:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4655efcf-8b7f-461f-be74-2e56da0235c5_8gz9cpcldevstack@QuobyteHD /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6a609f1d-e1dd-420f-81fd-39e01e0f46f2 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:36 devstack sudo[104276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4655efcf-8b7f-461f-be74-2e56da0235c5_8gz9cpcldevstack@QuobyteHD /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6a609f1d-e1dd-420f-81fd-39e01e0f46f2
Nov 06 17:21:36 devstack sudo[104276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:37 devstack sudo[104276]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4655efcf-8b7f-461f-be74-2e56da0235c5_8gz9cpcldevstack@QuobyteHD /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6a609f1d-e1dd-420f-81fd-39e01e0f46f2" returned: 0 in 0.431s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:37 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4655efcf-8b7f-461f-be74-2e56da0235c5_8gz9cpcldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6a609f1d-e1dd-420f-81fd-39e01e0f46f2 {{(pid=86856) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 17:21:37 devstack cinder-volume[86856]: INFO cinder.image.image_utils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Converted 0.00 MB image at 0.00 MB/s
Nov 06 17:21:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6a609f1d-e1dd-420f-81fd-39e01e0f46f2 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:37 devstack sudo[104282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6a609f1d-e1dd-420f-81fd-39e01e0f46f2 1G
Nov 06 17:21:37 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:37 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6a609f1d-e1dd-420f-81fd-39e01e0f46f2 1G" returned: 0 in 0.306s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:37 devstack cinder-volume[86856]: DEBUG cinder.volume.volume_utils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Downloaded image 4655efcf-8b7f-461f-be74-2e56da0235c5 ((None, [{'url': 'file:///opt/stack/data/glance/images/4655efcf-8b7f-461f-be74-2e56da0235c5', 'metadata': {}}])) to volume 6a609f1d-e1dd-420f-81fd-39e01e0f46f2 successfully. {{(pid=86856) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 06 17:21:37 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Temporary image 4655efcf-8b7f-461f-be74-2e56da0235c5 for user 600bac5e584643a29f14f9239ecacdd4 is deleted. {{(pid=86856) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 06 17:21:37 devstack cinder-volume[86856]: DEBUG cinder.volume.volume_utils [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Marking volume 6a609f1d-e1dd-420f-81fd-39e01e0f46f2 as bootable. {{(pid=86856) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 06 17:21:37 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Copying metadata from image 4655efcf-8b7f-461f-be74-2e56da0235c5 to 6a609f1d-e1dd-420f-81fd-39e01e0f46f2. {{(pid=86856) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 06 17:21:37 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Creating volume glance metadata for volume 6a609f1d-e1dd-420f-81fd-39e01e0f46f2 backed by image 4655efcf-8b7f-461f-be74-2e56da0235c5 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '4655efcf-8b7f-461f-be74-2e56da0235c5', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '86d42eb1c11a5775099c9f3acfa7a9ba', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86856) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 06 17:21:37 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1716cb9-0a90-4a6f-9084-54be496a969b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a609f1d-e1dd-420f-81fd-39e01e0f46f2', 'volume_size': 1, 'image_id': '4655efcf-8b7f-461f-be74-2e56da0235c5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4655efcf-8b7f-461f-be74-2e56da0235c5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '86d42eb1c11a5775099c9f3acfa7a9ba', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '91cd76df85444d668638370a8bf407ef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b61a220a7895c0f67d7fc88fd785d5c7f18cc470b4d3a4f1fc73713c87f2cace6487a0de00c2ea79db04cf207516b27049562589e60aeec2232c4211a35134b5', 'id': '4655efcf-8b7f-461f-be74-2e56da0235c5', 'created_at': datetime.datetime(2026, 11, 6, 16, 21, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 16, 21, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4655efcf-8b7f-461f-be74-2e56da0235c5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x71da66d71790>}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:21:37 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a66feb73-cdad-4395-a294-e24366c29ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:21:37 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Volume volume-6a609f1d-e1dd-420f-81fd-39e01e0f46f2 (6a609f1d-e1dd-420f-81fd-39e01e0f46f2): created successfully
Nov 06 17:21:37 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a66feb73-cdad-4395-a294-e24366c29ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:21:37 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Flow 'volume_create_manager' (7451aca6-bd00-4ee2-8bab-fe2dbc1478a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:21:37 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-5ecee297-8ee3-4f3c-bfac-09b2b9f957b1 tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Created volume successfully.
Nov 06 17:21:38 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-36b02bd9-b747-42f5-aab0-4ccd470a6ead tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Acquiring lock "cinder-6a609f1d-e1dd-420f-81fd-39e01e0f46f2-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:21:38 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-36b02bd9-b747-42f5-aab0-4ccd470a6ead tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Lock "cinder-6a609f1d-e1dd-420f-81fd-39e01e0f46f2-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:21:38 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-36b02bd9-b747-42f5-aab0-4ccd470a6ead tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Acquiring lock "cinder-quobyte-6a609f1d-e1dd-420f-81fd-39e01e0f46f2" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:21:38 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-36b02bd9-b747-42f5-aab0-4ccd470a6ead tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Lock "cinder-quobyte-6a609f1d-e1dd-420f-81fd-39e01e0f46f2" acquired by "delete_volume" :: waited 0.013s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:21:38 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f8037d-6752-4bd7-83e6-51a60ab893aa]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:21:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-36b02bd9-b747-42f5-aab0-4ccd470a6ead tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6a609f1d-e1dd-420f-81fd-39e01e0f46f2 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:38 devstack sudo[104287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6a609f1d-e1dd-420f-81fd-39e01e0f46f2
Nov 06 17:21:38 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:38 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-36b02bd9-b747-42f5-aab0-4ccd470a6ead tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6a609f1d-e1dd-420f-81fd-39e01e0f46f2" returned: 0 in 0.349s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-36b02bd9-b747-42f5-aab0-4ccd470a6ead tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6a609f1d-e1dd-420f-81fd-39e01e0f46f2 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:38 devstack sudo[104292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6a609f1d-e1dd-420f-81fd-39e01e0f46f2
Nov 06 17:21:38 devstack sudo[104292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:38 devstack sudo[104292]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-36b02bd9-b747-42f5-aab0-4ccd470a6ead tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6a609f1d-e1dd-420f-81fd-39e01e0f46f2" returned: 0 in 0.249s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:38 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-36b02bd9-b747-42f5-aab0-4ccd470a6ead tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Lock "cinder-quobyte-6a609f1d-e1dd-420f-81fd-39e01e0f46f2" released by "delete_volume" :: held 0.641s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:21:38 devstack cinder-volume[86856]: WARNING cinder.quota [None req-36b02bd9-b747-42f5-aab0-4ccd470a6ead tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 06 17:21:38 devstack cinder-volume[86856]: WARNING cinder.quota [None req-36b02bd9-b747-42f5-aab0-4ccd470a6ead tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 06 17:21:38 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-36b02bd9-b747-42f5-aab0-4ccd470a6ead tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Created reservations ['daa3afd8-40f8-45c8-9e10-44d78f681403', '282cb8a2-a0e8-4fe5-ad05-d43aacd0a395', '2481b72a-1109-4721-ae42-f64d2ad52aaa', 'e16c928e-7498-4eca-a49a-469636877248'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:21:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-36b02bd9-b747-42f5-aab0-4ccd470a6ead tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:21:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-36b02bd9-b747-42f5-aab0-4ccd470a6ead tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:21:38 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-36b02bd9-b747-42f5-aab0-4ccd470a6ead tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:21:38 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-36b02bd9-b747-42f5-aab0-4ccd470a6ead tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:21:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-36b02bd9-b747-42f5-aab0-4ccd470a6ead tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:21:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-36b02bd9-b747-42f5-aab0-4ccd470a6ead tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:38 devstack sudo[104295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:21:38 devstack sudo[104295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:39 devstack sudo[104295]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-36b02bd9-b747-42f5-aab0-4ccd470a6ead tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.244s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:39 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-36b02bd9-b747-42f5-aab0-4ccd470a6ead tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:21:39 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-36b02bd9-b747-42f5-aab0-4ccd470a6ead tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Deleted volume successfully.
Nov 06 17:21:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-36b02bd9-b747-42f5-aab0-4ccd470a6ead tempest-VolumeAndVolumeTypeFromImageTest-491914626 None] Lock "cinder-6a609f1d-e1dd-420f-81fd-39e01e0f46f2-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:21:42 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:21:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:21:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:21:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:21:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:21:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:21:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:42 devstack sudo[104301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:21:42 devstack sudo[104301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:42 devstack sudo[104301]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.241s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:42 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:21:42 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager._thread_info {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:21:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread count: 28 {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 17:21:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread info: [<_MainThread(MainThread, started 125183137599616)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125183027608256)>, <Thread(Thread-3 (stat_writer), started daemon 125183025243776)>, <Thread(Rabbit-heartbeat, started daemon 125183023512896)>, <Thread(Thread-5 (_runner), started daemon 125183023357120)>, <Thread(Thread-7 (_runner), started daemon 125183021306496)>, <Thread(fd_logger, started daemon 125183018711616)>, <Thread(privsep_reader, started daemon 125183017484224)>, <Thread(tpool_thread_0, started daemon 125183013742272)>, <Thread(tpool_thread_1, started daemon 125183005349568)>, <Thread(tpool_thread_2, started daemon 125182996956864)>, <Thread(tpool_thread_3, started daemon 125182988564160)>, <Thread(tpool_thread_4, started daemon 125182980171456)>, <Thread(tpool_thread_5, started daemon 125182971778752)>, <Thread(tpool_thread_6, started daemon 125182963386048)>, <Thread(tpool_thread_7, started daemon 125182954993344)>, <Thread(tpool_thread_8, started daemon 125182946600640)>, <Thread(tpool_thread_9, started daemon 125182938207936)>, <Thread(tpool_thread_10, started daemon 125182929815232)>, <Thread(tpool_thread_11, started daemon 125182921422528)>, <Thread(tpool_thread_12, started daemon 125182913013440)>, <Thread(tpool_thread_13, started daemon 125182904604352)>, <Thread(tpool_thread_14, started daemon 125182896195264)>, <Thread(tpool_thread_15, started daemon 125182887786176)>, <Thread(tpool_thread_16, started daemon 125182879377088)>, <Thread(tpool_thread_17, started daemon 125182870968000)>, <Thread(tpool_thread_18, started daemon 125182862558912)>, <Thread(tpool_thread_19, started daemon 125182854149824)>] {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 17:21:43 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-8baac6ee-3460-4493-8dbf-f6bd32be8a3f tempest-VolumeDependencyTests-39575988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:21:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8baac6ee-3460-4493-8dbf-f6bd32be8a3f tempest-VolumeDependencyTests-39575988 None] Flow 'volume_create_manager' (16bf985c-2d03-4116-8ee8-bb1fc21a846b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:21:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8baac6ee-3460-4493-8dbf-f6bd32be8a3f tempest-VolumeDependencyTests-39575988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e7248d4-2bae-4452-9053-14afd59f1a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:21:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8baac6ee-3460-4493-8dbf-f6bd32be8a3f tempest-VolumeDependencyTests-39575988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e7248d4-2bae-4452-9053-14afd59f1a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1095859702',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e4001ed-71ab-4cbc-878c-69c47c478c35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='253118d5bac449fab9f1c812ac24aed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:21:43Z,use_quota=True,user_id='c84f90a2b1a743c68476b2734b5888c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:21:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8baac6ee-3460-4493-8dbf-f6bd32be8a3f tempest-VolumeDependencyTests-39575988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b71c4dd8-72b0-4b4e-885d-5edb1350c2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:21:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8baac6ee-3460-4493-8dbf-f6bd32be8a3f tempest-VolumeDependencyTests-39575988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b71c4dd8-72b0-4b4e-885d-5edb1350c2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:21:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8baac6ee-3460-4493-8dbf-f6bd32be8a3f tempest-VolumeDependencyTests-39575988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ed3a5c0-c559-4ad1-9099-82e5c0b21edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:21:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8baac6ee-3460-4493-8dbf-f6bd32be8a3f tempest-VolumeDependencyTests-39575988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ed3a5c0-c559-4ad1-9099-82e5c0b21edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e4001ed-71ab-4cbc-878c-69c47c478c35', 'volume_name': 'volume-1e4001ed-71ab-4cbc-878c-69c47c478c35', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:21:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8baac6ee-3460-4493-8dbf-f6bd32be8a3f tempest-VolumeDependencyTests-39575988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b632404f-7553-4d8e-8df4-de5f084178de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:21:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8baac6ee-3460-4493-8dbf-f6bd32be8a3f tempest-VolumeDependencyTests-39575988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b632404f-7553-4d8e-8df4-de5f084178de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:21:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8baac6ee-3460-4493-8dbf-f6bd32be8a3f tempest-VolumeDependencyTests-39575988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79b190e9-d4ff-4ad7-b4bc-0056caf4a6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:21:43 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-8baac6ee-3460-4493-8dbf-f6bd32be8a3f tempest-VolumeDependencyTests-39575988 None] Volume 1e4001ed-71ab-4cbc-878c-69c47c478c35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e4001ed-71ab-4cbc-878c-69c47c478c35', 'volume_size': 1}
Nov 06 17:21:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-8baac6ee-3460-4493-8dbf-f6bd32be8a3f tempest-VolumeDependencyTests-39575988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:21:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-8baac6ee-3460-4493-8dbf-f6bd32be8a3f tempest-VolumeDependencyTests-39575988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:21:43 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-8baac6ee-3460-4493-8dbf-f6bd32be8a3f tempest-VolumeDependencyTests-39575988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1095859702',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e4001ed-71ab-4cbc-878c-69c47c478c35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='253118d5bac449fab9f1c812ac24aed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:21:43Z,use_quota=True,user_id='c84f90a2b1a743c68476b2734b5888c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:21:43 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-8baac6ee-3460-4493-8dbf-f6bd32be8a3f tempest-VolumeDependencyTests-39575988 None] Creating volume 1e4001ed-71ab-4cbc-878c-69c47c478c35 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:21:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-8baac6ee-3460-4493-8dbf-f6bd32be8a3f tempest-VolumeDependencyTests-39575988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:21:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-8baac6ee-3460-4493-8dbf-f6bd32be8a3f tempest-VolumeDependencyTests-39575988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:21:43 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-8baac6ee-3460-4493-8dbf-f6bd32be8a3f tempest-VolumeDependencyTests-39575988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:21:43 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-8baac6ee-3460-4493-8dbf-f6bd32be8a3f tempest-VolumeDependencyTests-39575988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:21:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-8baac6ee-3460-4493-8dbf-f6bd32be8a3f tempest-VolumeDependencyTests-39575988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:21:43 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-8baac6ee-3460-4493-8dbf-f6bd32be8a3f tempest-VolumeDependencyTests-39575988 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:21:43 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-8baac6ee-3460-4493-8dbf-f6bd32be8a3f tempest-VolumeDependencyTests-39575988 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:21:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8baac6ee-3460-4493-8dbf-f6bd32be8a3f tempest-VolumeDependencyTests-39575988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:43 devstack sudo[104304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35 1073741824
Nov 06 17:21:43 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:43 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8baac6ee-3460-4493-8dbf-f6bd32be8a3f tempest-VolumeDependencyTests-39575988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35 1073741824" returned: 0 in 0.428s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8baac6ee-3460-4493-8dbf-f6bd32be8a3f tempest-VolumeDependencyTests-39575988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:43 devstack sudo[104309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35
Nov 06 17:21:43 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:44 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-8baac6ee-3460-4493-8dbf-f6bd32be8a3f tempest-VolumeDependencyTests-39575988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35" returned: 0 in 0.253s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:44 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-8baac6ee-3460-4493-8dbf-f6bd32be8a3f tempest-VolumeDependencyTests-39575988 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:21:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-8baac6ee-3460-4493-8dbf-f6bd32be8a3f tempest-VolumeDependencyTests-39575988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:21:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8baac6ee-3460-4493-8dbf-f6bd32be8a3f tempest-VolumeDependencyTests-39575988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79b190e9-d4ff-4ad7-b4bc-0056caf4a6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e4001ed-71ab-4cbc-878c-69c47c478c35', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:21:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8baac6ee-3460-4493-8dbf-f6bd32be8a3f tempest-VolumeDependencyTests-39575988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31362bca-7a53-44e5-be21-704a198e75ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:21:44 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-8baac6ee-3460-4493-8dbf-f6bd32be8a3f tempest-VolumeDependencyTests-39575988 None] Volume volume-1e4001ed-71ab-4cbc-878c-69c47c478c35 (1e4001ed-71ab-4cbc-878c-69c47c478c35): created successfully
Nov 06 17:21:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8baac6ee-3460-4493-8dbf-f6bd32be8a3f tempest-VolumeDependencyTests-39575988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31362bca-7a53-44e5-be21-704a198e75ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:21:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-8baac6ee-3460-4493-8dbf-f6bd32be8a3f tempest-VolumeDependencyTests-39575988 None] Flow 'volume_create_manager' (16bf985c-2d03-4116-8ee8-bb1fc21a846b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:21:44 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-8baac6ee-3460-4493-8dbf-f6bd32be8a3f tempest-VolumeDependencyTests-39575988 None] Created volume successfully.
Nov 06 17:21:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-063d9ef1-721b-4187-be54-11ab514c720f tempest-VolumeDependencyTests-39575988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:21:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-063d9ef1-721b-4187-be54-11ab514c720f tempest-VolumeDependencyTests-39575988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:21:44 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-063d9ef1-721b-4187-be54-11ab514c720f tempest-VolumeDependencyTests-39575988 None] Creating offline snapshot f0cf64c7-5d31-44e9-a216-63e8daebc3b7 of volume 1e4001ed-71ab-4cbc-878c-69c47c478c35 {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:21:44 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[326855ed-fd84-45ce-b87c-a800a77a9f8c]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:21:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-063d9ef1-721b-4187-be54-11ab514c720f tempest-VolumeDependencyTests-39575988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:44 devstack sudo[104312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35
Nov 06 17:21:44 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:44 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-063d9ef1-721b-4187-be54-11ab514c720f tempest-VolumeDependencyTests-39575988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35" returned: 0 in 0.349s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-063d9ef1-721b-4187-be54-11ab514c720f tempest-VolumeDependencyTests-39575988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35.f0cf64c7-5d31-44e9-a216-63e8daebc3b7 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:44 devstack sudo[104317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35.f0cf64c7-5d31-44e9-a216-63e8daebc3b7 1G
Nov 06 17:21:44 devstack sudo[104317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:45 devstack sudo[104317]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-063d9ef1-721b-4187-be54-11ab514c720f tempest-VolumeDependencyTests-39575988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35.f0cf64c7-5d31-44e9-a216-63e8daebc3b7 1G" returned: 0 in 0.392s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-063d9ef1-721b-4187-be54-11ab514c720f tempest-VolumeDependencyTests-39575988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e4001ed-71ab-4cbc-878c-69c47c478c35 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35.f0cf64c7-5d31-44e9-a216-63e8daebc3b7 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:45 devstack sudo[104322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e4001ed-71ab-4cbc-878c-69c47c478c35 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35.f0cf64c7-5d31-44e9-a216-63e8daebc3b7
Nov 06 17:21:45 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:45 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-063d9ef1-721b-4187-be54-11ab514c720f tempest-VolumeDependencyTests-39575988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e4001ed-71ab-4cbc-878c-69c47c478c35 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35.f0cf64c7-5d31-44e9-a216-63e8daebc3b7" returned: 0 in 0.294s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:45 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-063d9ef1-721b-4187-be54-11ab514c720f tempest-VolumeDependencyTests-39575988 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35.f0cf64c7-5d31-44e9-a216-63e8daebc3b7 is being set with open permissions: ugo+rw
Nov 06 17:21:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-063d9ef1-721b-4187-be54-11ab514c720f tempest-VolumeDependencyTests-39575988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35.f0cf64c7-5d31-44e9-a216-63e8daebc3b7 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:45 devstack sudo[104330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35.f0cf64c7-5d31-44e9-a216-63e8daebc3b7
Nov 06 17:21:45 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:45 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-063d9ef1-721b-4187-be54-11ab514c720f tempest-VolumeDependencyTests-39575988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35.f0cf64c7-5d31-44e9-a216-63e8daebc3b7" returned: 0 in 0.243s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-063d9ef1-721b-4187-be54-11ab514c720f tempest-VolumeDependencyTests-39575988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:45 devstack sudo[104336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35.info
Nov 06 17:21:45 devstack sudo[104336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:46 devstack sudo[104336]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-063d9ef1-721b-4187-be54-11ab514c720f tempest-VolumeDependencyTests-39575988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35.info" returned: 0 in 0.250s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:46 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-063d9ef1-721b-4187-be54-11ab514c720f tempest-VolumeDependencyTests-39575988 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35.info is being set with open permissions: ugo+rw
Nov 06 17:21:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-063d9ef1-721b-4187-be54-11ab514c720f tempest-VolumeDependencyTests-39575988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:46 devstack sudo[104339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35.info
Nov 06 17:21:46 devstack sudo[104339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:46 devstack sudo[104339]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-063d9ef1-721b-4187-be54-11ab514c720f tempest-VolumeDependencyTests-39575988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35.info" returned: 0 in 0.238s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-063d9ef1-721b-4187-be54-11ab514c720f tempest-VolumeDependencyTests-39575988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.849s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:21:46 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-063d9ef1-721b-4187-be54-11ab514c720f tempest-VolumeDependencyTests-39575988 None] Create snapshot completed successfully
Nov 06 17:21:47 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:21:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Flow 'volume_create_manager' (d1d1d410-38f7-4203-b5da-486982e6d876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:21:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea5cb955-812f-423a-9481-66b315753f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:21:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea5cb955-812f-423a-9481-66b315753f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1925203612',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f1543c4-0f6f-487c-ba13-b76362e40713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='253118d5bac449fab9f1c812ac24aed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f0cf64c7-5d31-44e9-a216-63e8daebc3b7,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:21:47Z,use_quota=True,user_id='c84f90a2b1a743c68476b2734b5888c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:21:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7284606d-faa4-4630-8274-979964c72f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:21:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7284606d-faa4-4630-8274-979964c72f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:21:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5237322d-8c33-4abb-be07-34bbd5f9dc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:21:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5237322d-8c33-4abb-be07-34bbd5f9dc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5f1543c4-0f6f-487c-ba13-b76362e40713', 'volume_name': 'volume-5f1543c4-0f6f-487c-ba13-b76362e40713', 'volume_size': 1, 'snapshot_id': 'f0cf64c7-5d31-44e9-a216-63e8daebc3b7'}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:21:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f7a502a-5f48-4ca9-9f29-c85d7637e0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:21:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f7a502a-5f48-4ca9-9f29-c85d7637e0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:21:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d38d6e8-67da-4420-a25e-f9712606ae61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:21:47 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Volume 5f1543c4-0f6f-487c-ba13-b76362e40713: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5f1543c4-0f6f-487c-ba13-b76362e40713', 'volume_size': 1, 'snapshot_id': 'f0cf64c7-5d31-44e9-a216-63e8daebc3b7'}
Nov 06 17:21:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:21:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:21:47 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Acquiring lock "cinder-quobyte-f0cf64c7-5d31-44e9-a216-63e8daebc3b7-5f1543c4-0f6f-487c-ba13-b76362e40713" by "_create_volume_from_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:21:47 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Lock "cinder-quobyte-f0cf64c7-5d31-44e9-a216-63e8daebc3b7-5f1543c4-0f6f-487c-ba13-b76362e40713" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:21:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Creating volume 5f1543c4-0f6f-487c-ba13-b76362e40713 from snapshot f0cf64c7-5d31-44e9-a216-63e8daebc3b7 {{(pid=86856) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 06 17:21:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:21:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:21:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:21:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:21:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:21:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:21:47 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Acquiring lock "cinder-quobyte-5f1543c4-0f6f-487c-ba13-b76362e40713" by "_copy_volume_from_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:21:47 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Lock "cinder-quobyte-5f1543c4-0f6f-487c-ba13-b76362e40713" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:21:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] snapshot: f0cf64c7-5d31-44e9-a216-63e8daebc3b7, volume: 5f1543c4-0f6f-487c-ba13-b76362e40713,  {{(pid=86856) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 06 17:21:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:21:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:21:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:21:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:21:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:21:47 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[893c63b1-2893-4759-b4d4-7c80a1c1e970]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:21:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35.f0cf64c7-5d31-44e9-a216-63e8daebc3b7 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:47 devstack sudo[104342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35.f0cf64c7-5d31-44e9-a216-63e8daebc3b7
Nov 06 17:21:47 devstack sudo[104342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:47 devstack sudo[104342]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35.f0cf64c7-5d31-44e9-a216-63e8daebc3b7" returned: 0 in 0.358s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e4001ed-71ab-4cbc-878c-69c47c478c35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:21:47 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4a8167-148b-4de4-a054-c755e5f4ab07]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:21:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:47 devstack sudo[104347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35
Nov 06 17:21:47 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:48 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35" returned: 0 in 0.359s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:48 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35 {{(pid=86856) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 06 17:21:48 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Creating direct copy from snapshot {{(pid=86856) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 06 17:21:48 devstack cinder-volume[86856]: DEBUG cinder.utils [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Path /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5f1543c4-0f6f-487c-ba13-b76362e40713 not found in is_blk_device check {{(pid=86856) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 06 17:21:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5f1543c4-0f6f-487c-ba13-b76362e40713 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:48 devstack sudo[104352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5f1543c4-0f6f-487c-ba13-b76362e40713
Nov 06 17:21:48 devstack sudo[104352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:54 devstack sudo[104352]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5f1543c4-0f6f-487c-ba13-b76362e40713" returned: 0 in 6.194s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:54 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Image conversion details: src /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35, size 1024.00 MB, duration 6.20 sec, destination /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5f1543c4-0f6f-487c-ba13-b76362e40713 {{(pid=86856) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 17:21:54 devstack cinder-volume[86856]: INFO cinder.image.image_utils [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Converted 1024.00 MB image at 165.28 MB/s
Nov 06 17:21:54 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5f1543c4-0f6f-487c-ba13-b76362e40713 is being set with open permissions: ugo+rw
Nov 06 17:21:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5f1543c4-0f6f-487c-ba13-b76362e40713 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:54 devstack sudo[104404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5f1543c4-0f6f-487c-ba13-b76362e40713
Nov 06 17:21:54 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:54 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5f1543c4-0f6f-487c-ba13-b76362e40713" returned: 0 in 0.241s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:54 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Lock "cinder-quobyte-5f1543c4-0f6f-487c-ba13-b76362e40713" released by "_copy_volume_from_snapshot" :: held 7.235s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:21:54 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Lock "cinder-quobyte-f0cf64c7-5d31-44e9-a216-63e8daebc3b7-5f1543c4-0f6f-487c-ba13-b76362e40713" released by "_create_volume_from_snapshot" :: held 7.298s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:21:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.314s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:21:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d38d6e8-67da-4420-a25e-f9712606ae61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f1543c4-0f6f-487c-ba13-b76362e40713', 'volume_size': 1, 'snapshot_id': 'f0cf64c7-5d31-44e9-a216-63e8daebc3b7'}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:21:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (889bcfc4-827a-470a-aec7-7e3afbb3b876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:21:54 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Volume volume-5f1543c4-0f6f-487c-ba13-b76362e40713 (5f1543c4-0f6f-487c-ba13-b76362e40713): created successfully
Nov 06 17:21:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (889bcfc4-827a-470a-aec7-7e3afbb3b876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:21:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Flow 'volume_create_manager' (d1d1d410-38f7-4203-b5da-486982e6d876) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:21:54 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-34d8a984-02f5-4731-b8ad-914de9cae765 tempest-VolumeDependencyTests-39575988 None] Created volume successfully.
Nov 06 17:21:54 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9de15c21-45ce-4849-b7ce-c6a19c51cf24 tempest-VolumeDependencyTests-39575988 None] Acquiring lock "cinder-f0cf64c7-5d31-44e9-a216-63e8daebc3b7-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:21:54 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9de15c21-45ce-4849-b7ce-c6a19c51cf24 tempest-VolumeDependencyTests-39575988 None] Lock "cinder-f0cf64c7-5d31-44e9-a216-63e8daebc3b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:21:54 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9de15c21-45ce-4849-b7ce-c6a19c51cf24 tempest-VolumeDependencyTests-39575988 None] Acquiring lock "cinder-quobyte-1e4001ed-71ab-4cbc-878c-69c47c478c35" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:21:54 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9de15c21-45ce-4849-b7ce-c6a19c51cf24 tempest-VolumeDependencyTests-39575988 None] Lock "cinder-quobyte-1e4001ed-71ab-4cbc-878c-69c47c478c35" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:21:54 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9de15c21-45ce-4849-b7ce-c6a19c51cf24 tempest-VolumeDependencyTests-39575988 None] Acquiring lock "cinder-quobyte-f0cf64c7-5d31-44e9-a216-63e8daebc3b7" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:21:54 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9de15c21-45ce-4849-b7ce-c6a19c51cf24 tempest-VolumeDependencyTests-39575988 None] Lock "cinder-quobyte-f0cf64c7-5d31-44e9-a216-63e8daebc3b7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:21:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-9de15c21-45ce-4849-b7ce-c6a19c51cf24 tempest-VolumeDependencyTests-39575988 None] Deleting offline snapshot f0cf64c7-5d31-44e9-a216-63e8daebc3b7 of volume 1e4001ed-71ab-4cbc-878c-69c47c478c35 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:21:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-9de15c21-45ce-4849-b7ce-c6a19c51cf24 tempest-VolumeDependencyTests-39575988 None] snapshot_file for this snap is: volume-1e4001ed-71ab-4cbc-878c-69c47c478c35.f0cf64c7-5d31-44e9-a216-63e8daebc3b7 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:21:54 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[002f35ba-bc56-480d-ae45-b6d4f42f50b8]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:21:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9de15c21-45ce-4849-b7ce-c6a19c51cf24 tempest-VolumeDependencyTests-39575988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35.f0cf64c7-5d31-44e9-a216-63e8daebc3b7 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:54 devstack sudo[104407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35.f0cf64c7-5d31-44e9-a216-63e8daebc3b7
Nov 06 17:21:54 devstack sudo[104407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:55 devstack sudo[104407]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9de15c21-45ce-4849-b7ce-c6a19c51cf24 tempest-VolumeDependencyTests-39575988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35.f0cf64c7-5d31-44e9-a216-63e8daebc3b7" returned: 0 in 0.346s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:55 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-9de15c21-45ce-4849-b7ce-c6a19c51cf24 tempest-VolumeDependencyTests-39575988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e4001ed-71ab-4cbc-878c-69c47c478c35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:21:55 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[30da71be-9644-40fc-9afe-1cc3be852e0c]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:21:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9de15c21-45ce-4849-b7ce-c6a19c51cf24 tempest-VolumeDependencyTests-39575988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:55 devstack sudo[104412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35
Nov 06 17:21:55 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:55 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9de15c21-45ce-4849-b7ce-c6a19c51cf24 tempest-VolumeDependencyTests-39575988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35" returned: 0 in 0.534s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9de15c21-45ce-4849-b7ce-c6a19c51cf24 tempest-VolumeDependencyTests-39575988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35.f0cf64c7-5d31-44e9-a216-63e8daebc3b7 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:55 devstack sudo[104417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35.f0cf64c7-5d31-44e9-a216-63e8daebc3b7
Nov 06 17:21:55 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:56 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9de15c21-45ce-4849-b7ce-c6a19c51cf24 tempest-VolumeDependencyTests-39575988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35.f0cf64c7-5d31-44e9-a216-63e8daebc3b7" returned: 0 in 0.319s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9de15c21-45ce-4849-b7ce-c6a19c51cf24 tempest-VolumeDependencyTests-39575988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35.f0cf64c7-5d31-44e9-a216-63e8daebc3b7 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:56 devstack sudo[104422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35.f0cf64c7-5d31-44e9-a216-63e8daebc3b7
Nov 06 17:21:56 devstack sudo[104422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:56 devstack sudo[104422]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9de15c21-45ce-4849-b7ce-c6a19c51cf24 tempest-VolumeDependencyTests-39575988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35.f0cf64c7-5d31-44e9-a216-63e8daebc3b7" returned: 0 in 0.244s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:56 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9de15c21-45ce-4849-b7ce-c6a19c51cf24 tempest-VolumeDependencyTests-39575988 None] Lock "cinder-quobyte-f0cf64c7-5d31-44e9-a216-63e8daebc3b7" released by "_delete_snapshot" :: held 1.542s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:21:56 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9de15c21-45ce-4849-b7ce-c6a19c51cf24 tempest-VolumeDependencyTests-39575988 None] Lock "cinder-quobyte-1e4001ed-71ab-4cbc-878c-69c47c478c35" released by "delete_snapshot" :: held 1.563s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:21:56 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-9de15c21-45ce-4849-b7ce-c6a19c51cf24 tempest-VolumeDependencyTests-39575988 None] Created reservations ['95162292-1684-4cea-a27b-281fde2845c3', '0d2491f5-2b1e-46f8-8398-55e3a997a933', '2c4178e8-4fae-4d22-bd1c-a114ec6fef33', 'f38805ab-c4aa-4685-a17c-bb2c6cc3a436'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:21:56 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-9de15c21-45ce-4849-b7ce-c6a19c51cf24 tempest-VolumeDependencyTests-39575988 None] Delete snapshot completed successfully.
Nov 06 17:21:56 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9de15c21-45ce-4849-b7ce-c6a19c51cf24 tempest-VolumeDependencyTests-39575988 None] Lock "cinder-f0cf64c7-5d31-44e9-a216-63e8daebc3b7-delete_snapshot" released by "delete_snapshot" :: held 1.690s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:21:56 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-20de8c3d-3c0a-4925-89ee-90b1f3247537 tempest-VolumeDependencyTests-39575988 None] Acquiring lock "cinder-1e4001ed-71ab-4cbc-878c-69c47c478c35-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:21:56 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-20de8c3d-3c0a-4925-89ee-90b1f3247537 tempest-VolumeDependencyTests-39575988 None] Lock "cinder-1e4001ed-71ab-4cbc-878c-69c47c478c35-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:21:56 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-20de8c3d-3c0a-4925-89ee-90b1f3247537 tempest-VolumeDependencyTests-39575988 None] Acquiring lock "cinder-quobyte-1e4001ed-71ab-4cbc-878c-69c47c478c35" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:21:56 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-20de8c3d-3c0a-4925-89ee-90b1f3247537 tempest-VolumeDependencyTests-39575988 None] Lock "cinder-quobyte-1e4001ed-71ab-4cbc-878c-69c47c478c35" acquired by "delete_volume" :: waited 0.015s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:21:56 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53999b1-60c4-4de6-9de2-0f14965ea488]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:21:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-20de8c3d-3c0a-4925-89ee-90b1f3247537 tempest-VolumeDependencyTests-39575988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:57 devstack sudo[104426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35
Nov 06 17:21:57 devstack sudo[104426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:57 devstack sudo[104426]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-20de8c3d-3c0a-4925-89ee-90b1f3247537 tempest-VolumeDependencyTests-39575988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35" returned: 0 in 0.362s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-20de8c3d-3c0a-4925-89ee-90b1f3247537 tempest-VolumeDependencyTests-39575988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:57 devstack sudo[104431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35
Nov 06 17:21:57 devstack sudo[104431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:57 devstack sudo[104431]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-20de8c3d-3c0a-4925-89ee-90b1f3247537 tempest-VolumeDependencyTests-39575988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1e4001ed-71ab-4cbc-878c-69c47c478c35" returned: 0 in 0.245s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:57 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-20de8c3d-3c0a-4925-89ee-90b1f3247537 tempest-VolumeDependencyTests-39575988 None] Lock "cinder-quobyte-1e4001ed-71ab-4cbc-878c-69c47c478c35" released by "delete_volume" :: held 0.675s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:21:57 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-20de8c3d-3c0a-4925-89ee-90b1f3247537 tempest-VolumeDependencyTests-39575988 None] Created reservations ['f3505009-4cb2-4470-8bc9-06a36e7711da', '36147b10-51a0-4db5-b0f8-eae1a418cf41', '0603526e-6a8b-44c1-a4e9-0cde312ace94', 'cd7b8f83-289a-4c4a-94d7-59c11e953e63'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:21:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-20de8c3d-3c0a-4925-89ee-90b1f3247537 tempest-VolumeDependencyTests-39575988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:21:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-20de8c3d-3c0a-4925-89ee-90b1f3247537 tempest-VolumeDependencyTests-39575988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:21:57 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-20de8c3d-3c0a-4925-89ee-90b1f3247537 tempest-VolumeDependencyTests-39575988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:21:57 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-20de8c3d-3c0a-4925-89ee-90b1f3247537 tempest-VolumeDependencyTests-39575988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:21:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-20de8c3d-3c0a-4925-89ee-90b1f3247537 tempest-VolumeDependencyTests-39575988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:21:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-20de8c3d-3c0a-4925-89ee-90b1f3247537 tempest-VolumeDependencyTests-39575988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:57 devstack sudo[104434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:21:57 devstack sudo[104434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:57 devstack sudo[104434]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-20de8c3d-3c0a-4925-89ee-90b1f3247537 tempest-VolumeDependencyTests-39575988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.243s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:57 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-20de8c3d-3c0a-4925-89ee-90b1f3247537 tempest-VolumeDependencyTests-39575988 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:21:57 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-20de8c3d-3c0a-4925-89ee-90b1f3247537 tempest-VolumeDependencyTests-39575988 None] Deleted volume successfully.
Nov 06 17:21:57 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-20de8c3d-3c0a-4925-89ee-90b1f3247537 tempest-VolumeDependencyTests-39575988 None] Lock "cinder-1e4001ed-71ab-4cbc-878c-69c47c478c35-delete_volume" released by "delete_volume" :: held 1.112s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:21:58 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-361c3a52-3841-4840-95ac-f2c567f780b2 tempest-VolumeDependencyTests-39575988 None] Acquiring lock "cinder-5f1543c4-0f6f-487c-ba13-b76362e40713-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:21:58 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-361c3a52-3841-4840-95ac-f2c567f780b2 tempest-VolumeDependencyTests-39575988 None] Lock "cinder-5f1543c4-0f6f-487c-ba13-b76362e40713-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:21:58 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-361c3a52-3841-4840-95ac-f2c567f780b2 tempest-VolumeDependencyTests-39575988 None] Acquiring lock "cinder-quobyte-5f1543c4-0f6f-487c-ba13-b76362e40713" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:21:58 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-361c3a52-3841-4840-95ac-f2c567f780b2 tempest-VolumeDependencyTests-39575988 None] Lock "cinder-quobyte-5f1543c4-0f6f-487c-ba13-b76362e40713" acquired by "delete_volume" :: waited 0.018s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:21:58 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a11578-0e99-4133-ad64-11d2714d5604]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:21:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-361c3a52-3841-4840-95ac-f2c567f780b2 tempest-VolumeDependencyTests-39575988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5f1543c4-0f6f-487c-ba13-b76362e40713 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:58 devstack sudo[104437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5f1543c4-0f6f-487c-ba13-b76362e40713
Nov 06 17:21:58 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:58 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-361c3a52-3841-4840-95ac-f2c567f780b2 tempest-VolumeDependencyTests-39575988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5f1543c4-0f6f-487c-ba13-b76362e40713" returned: 0 in 0.347s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-361c3a52-3841-4840-95ac-f2c567f780b2 tempest-VolumeDependencyTests-39575988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5f1543c4-0f6f-487c-ba13-b76362e40713 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:58 devstack sudo[104442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5f1543c4-0f6f-487c-ba13-b76362e40713
Nov 06 17:21:58 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:58 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-361c3a52-3841-4840-95ac-f2c567f780b2 tempest-VolumeDependencyTests-39575988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5f1543c4-0f6f-487c-ba13-b76362e40713" returned: 0 in 0.239s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:58 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-361c3a52-3841-4840-95ac-f2c567f780b2 tempest-VolumeDependencyTests-39575988 None] Lock "cinder-quobyte-5f1543c4-0f6f-487c-ba13-b76362e40713" released by "delete_volume" :: held 0.628s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:21:58 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-361c3a52-3841-4840-95ac-f2c567f780b2 tempest-VolumeDependencyTests-39575988 None] Created reservations ['30b35dce-ea2e-459b-97e2-890342b37e7f', '4db68efc-dd86-4f85-a4ad-5c786f7a3325', '767f1ed8-97e2-4f2a-af9f-84d9c6400500', 'e13b50ca-05c1-46a7-8f35-0f3a1c717fbe'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:21:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-361c3a52-3841-4840-95ac-f2c567f780b2 tempest-VolumeDependencyTests-39575988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:21:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-361c3a52-3841-4840-95ac-f2c567f780b2 tempest-VolumeDependencyTests-39575988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:21:58 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-361c3a52-3841-4840-95ac-f2c567f780b2 tempest-VolumeDependencyTests-39575988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:21:58 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-361c3a52-3841-4840-95ac-f2c567f780b2 tempest-VolumeDependencyTests-39575988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:21:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-361c3a52-3841-4840-95ac-f2c567f780b2 tempest-VolumeDependencyTests-39575988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:21:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-361c3a52-3841-4840-95ac-f2c567f780b2 tempest-VolumeDependencyTests-39575988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:21:58 devstack sudo[104445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:21:58 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:21:59 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root
Nov 06 17:21:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-361c3a52-3841-4840-95ac-f2c567f780b2 tempest-VolumeDependencyTests-39575988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.243s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:21:59 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-361c3a52-3841-4840-95ac-f2c567f780b2 tempest-VolumeDependencyTests-39575988 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:21:59 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-361c3a52-3841-4840-95ac-f2c567f780b2 tempest-VolumeDependencyTests-39575988 None] Deleted volume successfully.
Nov 06 17:21:59 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-361c3a52-3841-4840-95ac-f2c567f780b2 tempest-VolumeDependencyTests-39575988 None] Lock "cinder-5f1543c4-0f6f-487c-ba13-b76362e40713-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:08 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:UPDATE=43,cinder:SELECT=35,cinder:INSERT=16,cinder:DELETE=4 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:22:09 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=41,cinder:UPDATE=41,cinder:INSERT=14,cinder:DELETE=3 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:22:15 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdbdea62-03e3-4180-a3b6-2aae796114ba tempest-CreateVolumesFromImageTest-1912033071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:22:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fdbdea62-03e3-4180-a3b6-2aae796114ba tempest-CreateVolumesFromImageTest-1912033071 None] Flow 'volume_create_manager' (69ac14b0-ef50-4b58-b72e-8b137d8ff7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fdbdea62-03e3-4180-a3b6-2aae796114ba tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e1158a7-7f30-474e-b3b7-8d5e8cc8b373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fdbdea62-03e3-4180-a3b6-2aae796114ba tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e1158a7-7f30-474e-b3b7-8d5e8cc8b373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-631690779',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6211de1-b2ec-4989-bf58-ae4bb9868c4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3489907c8f56409980f0fdf5b33fc278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:16Z,use_quota=True,user_id='295d067b9d0c47ab897f3a9588f339fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fdbdea62-03e3-4180-a3b6-2aae796114ba tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (185eb5cf-6fac-475e-9532-9f8ab1e7ece1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fdbdea62-03e3-4180-a3b6-2aae796114ba tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (185eb5cf-6fac-475e-9532-9f8ab1e7ece1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fdbdea62-03e3-4180-a3b6-2aae796114ba tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a3f75d-735c-4a0f-9085-b13399dddc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fdbdea62-03e3-4180-a3b6-2aae796114ba tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a3f75d-735c-4a0f-9085-b13399dddc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6211de1-b2ec-4989-bf58-ae4bb9868c4f', 'volume_name': 'volume-b6211de1-b2ec-4989-bf58-ae4bb9868c4f', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fdbdea62-03e3-4180-a3b6-2aae796114ba tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7aaf3b4-7d4d-4f80-a822-1a71b5515d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fdbdea62-03e3-4180-a3b6-2aae796114ba tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7aaf3b4-7d4d-4f80-a822-1a71b5515d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fdbdea62-03e3-4180-a3b6-2aae796114ba tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a794320a-499a-4fde-ba8c-1221ce736864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:15 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-fdbdea62-03e3-4180-a3b6-2aae796114ba tempest-CreateVolumesFromImageTest-1912033071 None] Volume b6211de1-b2ec-4989-bf58-ae4bb9868c4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6211de1-b2ec-4989-bf58-ae4bb9868c4f', 'volume_size': 1}
Nov 06 17:22:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-fdbdea62-03e3-4180-a3b6-2aae796114ba tempest-CreateVolumesFromImageTest-1912033071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-fdbdea62-03e3-4180-a3b6-2aae796114ba tempest-CreateVolumesFromImageTest-1912033071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:15 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-fdbdea62-03e3-4180-a3b6-2aae796114ba tempest-CreateVolumesFromImageTest-1912033071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-631690779',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6211de1-b2ec-4989-bf58-ae4bb9868c4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3489907c8f56409980f0fdf5b33fc278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:16Z,use_quota=True,user_id='295d067b9d0c47ab897f3a9588f339fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:22:15 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-fdbdea62-03e3-4180-a3b6-2aae796114ba tempest-CreateVolumesFromImageTest-1912033071 None] Creating volume b6211de1-b2ec-4989-bf58-ae4bb9868c4f {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:22:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-fdbdea62-03e3-4180-a3b6-2aae796114ba tempest-CreateVolumesFromImageTest-1912033071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-fdbdea62-03e3-4180-a3b6-2aae796114ba tempest-CreateVolumesFromImageTest-1912033071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:15 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-fdbdea62-03e3-4180-a3b6-2aae796114ba tempest-CreateVolumesFromImageTest-1912033071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:15 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-fdbdea62-03e3-4180-a3b6-2aae796114ba tempest-CreateVolumesFromImageTest-1912033071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-fdbdea62-03e3-4180-a3b6-2aae796114ba tempest-CreateVolumesFromImageTest-1912033071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:15 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-fdbdea62-03e3-4180-a3b6-2aae796114ba tempest-CreateVolumesFromImageTest-1912033071 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:22:15 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-fdbdea62-03e3-4180-a3b6-2aae796114ba tempest-CreateVolumesFromImageTest-1912033071 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:22:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fdbdea62-03e3-4180-a3b6-2aae796114ba tempest-CreateVolumesFromImageTest-1912033071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b6211de1-b2ec-4989-bf58-ae4bb9868c4f 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:15 devstack sudo[104487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b6211de1-b2ec-4989-bf58-ae4bb9868c4f 1073741824
Nov 06 17:22:15 devstack sudo[104487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:15 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e8b4a29-1e6f-4d89-9488-cb0a812b11d6 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:22:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4e8b4a29-1e6f-4d89-9488-cb0a812b11d6 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Flow 'volume_create_manager' (dd9edc72-e489-4d38-a242-493893711cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4e8b4a29-1e6f-4d89-9488-cb0a812b11d6 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ba37082-b289-4492-ae74-616ac57146f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4e8b4a29-1e6f-4d89-9488-cb0a812b11d6 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ba37082-b289-4492-ae74-616ac57146f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-957692645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a1c607-dccb-4e84-b3b0-b1c6cd8f0238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db74ff59d184f3a88e5aa9c8714ea78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:16Z,use_quota=True,user_id='beba513901474f2fbc012ec76f6e0034',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4e8b4a29-1e6f-4d89-9488-cb0a812b11d6 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afbeccab-a562-41a9-8103-048094a6a8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4e8b4a29-1e6f-4d89-9488-cb0a812b11d6 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afbeccab-a562-41a9-8103-048094a6a8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4e8b4a29-1e6f-4d89-9488-cb0a812b11d6 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8bcc485-0dc7-4df1-a5a9-56e3d2a09086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4e8b4a29-1e6f-4d89-9488-cb0a812b11d6 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8bcc485-0dc7-4df1-a5a9-56e3d2a09086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05a1c607-dccb-4e84-b3b0-b1c6cd8f0238', 'volume_name': 'volume-05a1c607-dccb-4e84-b3b0-b1c6cd8f0238', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4e8b4a29-1e6f-4d89-9488-cb0a812b11d6 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9abcde91-e1e9-409e-a385-20f9c1a9d383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4e8b4a29-1e6f-4d89-9488-cb0a812b11d6 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9abcde91-e1e9-409e-a385-20f9c1a9d383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4e8b4a29-1e6f-4d89-9488-cb0a812b11d6 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16941aba-3997-4235-93d9-acd6c37d6347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:16 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-4e8b4a29-1e6f-4d89-9488-cb0a812b11d6 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Volume 05a1c607-dccb-4e84-b3b0-b1c6cd8f0238: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05a1c607-dccb-4e84-b3b0-b1c6cd8f0238', 'volume_size': 1}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4e8b4a29-1e6f-4d89-9488-cb0a812b11d6 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-427f932e-9230-41a7-ab90-49adb8c8d9bd tempest-CreateVolumesFromImageTest-1912033071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-427f932e-9230-41a7-ab90-49adb8c8d9bd tempest-CreateVolumesFromImageTest-1912033071 None] Flow 'volume_create_manager' (fe634a53-24bf-425f-8427-9a513c89593c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-427f932e-9230-41a7-ab90-49adb8c8d9bd tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2655879f-827a-491b-818e-f2a64842d1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-427f932e-9230-41a7-ab90-49adb8c8d9bd tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2655879f-827a-491b-818e-f2a64842d1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1837154653',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fb80b86-ef5d-4a5e-97d3-0c60f9489090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3489907c8f56409980f0fdf5b33fc278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:16Z,use_quota=True,user_id='295d067b9d0c47ab897f3a9588f339fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-427f932e-9230-41a7-ab90-49adb8c8d9bd tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66595589-1d23-486e-9533-b50cf25edf9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-427f932e-9230-41a7-ab90-49adb8c8d9bd tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66595589-1d23-486e-9533-b50cf25edf9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-427f932e-9230-41a7-ab90-49adb8c8d9bd tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ec31d7-4cd4-4ad5-90aa-23755b43c707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-427f932e-9230-41a7-ab90-49adb8c8d9bd tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ec31d7-4cd4-4ad5-90aa-23755b43c707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fb80b86-ef5d-4a5e-97d3-0c60f9489090', 'volume_name': 'volume-0fb80b86-ef5d-4a5e-97d3-0c60f9489090', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-427f932e-9230-41a7-ab90-49adb8c8d9bd tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73917701-8acf-45fe-9748-066b39a05b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-427f932e-9230-41a7-ab90-49adb8c8d9bd tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73917701-8acf-45fe-9748-066b39a05b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-427f932e-9230-41a7-ab90-49adb8c8d9bd tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b49b8b86-08d9-4ea2-bb39-8452e71db081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:16 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-427f932e-9230-41a7-ab90-49adb8c8d9bd tempest-CreateVolumesFromImageTest-1912033071 None] Volume 0fb80b86-ef5d-4a5e-97d3-0c60f9489090: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fb80b86-ef5d-4a5e-97d3-0c60f9489090', 'volume_size': 1}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-427f932e-9230-41a7-ab90-49adb8c8d9bd tempest-CreateVolumesFromImageTest-1912033071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-61477123-eece-4455-a6f6-790c9687990c tempest-CreateVolumesFromSnapshotTest-1490455522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:22:16 devstack sudo[104487]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-61477123-eece-4455-a6f6-790c9687990c tempest-CreateVolumesFromSnapshotTest-1490455522 None] Flow 'volume_create_manager' (72999867-30b1-45de-9fc2-31d72762a1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-61477123-eece-4455-a6f6-790c9687990c tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40f1bda9-0d9d-45ea-a4da-cd0d86aa8418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fdbdea62-03e3-4180-a3b6-2aae796114ba tempest-CreateVolumesFromImageTest-1912033071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b6211de1-b2ec-4989-bf58-ae4bb9868c4f 1073741824" returned: 0 in 0.715s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-61477123-eece-4455-a6f6-790c9687990c tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40f1bda9-0d9d-45ea-a4da-cd0d86aa8418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-520175881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6394a35-58a2-4020-9e81-e90144bdc174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b370004be334cc79fcdf16a23d99fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:16Z,use_quota=True,user_id='f1820ef89e6a4e2e923396a6b57e59d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-61477123-eece-4455-a6f6-790c9687990c tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc27e78a-0258-4357-b8dd-5579c8b951cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-61477123-eece-4455-a6f6-790c9687990c tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc27e78a-0258-4357-b8dd-5579c8b951cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-61477123-eece-4455-a6f6-790c9687990c tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faf4f5cc-e7cc-4bf5-90d6-345f27164b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-61477123-eece-4455-a6f6-790c9687990c tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faf4f5cc-e7cc-4bf5-90d6-345f27164b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6394a35-58a2-4020-9e81-e90144bdc174', 'volume_name': 'volume-a6394a35-58a2-4020-9e81-e90144bdc174', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-61477123-eece-4455-a6f6-790c9687990c tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88e362eb-8f5c-47e4-818b-137f0db3a9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-61477123-eece-4455-a6f6-790c9687990c tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88e362eb-8f5c-47e4-818b-137f0db3a9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-61477123-eece-4455-a6f6-790c9687990c tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fcfc132-7359-4a84-b040-a52b9a57ab01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:16 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-61477123-eece-4455-a6f6-790c9687990c tempest-CreateVolumesFromSnapshotTest-1490455522 None] Volume a6394a35-58a2-4020-9e81-e90144bdc174: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6394a35-58a2-4020-9e81-e90144bdc174', 'volume_size': 1}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-61477123-eece-4455-a6f6-790c9687990c tempest-CreateVolumesFromSnapshotTest-1490455522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ae0a039-7987-4e7d-a74b-1f5de04824e8 tempest-CreateVolumesFromImageTest-1912033071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9ae0a039-7987-4e7d-a74b-1f5de04824e8 tempest-CreateVolumesFromImageTest-1912033071 None] Flow 'volume_create_manager' (d381bb4f-f171-4389-ab5c-ac6e2430ee6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9ae0a039-7987-4e7d-a74b-1f5de04824e8 tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20c2b18f-852e-47b6-a2c1-d1dd368b66ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fdbdea62-03e3-4180-a3b6-2aae796114ba tempest-CreateVolumesFromImageTest-1912033071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b6211de1-b2ec-4989-bf58-ae4bb9868c4f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9ae0a039-7987-4e7d-a74b-1f5de04824e8 tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20c2b18f-852e-47b6-a2c1-d1dd368b66ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-486723789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beca139f-86f2-4942-8b5e-656b6cdb5d93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3489907c8f56409980f0fdf5b33fc278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:17Z,use_quota=True,user_id='295d067b9d0c47ab897f3a9588f339fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9ae0a039-7987-4e7d-a74b-1f5de04824e8 tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aefb6de6-ddb8-46db-97d6-93f81f32b4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:16 devstack sudo[104494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b6211de1-b2ec-4989-bf58-ae4bb9868c4f
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9ae0a039-7987-4e7d-a74b-1f5de04824e8 tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aefb6de6-ddb8-46db-97d6-93f81f32b4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:16 devstack sudo[104494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9ae0a039-7987-4e7d-a74b-1f5de04824e8 tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695e5766-3ea8-430d-9b64-c7bdb2b1baf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9ae0a039-7987-4e7d-a74b-1f5de04824e8 tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695e5766-3ea8-430d-9b64-c7bdb2b1baf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beca139f-86f2-4942-8b5e-656b6cdb5d93', 'volume_name': 'volume-beca139f-86f2-4942-8b5e-656b6cdb5d93', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9ae0a039-7987-4e7d-a74b-1f5de04824e8 tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26347200-9316-401c-86d1-0b113e026a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9ae0a039-7987-4e7d-a74b-1f5de04824e8 tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26347200-9316-401c-86d1-0b113e026a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9ae0a039-7987-4e7d-a74b-1f5de04824e8 tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0c752ca-9061-4618-926f-110ac7d99cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:16 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-9ae0a039-7987-4e7d-a74b-1f5de04824e8 tempest-CreateVolumesFromImageTest-1912033071 None] Volume beca139f-86f2-4942-8b5e-656b6cdb5d93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beca139f-86f2-4942-8b5e-656b6cdb5d93', 'volume_size': 1}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9ae0a039-7987-4e7d-a74b-1f5de04824e8 tempest-CreateVolumesFromImageTest-1912033071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:16 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-66d80f8e-ac0c-4120-8da2-8a1876ff42b0 tempest-CreateVolumesFromImageTest-1912033071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-66d80f8e-ac0c-4120-8da2-8a1876ff42b0 tempest-CreateVolumesFromImageTest-1912033071 None] Flow 'volume_create_manager' (60a56ce4-81f6-4b0c-97ef-7e7f8286d354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-66d80f8e-ac0c-4120-8da2-8a1876ff42b0 tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a61f544-a9bc-40a8-bc8c-b6feb8f12386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-66d80f8e-ac0c-4120-8da2-8a1876ff42b0 tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a61f544-a9bc-40a8-bc8c-b6feb8f12386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1723056558',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=903ae728-ff5f-4c81-aad4-3453de31b3d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3489907c8f56409980f0fdf5b33fc278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:17Z,use_quota=True,user_id='295d067b9d0c47ab897f3a9588f339fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-66d80f8e-ac0c-4120-8da2-8a1876ff42b0 tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af9a7f26-2972-4cc0-b529-72523a81615e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-66d80f8e-ac0c-4120-8da2-8a1876ff42b0 tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af9a7f26-2972-4cc0-b529-72523a81615e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-66d80f8e-ac0c-4120-8da2-8a1876ff42b0 tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e87fbfc9-bff7-4855-8f70-41512ef68179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-66d80f8e-ac0c-4120-8da2-8a1876ff42b0 tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e87fbfc9-bff7-4855-8f70-41512ef68179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '903ae728-ff5f-4c81-aad4-3453de31b3d9', 'volume_name': 'volume-903ae728-ff5f-4c81-aad4-3453de31b3d9', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-66d80f8e-ac0c-4120-8da2-8a1876ff42b0 tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba3f808c-c07a-493c-8692-ef00bb3d3639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-66d80f8e-ac0c-4120-8da2-8a1876ff42b0 tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba3f808c-c07a-493c-8692-ef00bb3d3639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:17 devstack sudo[104494]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-66d80f8e-ac0c-4120-8da2-8a1876ff42b0 tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (494f89b9-2435-4a9c-ad15-2acc2c2330b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:17 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-66d80f8e-ac0c-4120-8da2-8a1876ff42b0 tempest-CreateVolumesFromImageTest-1912033071 None] Volume 903ae728-ff5f-4c81-aad4-3453de31b3d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-903ae728-ff5f-4c81-aad4-3453de31b3d9', 'volume_size': 1}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-66d80f8e-ac0c-4120-8da2-8a1876ff42b0 tempest-CreateVolumesFromImageTest-1912033071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fdbdea62-03e3-4180-a3b6-2aae796114ba tempest-CreateVolumesFromImageTest-1912033071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b6211de1-b2ec-4989-bf58-ae4bb9868c4f" returned: 0 in 0.360s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-fdbdea62-03e3-4180-a3b6-2aae796114ba tempest-CreateVolumesFromImageTest-1912033071 None] <== create_volume: return (1274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-fdbdea62-03e3-4180-a3b6-2aae796114ba tempest-CreateVolumesFromImageTest-1912033071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4e8b4a29-1e6f-4d89-9488-cb0a812b11d6 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.051s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4e8b4a29-1e6f-4d89-9488-cb0a812b11d6 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-957692645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a1c607-dccb-4e84-b3b0-b1c6cd8f0238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db74ff59d184f3a88e5aa9c8714ea78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:16Z,use_quota=True,user_id='beba513901474f2fbc012ec76f6e0034',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-4e8b4a29-1e6f-4d89-9488-cb0a812b11d6 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Creating volume 05a1c607-dccb-4e84-b3b0-b1c6cd8f0238 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4e8b4a29-1e6f-4d89-9488-cb0a812b11d6 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4e8b4a29-1e6f-4d89-9488-cb0a812b11d6 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4e8b4a29-1e6f-4d89-9488-cb0a812b11d6 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4e8b4a29-1e6f-4d89-9488-cb0a812b11d6 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4e8b4a29-1e6f-4d89-9488-cb0a812b11d6 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4e8b4a29-1e6f-4d89-9488-cb0a812b11d6 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:22:17 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-4e8b4a29-1e6f-4d89-9488-cb0a812b11d6 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4e8b4a29-1e6f-4d89-9488-cb0a812b11d6 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-05a1c607-dccb-4e84-b3b0-b1c6cd8f0238 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fdbdea62-03e3-4180-a3b6-2aae796114ba tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a794320a-499a-4fde-ba8c-1221ce736864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6211de1-b2ec-4989-bf58-ae4bb9868c4f', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fdbdea62-03e3-4180-a3b6-2aae796114ba tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (963e4376-9a8f-491c-94d4-927addb2ce03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:17 devstack sudo[104497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-05a1c607-dccb-4e84-b3b0-b1c6cd8f0238 1073741824
Nov 06 17:22:17 devstack sudo[104497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:17 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-fdbdea62-03e3-4180-a3b6-2aae796114ba tempest-CreateVolumesFromImageTest-1912033071 None] Volume volume-b6211de1-b2ec-4989-bf58-ae4bb9868c4f (b6211de1-b2ec-4989-bf58-ae4bb9868c4f): created successfully
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fdbdea62-03e3-4180-a3b6-2aae796114ba tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (963e4376-9a8f-491c-94d4-927addb2ce03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fdbdea62-03e3-4180-a3b6-2aae796114ba tempest-CreateVolumesFromImageTest-1912033071 None] Flow 'volume_create_manager' (69ac14b0-ef50-4b58-b72e-8b137d8ff7f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:17 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-fdbdea62-03e3-4180-a3b6-2aae796114ba tempest-CreateVolumesFromImageTest-1912033071 None] Created volume successfully.
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d8a80c2-87c6-4650-b09b-8291845ccc95 tempest-CreateVolumesFromImageTest-1912033071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1d8a80c2-87c6-4650-b09b-8291845ccc95 tempest-CreateVolumesFromImageTest-1912033071 None] Flow 'volume_create_manager' (a5dac745-34b1-4ced-ac63-aa0b17b6b5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1d8a80c2-87c6-4650-b09b-8291845ccc95 tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e895c11b-cf80-4903-9afb-edec4d42dc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1d8a80c2-87c6-4650-b09b-8291845ccc95 tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e895c11b-cf80-4903-9afb-edec4d42dc48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2076190428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b85e133d-7c40-4e58-adee-b25bffcd8b59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3489907c8f56409980f0fdf5b33fc278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:17Z,use_quota=True,user_id='295d067b9d0c47ab897f3a9588f339fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1d8a80c2-87c6-4650-b09b-8291845ccc95 tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd56258-a19b-4144-8f97-2d98a8f17c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1d8a80c2-87c6-4650-b09b-8291845ccc95 tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd56258-a19b-4144-8f97-2d98a8f17c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1d8a80c2-87c6-4650-b09b-8291845ccc95 tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13c2091-3992-4b86-9ee6-cf886bb55f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1d8a80c2-87c6-4650-b09b-8291845ccc95 tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13c2091-3992-4b86-9ee6-cf886bb55f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b85e133d-7c40-4e58-adee-b25bffcd8b59', 'volume_name': 'volume-b85e133d-7c40-4e58-adee-b25bffcd8b59', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1d8a80c2-87c6-4650-b09b-8291845ccc95 tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c73b9ea-8b14-4122-959d-322e5ab95179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1d8a80c2-87c6-4650-b09b-8291845ccc95 tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c73b9ea-8b14-4122-959d-322e5ab95179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1d8a80c2-87c6-4650-b09b-8291845ccc95 tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c2cf7e6-c313-4565-a44c-4122fb7d7b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:17 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-1d8a80c2-87c6-4650-b09b-8291845ccc95 tempest-CreateVolumesFromImageTest-1912033071 None] Volume b85e133d-7c40-4e58-adee-b25bffcd8b59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b85e133d-7c40-4e58-adee-b25bffcd8b59', 'volume_size': 1}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1d8a80c2-87c6-4650-b09b-8291845ccc95 tempest-CreateVolumesFromImageTest-1912033071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:17 devstack sudo[104497]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4e8b4a29-1e6f-4d89-9488-cb0a812b11d6 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-05a1c607-dccb-4e84-b3b0-b1c6cd8f0238 1073741824" returned: 0 in 0.545s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4e8b4a29-1e6f-4d89-9488-cb0a812b11d6 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-05a1c607-dccb-4e84-b3b0-b1c6cd8f0238 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:17 devstack sudo[104503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-05a1c607-dccb-4e84-b3b0-b1c6cd8f0238
Nov 06 17:22:17 devstack sudo[104503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:17 devstack sudo[104503]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4e8b4a29-1e6f-4d89-9488-cb0a812b11d6 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-05a1c607-dccb-4e84-b3b0-b1c6cd8f0238" returned: 0 in 0.259s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4e8b4a29-1e6f-4d89-9488-cb0a812b11d6 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4e8b4a29-1e6f-4d89-9488-cb0a812b11d6 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-427f932e-9230-41a7-ab90-49adb8c8d9bd tempest-CreateVolumesFromImageTest-1912033071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.802s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-427f932e-9230-41a7-ab90-49adb8c8d9bd tempest-CreateVolumesFromImageTest-1912033071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1837154653',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fb80b86-ef5d-4a5e-97d3-0c60f9489090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3489907c8f56409980f0fdf5b33fc278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:16Z,use_quota=True,user_id='295d067b9d0c47ab897f3a9588f339fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-427f932e-9230-41a7-ab90-49adb8c8d9bd tempest-CreateVolumesFromImageTest-1912033071 None] Creating volume 0fb80b86-ef5d-4a5e-97d3-0c60f9489090 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-427f932e-9230-41a7-ab90-49adb8c8d9bd tempest-CreateVolumesFromImageTest-1912033071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-427f932e-9230-41a7-ab90-49adb8c8d9bd tempest-CreateVolumesFromImageTest-1912033071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-427f932e-9230-41a7-ab90-49adb8c8d9bd tempest-CreateVolumesFromImageTest-1912033071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-427f932e-9230-41a7-ab90-49adb8c8d9bd tempest-CreateVolumesFromImageTest-1912033071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-427f932e-9230-41a7-ab90-49adb8c8d9bd tempest-CreateVolumesFromImageTest-1912033071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-427f932e-9230-41a7-ab90-49adb8c8d9bd tempest-CreateVolumesFromImageTest-1912033071 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:22:17 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-427f932e-9230-41a7-ab90-49adb8c8d9bd tempest-CreateVolumesFromImageTest-1912033071 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:22:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-427f932e-9230-41a7-ab90-49adb8c8d9bd tempest-CreateVolumesFromImageTest-1912033071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0fb80b86-ef5d-4a5e-97d3-0c60f9489090 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:18 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4e8b4a29-1e6f-4d89-9488-cb0a812b11d6 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16941aba-3997-4235-93d9-acd6c37d6347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05a1c607-dccb-4e84-b3b0-b1c6cd8f0238', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:18 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4e8b4a29-1e6f-4d89-9488-cb0a812b11d6 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1662a595-d841-4ed3-a0cb-40459f08d5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:18 devstack sudo[104506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0fb80b86-ef5d-4a5e-97d3-0c60f9489090 1073741824
Nov 06 17:22:18 devstack sudo[104506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:18 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-4e8b4a29-1e6f-4d89-9488-cb0a812b11d6 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Volume volume-05a1c607-dccb-4e84-b3b0-b1c6cd8f0238 (05a1c607-dccb-4e84-b3b0-b1c6cd8f0238): created successfully
Nov 06 17:22:18 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4e8b4a29-1e6f-4d89-9488-cb0a812b11d6 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1662a595-d841-4ed3-a0cb-40459f08d5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:18 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4e8b4a29-1e6f-4d89-9488-cb0a812b11d6 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Flow 'volume_create_manager' (dd9edc72-e489-4d38-a242-493893711cf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:18 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-4e8b4a29-1e6f-4d89-9488-cb0a812b11d6 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Created volume successfully.
Nov 06 17:22:18 devstack sudo[104506]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-427f932e-9230-41a7-ab90-49adb8c8d9bd tempest-CreateVolumesFromImageTest-1912033071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0fb80b86-ef5d-4a5e-97d3-0c60f9489090 1073741824" returned: 0 in 0.506s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-427f932e-9230-41a7-ab90-49adb8c8d9bd tempest-CreateVolumesFromImageTest-1912033071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0fb80b86-ef5d-4a5e-97d3-0c60f9489090 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:18 devstack sudo[104512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0fb80b86-ef5d-4a5e-97d3-0c60f9489090
Nov 06 17:22:18 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:18 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-427f932e-9230-41a7-ab90-49adb8c8d9bd tempest-CreateVolumesFromImageTest-1912033071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0fb80b86-ef5d-4a5e-97d3-0c60f9489090" returned: 0 in 0.241s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:18 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-427f932e-9230-41a7-ab90-49adb8c8d9bd tempest-CreateVolumesFromImageTest-1912033071 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:22:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-427f932e-9230-41a7-ab90-49adb8c8d9bd tempest-CreateVolumesFromImageTest-1912033071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-61477123-eece-4455-a6f6-790c9687990c tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.093s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:18 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-61477123-eece-4455-a6f6-790c9687990c tempest-CreateVolumesFromSnapshotTest-1490455522 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-520175881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6394a35-58a2-4020-9e81-e90144bdc174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b370004be334cc79fcdf16a23d99fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:16Z,use_quota=True,user_id='f1820ef89e6a4e2e923396a6b57e59d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:22:18 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-61477123-eece-4455-a6f6-790c9687990c tempest-CreateVolumesFromSnapshotTest-1490455522 None] Creating volume a6394a35-58a2-4020-9e81-e90144bdc174 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:22:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-61477123-eece-4455-a6f6-790c9687990c tempest-CreateVolumesFromSnapshotTest-1490455522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-61477123-eece-4455-a6f6-790c9687990c tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:18 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-61477123-eece-4455-a6f6-790c9687990c tempest-CreateVolumesFromSnapshotTest-1490455522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:18 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-61477123-eece-4455-a6f6-790c9687990c tempest-CreateVolumesFromSnapshotTest-1490455522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-61477123-eece-4455-a6f6-790c9687990c tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:18 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-61477123-eece-4455-a6f6-790c9687990c tempest-CreateVolumesFromSnapshotTest-1490455522 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:22:18 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-61477123-eece-4455-a6f6-790c9687990c tempest-CreateVolumesFromSnapshotTest-1490455522 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:22:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-61477123-eece-4455-a6f6-790c9687990c tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:18 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-427f932e-9230-41a7-ab90-49adb8c8d9bd tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b49b8b86-08d9-4ea2-bb39-8452e71db081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fb80b86-ef5d-4a5e-97d3-0c60f9489090', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:18 devstack sudo[104515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174 1073741824
Nov 06 17:22:18 devstack sudo[104515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:18 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-427f932e-9230-41a7-ab90-49adb8c8d9bd tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48913417-b0d6-4a8d-8d5d-9acca47c69a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:18 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-427f932e-9230-41a7-ab90-49adb8c8d9bd tempest-CreateVolumesFromImageTest-1912033071 None] Volume volume-0fb80b86-ef5d-4a5e-97d3-0c60f9489090 (0fb80b86-ef5d-4a5e-97d3-0c60f9489090): created successfully
Nov 06 17:22:18 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-427f932e-9230-41a7-ab90-49adb8c8d9bd tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48913417-b0d6-4a8d-8d5d-9acca47c69a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:18 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-427f932e-9230-41a7-ab90-49adb8c8d9bd tempest-CreateVolumesFromImageTest-1912033071 None] Flow 'volume_create_manager' (fe634a53-24bf-425f-8427-9a513c89593c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:18 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-427f932e-9230-41a7-ab90-49adb8c8d9bd tempest-CreateVolumesFromImageTest-1912033071 None] Created volume successfully.
Nov 06 17:22:19 devstack sudo[104515]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-61477123-eece-4455-a6f6-790c9687990c tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174 1073741824" returned: 0 in 0.510s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-61477123-eece-4455-a6f6-790c9687990c tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:19 devstack sudo[104521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174
Nov 06 17:22:19 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:19 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-a665e457-3454-4ae6-9722-db4c9d3ba0ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:22:19 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a665e457-3454-4ae6-9722-db4c9d3ba0ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Flow 'volume_create_manager' (961e6c57-858d-4284-ad6f-1f9042104315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:19 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:19 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a665e457-3454-4ae6-9722-db4c9d3ba0ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (142cb594-ee75-4a57-ae88-0b70c0690a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-61477123-eece-4455-a6f6-790c9687990c tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174" returned: 0 in 0.374s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:19 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-61477123-eece-4455-a6f6-790c9687990c tempest-CreateVolumesFromSnapshotTest-1490455522 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:22:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-61477123-eece-4455-a6f6-790c9687990c tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9ae0a039-7987-4e7d-a74b-1f5de04824e8 tempest-CreateVolumesFromImageTest-1912033071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.888s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:19 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-9ae0a039-7987-4e7d-a74b-1f5de04824e8 tempest-CreateVolumesFromImageTest-1912033071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-486723789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beca139f-86f2-4942-8b5e-656b6cdb5d93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3489907c8f56409980f0fdf5b33fc278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:17Z,use_quota=True,user_id='295d067b9d0c47ab897f3a9588f339fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:22:19 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-9ae0a039-7987-4e7d-a74b-1f5de04824e8 tempest-CreateVolumesFromImageTest-1912033071 None] Creating volume beca139f-86f2-4942-8b5e-656b6cdb5d93 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:22:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9ae0a039-7987-4e7d-a74b-1f5de04824e8 tempest-CreateVolumesFromImageTest-1912033071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9ae0a039-7987-4e7d-a74b-1f5de04824e8 tempest-CreateVolumesFromImageTest-1912033071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:19 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-9ae0a039-7987-4e7d-a74b-1f5de04824e8 tempest-CreateVolumesFromImageTest-1912033071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:19 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-9ae0a039-7987-4e7d-a74b-1f5de04824e8 tempest-CreateVolumesFromImageTest-1912033071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9ae0a039-7987-4e7d-a74b-1f5de04824e8 tempest-CreateVolumesFromImageTest-1912033071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:19 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-9ae0a039-7987-4e7d-a74b-1f5de04824e8 tempest-CreateVolumesFromImageTest-1912033071 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:22:19 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-9ae0a039-7987-4e7d-a74b-1f5de04824e8 tempest-CreateVolumesFromImageTest-1912033071 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:22:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9ae0a039-7987-4e7d-a74b-1f5de04824e8 tempest-CreateVolumesFromImageTest-1912033071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-beca139f-86f2-4942-8b5e-656b6cdb5d93 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:19 devstack sudo[104524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-beca139f-86f2-4942-8b5e-656b6cdb5d93 1073741824
Nov 06 17:22:19 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:19 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a665e457-3454-4ae6-9722-db4c9d3ba0ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (142cb594-ee75-4a57-ae88-0b70c0690a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1668406515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b851a049-d6ad-45d1-9633-566e1e4af273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db74ff59d184f3a88e5aa9c8714ea78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:20Z,use_quota=True,user_id='beba513901474f2fbc012ec76f6e0034',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:19 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a665e457-3454-4ae6-9722-db4c9d3ba0ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0f50402-1ece-4747-a774-8e9fe7cf0c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:19 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a665e457-3454-4ae6-9722-db4c9d3ba0ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0f50402-1ece-4747-a774-8e9fe7cf0c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:19 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a665e457-3454-4ae6-9722-db4c9d3ba0ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc2463e-adcb-469b-83f8-3dc960af3758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:19 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a665e457-3454-4ae6-9722-db4c9d3ba0ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc2463e-adcb-469b-83f8-3dc960af3758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b851a049-d6ad-45d1-9633-566e1e4af273', 'volume_name': 'volume-b851a049-d6ad-45d1-9633-566e1e4af273', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:19 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a665e457-3454-4ae6-9722-db4c9d3ba0ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2597694-ad40-463f-8783-7f59aaef734c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:19 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a665e457-3454-4ae6-9722-db4c9d3ba0ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2597694-ad40-463f-8783-7f59aaef734c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:19 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a665e457-3454-4ae6-9722-db4c9d3ba0ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a3366f5-430c-4953-a97a-8d81650f2894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:19 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-a665e457-3454-4ae6-9722-db4c9d3ba0ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Volume b851a049-d6ad-45d1-9633-566e1e4af273: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b851a049-d6ad-45d1-9633-566e1e4af273', 'volume_size': 1}
Nov 06 17:22:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a665e457-3454-4ae6-9722-db4c9d3ba0ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:19 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-61477123-eece-4455-a6f6-790c9687990c tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fcfc132-7359-4a84-b040-a52b9a57ab01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6394a35-58a2-4020-9e81-e90144bdc174', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:19 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-61477123-eece-4455-a6f6-790c9687990c tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (972e6468-de77-4f43-9f87-fdf56eb2bbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:19 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-61477123-eece-4455-a6f6-790c9687990c tempest-CreateVolumesFromSnapshotTest-1490455522 None] Volume volume-a6394a35-58a2-4020-9e81-e90144bdc174 (a6394a35-58a2-4020-9e81-e90144bdc174): created successfully
Nov 06 17:22:19 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-61477123-eece-4455-a6f6-790c9687990c tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (972e6468-de77-4f43-9f87-fdf56eb2bbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:19 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-61477123-eece-4455-a6f6-790c9687990c tempest-CreateVolumesFromSnapshotTest-1490455522 None] Flow 'volume_create_manager' (72999867-30b1-45de-9fc2-31d72762a1b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:19 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-61477123-eece-4455-a6f6-790c9687990c tempest-CreateVolumesFromSnapshotTest-1490455522 None] Created volume successfully.
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Flow 'volume_create_manager' (bca27152-d672-4227-8403-4df8481dd7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec303769-46d0-494b-b31d-588677af35d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec303769-46d0-494b-b31d-588677af35d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9466ace0-4bae-46cc-861f-85f7f215b03c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57cb1b1847a64db8a86923811113fffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:20Z,use_quota=True,user_id='a742c71f228042acb9f454060b261cbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(100939b4-59aa-4d31-99d8-cf194b77a8ef),volume_type_id=100939b4-59aa-4d31-99d8-cf194b77a8ef)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:20 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cea8276-4ae1-44d7-a06f-615af71d1ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cea8276-4ae1-44d7-a06f-615af71d1ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (412c14b7-1e0c-44f3-ab59-3715c9ee58fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.image.glance [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Creating Keystone auth plugin from conf {{(pid=86856) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-b150df8c-7840-4956-8dfd-8aa0f9704fef tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b150df8c-7840-4956-8dfd-8aa0f9704fef tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Flow 'volume_create_manager' (efffc698-d80c-4289-911f-6ca215b0d5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b150df8c-7840-4956-8dfd-8aa0f9704fef tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (077bf111-2ce6-421e-9a50-50ac7ab2a41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9ae0a039-7987-4e7d-a74b-1f5de04824e8 tempest-CreateVolumesFromImageTest-1912033071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-beca139f-86f2-4942-8b5e-656b6cdb5d93 1073741824" returned: 0 in 0.636s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b150df8c-7840-4956-8dfd-8aa0f9704fef tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (077bf111-2ce6-421e-9a50-50ac7ab2a41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1304177836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86e5c615-4b00-49ee-a13f-bdbd9793d414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db74ff59d184f3a88e5aa9c8714ea78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:20Z,use_quota=True,user_id='beba513901474f2fbc012ec76f6e0034',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b150df8c-7840-4956-8dfd-8aa0f9704fef tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5da7620-a037-464b-be09-7b3a11a245ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b150df8c-7840-4956-8dfd-8aa0f9704fef tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5da7620-a037-464b-be09-7b3a11a245ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b150df8c-7840-4956-8dfd-8aa0f9704fef tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85f860b3-d5d5-485f-a0f8-f7e1bf9041fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b150df8c-7840-4956-8dfd-8aa0f9704fef tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85f860b3-d5d5-485f-a0f8-f7e1bf9041fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86e5c615-4b00-49ee-a13f-bdbd9793d414', 'volume_name': 'volume-86e5c615-4b00-49ee-a13f-bdbd9793d414', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b150df8c-7840-4956-8dfd-8aa0f9704fef tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea96b36e-c58e-4098-9ef1-69f8c08f3e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b150df8c-7840-4956-8dfd-8aa0f9704fef tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea96b36e-c58e-4098-9ef1-69f8c08f3e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b150df8c-7840-4956-8dfd-8aa0f9704fef tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56fb7ab8-c577-4151-a8e6-5ee4589ffe67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:20 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-b150df8c-7840-4956-8dfd-8aa0f9704fef tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Volume 86e5c615-4b00-49ee-a13f-bdbd9793d414: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86e5c615-4b00-49ee-a13f-bdbd9793d414', 'volume_size': 1}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b150df8c-7840-4956-8dfd-8aa0f9704fef tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9ae0a039-7987-4e7d-a74b-1f5de04824e8 tempest-CreateVolumesFromImageTest-1912033071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-beca139f-86f2-4942-8b5e-656b6cdb5d93 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bea6b9d-171e-46de-9308-bbc123930e23 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:22:20 devstack sudo[104531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-beca139f-86f2-4942-8b5e-656b6cdb5d93
Nov 06 17:22:20 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1bea6b9d-171e-46de-9308-bbc123930e23 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Flow 'volume_create_manager' (e7056f14-7ee2-46a6-bb89-11a42c565e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1bea6b9d-171e-46de-9308-bbc123930e23 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70e72344-5011-4138-83b7-74ce5c9e7a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1bea6b9d-171e-46de-9308-bbc123930e23 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70e72344-5011-4138-83b7-74ce5c9e7a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-525982894',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7d7d638-c0f8-4e73-9cb4-9976d827d113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db74ff59d184f3a88e5aa9c8714ea78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:20Z,use_quota=True,user_id='beba513901474f2fbc012ec76f6e0034',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1bea6b9d-171e-46de-9308-bbc123930e23 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb8e808-0dd2-459d-a48f-a85812f1d0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1bea6b9d-171e-46de-9308-bbc123930e23 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb8e808-0dd2-459d-a48f-a85812f1d0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1bea6b9d-171e-46de-9308-bbc123930e23 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c7d5185-6a21-4f2c-a822-8cd2d434f040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1bea6b9d-171e-46de-9308-bbc123930e23 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c7d5185-6a21-4f2c-a822-8cd2d434f040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7d7d638-c0f8-4e73-9cb4-9976d827d113', 'volume_name': 'volume-e7d7d638-c0f8-4e73-9cb4-9976d827d113', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1bea6b9d-171e-46de-9308-bbc123930e23 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d4c4f13-fef3-4b30-8c80-45b5137ef858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1bea6b9d-171e-46de-9308-bbc123930e23 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d4c4f13-fef3-4b30-8c80-45b5137ef858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1bea6b9d-171e-46de-9308-bbc123930e23 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76977a2a-a4a1-474f-a575-5dd05180b427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:20 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-1bea6b9d-171e-46de-9308-bbc123930e23 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Volume e7d7d638-c0f8-4e73-9cb4-9976d827d113: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7d7d638-c0f8-4e73-9cb4-9976d827d113', 'volume_size': 1}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1bea6b9d-171e-46de-9308-bbc123930e23 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (412c14b7-1e0c-44f3-ab59-3715c9ee58fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9466ace0-4bae-46cc-861f-85f7f215b03c', 'volume_name': 'volume-9466ace0-4bae-46cc-861f-85f7f215b03c', 'volume_size': 1, 'image_id': 'aa95ee61-4aee-4c1a-a148-4f2195a25ba6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa95ee61-4aee-4c1a-a148-4f2195a25ba6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '23fb3cce86f2768348eb1b0c9685b104', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '57cb1b1847a64db8a86923811113fffc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4ce634667a3faae6e3dfd07ff73493841d6899be9c62d51420ca738daa7286f19bb1e5eda661af04e4bfb360b7c2bad1714ce2f583c2ca13809a2798f29fd385', 'id': 'aa95ee61-4aee-4c1a-a148-4f2195a25ba6', 'created_at': datetime.datetime(2026, 11, 6, 16, 22, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 16, 22, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa95ee61-4aee-4c1a-a148-4f2195a25ba6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x71da66ddfaa0>}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6479687-b3e8-4754-b423-51ffed18afdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6479687-b3e8-4754-b423-51ffed18afdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adff9033-85f0-464b-8aee-a2e53493bf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:20 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Volume 9466ace0-4bae-46cc-861f-85f7f215b03c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9466ace0-4bae-46cc-861f-85f7f215b03c', 'volume_size': 1, 'image_id': 'aa95ee61-4aee-4c1a-a148-4f2195a25ba6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa95ee61-4aee-4c1a-a148-4f2195a25ba6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '23fb3cce86f2768348eb1b0c9685b104', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '57cb1b1847a64db8a86923811113fffc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4ce634667a3faae6e3dfd07ff73493841d6899be9c62d51420ca738daa7286f19bb1e5eda661af04e4bfb360b7c2bad1714ce2f583c2ca13809a2798f29fd385', 'id': 'aa95ee61-4aee-4c1a-a148-4f2195a25ba6', 'created_at': datetime.datetime(2026, 11, 6, 16, 22, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 16, 22, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa95ee61-4aee-4c1a-a148-4f2195a25ba6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x71da66ddfaa0>}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Trying to clone 9466ace0-4bae-46cc-861f-85f7f215b03c from image aa95ee61-4aee-4c1a-a148-4f2195a25ba6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/aa95ee61-4aee-4c1a-a148-4f2195a25ba6', 'metadata': {}}]). {{(pid=86856) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 06 17:22:20 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9ae0a039-7987-4e7d-a74b-1f5de04824e8 tempest-CreateVolumesFromImageTest-1912033071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-beca139f-86f2-4942-8b5e-656b6cdb5d93" returned: 0 in 0.448s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-9ae0a039-7987-4e7d-a74b-1f5de04824e8 tempest-CreateVolumesFromImageTest-1912033071 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9ae0a039-7987-4e7d-a74b-1f5de04824e8 tempest-CreateVolumesFromImageTest-1912033071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_aa95ee61-4aee-4c1a-a148-4f2195a25ba6_vzxv8nl7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86856) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 06 17:22:20 devstack cinder-volume[86856]: INFO cinder.image.image_utils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Image download 0.00 MB at 0.00 MB/s
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-66d80f8e-ac0c-4120-8da2-8a1876ff42b0 tempest-CreateVolumesFromImageTest-1912033071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.823s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-66d80f8e-ac0c-4120-8da2-8a1876ff42b0 tempest-CreateVolumesFromImageTest-1912033071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1723056558',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=903ae728-ff5f-4c81-aad4-3453de31b3d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3489907c8f56409980f0fdf5b33fc278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:17Z,use_quota=True,user_id='295d067b9d0c47ab897f3a9588f339fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-66d80f8e-ac0c-4120-8da2-8a1876ff42b0 tempest-CreateVolumesFromImageTest-1912033071 None] Creating volume 903ae728-ff5f-4c81-aad4-3453de31b3d9 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-66d80f8e-ac0c-4120-8da2-8a1876ff42b0 tempest-CreateVolumesFromImageTest-1912033071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-66d80f8e-ac0c-4120-8da2-8a1876ff42b0 tempest-CreateVolumesFromImageTest-1912033071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-66d80f8e-ac0c-4120-8da2-8a1876ff42b0 tempest-CreateVolumesFromImageTest-1912033071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-66d80f8e-ac0c-4120-8da2-8a1876ff42b0 tempest-CreateVolumesFromImageTest-1912033071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-66d80f8e-ac0c-4120-8da2-8a1876ff42b0 tempest-CreateVolumesFromImageTest-1912033071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-66d80f8e-ac0c-4120-8da2-8a1876ff42b0 tempest-CreateVolumesFromImageTest-1912033071 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:22:20 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-66d80f8e-ac0c-4120-8da2-8a1876ff42b0 tempest-CreateVolumesFromImageTest-1912033071 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-66d80f8e-ac0c-4120-8da2-8a1876ff42b0 tempest-CreateVolumesFromImageTest-1912033071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-903ae728-ff5f-4c81-aad4-3453de31b3d9 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2d19cb9-d33f-4af1-99d4-52baeab3083f tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a2d19cb9-d33f-4af1-99d4-52baeab3083f tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Flow 'volume_create_manager' (924fd01f-4fe0-447f-8e67-a541e153c0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:20 devstack sudo[104534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-903ae728-ff5f-4c81-aad4-3453de31b3d9 1073741824
Nov 06 17:22:20 devstack sudo[104534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:20 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a2d19cb9-d33f-4af1-99d4-52baeab3083f tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00906ce5-f90e-4f80-b89d-9ef5127d92e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9ae0a039-7987-4e7d-a74b-1f5de04824e8 tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0c752ca-9061-4618-926f-110ac7d99cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beca139f-86f2-4942-8b5e-656b6cdb5d93', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9ae0a039-7987-4e7d-a74b-1f5de04824e8 tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e57189b-2cbf-4d82-b1d3-9fcf5a41a270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a2d19cb9-d33f-4af1-99d4-52baeab3083f tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00906ce5-f90e-4f80-b89d-9ef5127d92e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-991265519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7034bddf-7db0-4c7f-a4f2-f2a410a00322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db74ff59d184f3a88e5aa9c8714ea78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:21Z,use_quota=True,user_id='beba513901474f2fbc012ec76f6e0034',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a2d19cb9-d33f-4af1-99d4-52baeab3083f tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8d5948-d593-41e0-800c-4dc3a6b89c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a2d19cb9-d33f-4af1-99d4-52baeab3083f tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8d5948-d593-41e0-800c-4dc3a6b89c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a2d19cb9-d33f-4af1-99d4-52baeab3083f tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4052abb6-5184-4179-96fa-9c69602fd205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a2d19cb9-d33f-4af1-99d4-52baeab3083f tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4052abb6-5184-4179-96fa-9c69602fd205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7034bddf-7db0-4c7f-a4f2-f2a410a00322', 'volume_name': 'volume-7034bddf-7db0-4c7f-a4f2-f2a410a00322', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a2d19cb9-d33f-4af1-99d4-52baeab3083f tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d05acb51-94df-42e3-b7ee-d57ab9fb398d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a2d19cb9-d33f-4af1-99d4-52baeab3083f tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d05acb51-94df-42e3-b7ee-d57ab9fb398d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a2d19cb9-d33f-4af1-99d4-52baeab3083f tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6809a277-3d31-4c16-8dec-d950ed2aefd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:21 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-a2d19cb9-d33f-4af1-99d4-52baeab3083f tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Volume 7034bddf-7db0-4c7f-a4f2-f2a410a00322: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7034bddf-7db0-4c7f-a4f2-f2a410a00322', 'volume_size': 1}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a2d19cb9-d33f-4af1-99d4-52baeab3083f tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:21 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-9ae0a039-7987-4e7d-a74b-1f5de04824e8 tempest-CreateVolumesFromImageTest-1912033071 None] Volume volume-beca139f-86f2-4942-8b5e-656b6cdb5d93 (beca139f-86f2-4942-8b5e-656b6cdb5d93): created successfully
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9ae0a039-7987-4e7d-a74b-1f5de04824e8 tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e57189b-2cbf-4d82-b1d3-9fcf5a41a270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-9ae0a039-7987-4e7d-a74b-1f5de04824e8 tempest-CreateVolumesFromImageTest-1912033071 None] Flow 'volume_create_manager' (d381bb4f-f171-4389-ab5c-ac6e2430ee6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5c5e93-70e2-42ff-a6cf-4e89dffbac7c]: (4, 'raw') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa95ee61-4aee-4c1a-a148-4f2195a25ba6_vzxv8nl7devstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:21 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-9ae0a039-7987-4e7d-a74b-1f5de04824e8 tempest-CreateVolumesFromImageTest-1912033071 None] Created volume successfully.
Nov 06 17:22:21 devstack sudo[104536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa95ee61-4aee-4c1a-a148-4f2195a25ba6_vzxv8nl7devstack@QuobyteHD
Nov 06 17:22:21 devstack sudo[104536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ab16f6e3-76b1-41cc-ad4c-ebf803a01974 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-4be864ef-37e4-46f6-bcb7-c0383acb8e90 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4be864ef-37e4-46f6-bcb7-c0383acb8e90 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Flow 'volume_create_manager' (12e13460-29bc-410b-82d8-c19d841d9137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4be864ef-37e4-46f6-bcb7-c0383acb8e90 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11210667-de7b-4683-8256-4d59099d7ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4be864ef-37e4-46f6-bcb7-c0383acb8e90 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11210667-de7b-4683-8256-4d59099d7ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1670734902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9ace20b-954f-477a-beb3-088b7634076d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db74ff59d184f3a88e5aa9c8714ea78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:21Z,use_quota=True,user_id='beba513901474f2fbc012ec76f6e0034',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4be864ef-37e4-46f6-bcb7-c0383acb8e90 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23c72642-a199-4965-84ba-42279164ea80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4be864ef-37e4-46f6-bcb7-c0383acb8e90 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23c72642-a199-4965-84ba-42279164ea80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4be864ef-37e4-46f6-bcb7-c0383acb8e90 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04b374a4-5ea9-4005-8f9d-a5c0ef5e3693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4be864ef-37e4-46f6-bcb7-c0383acb8e90 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04b374a4-5ea9-4005-8f9d-a5c0ef5e3693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9ace20b-954f-477a-beb3-088b7634076d', 'volume_name': 'volume-f9ace20b-954f-477a-beb3-088b7634076d', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4be864ef-37e4-46f6-bcb7-c0383acb8e90 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4142008-ae25-4f4b-bc26-4b163680f8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4be864ef-37e4-46f6-bcb7-c0383acb8e90 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4142008-ae25-4f4b-bc26-4b163680f8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4be864ef-37e4-46f6-bcb7-c0383acb8e90 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93299ed8-0e63-429d-8c08-d7a18f4ce30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:21 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-4be864ef-37e4-46f6-bcb7-c0383acb8e90 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Volume f9ace20b-954f-477a-beb3-088b7634076d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9ace20b-954f-477a-beb3-088b7634076d', 'volume_size': 1}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4be864ef-37e4-46f6-bcb7-c0383acb8e90 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:21 devstack sudo[104534]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-66d80f8e-ac0c-4120-8da2-8a1876ff42b0 tempest-CreateVolumesFromImageTest-1912033071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-903ae728-ff5f-4c81-aad4-3453de31b3d9 1073741824" returned: 0 in 0.661s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:21 devstack sudo[104536]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa95ee61-4aee-4c1a-a148-4f2195a25ba6_vzxv8nl7devstack@QuobyteHD" returned: 0 in 0.474s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa95ee61-4aee-4c1a-a148-4f2195a25ba6_vzxv8nl7devstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-66d80f8e-ac0c-4120-8da2-8a1876ff42b0 tempest-CreateVolumesFromImageTest-1912033071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-903ae728-ff5f-4c81-aad4-3453de31b3d9 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:21 devstack sudo[104546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-903ae728-ff5f-4c81-aad4-3453de31b3d9
Nov 06 17:22:21 devstack sudo[104546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:21 devstack sudo[104544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa95ee61-4aee-4c1a-a148-4f2195a25ba6_vzxv8nl7devstack@QuobyteHD
Nov 06 17:22:21 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:21 devstack sudo[104546]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-66d80f8e-ac0c-4120-8da2-8a1876ff42b0 tempest-CreateVolumesFromImageTest-1912033071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-903ae728-ff5f-4c81-aad4-3453de31b3d9" returned: 0 in 0.259s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-66d80f8e-ac0c-4120-8da2-8a1876ff42b0 tempest-CreateVolumesFromImageTest-1912033071 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-66d80f8e-ac0c-4120-8da2-8a1876ff42b0 tempest-CreateVolumesFromImageTest-1912033071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1d8a80c2-87c6-4650-b09b-8291845ccc95 tempest-CreateVolumesFromImageTest-1912033071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.446s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1d8a80c2-87c6-4650-b09b-8291845ccc95 tempest-CreateVolumesFromImageTest-1912033071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2076190428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b85e133d-7c40-4e58-adee-b25bffcd8b59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3489907c8f56409980f0fdf5b33fc278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:17Z,use_quota=True,user_id='295d067b9d0c47ab897f3a9588f339fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-1d8a80c2-87c6-4650-b09b-8291845ccc95 tempest-CreateVolumesFromImageTest-1912033071 None] Creating volume b85e133d-7c40-4e58-adee-b25bffcd8b59 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1d8a80c2-87c6-4650-b09b-8291845ccc95 tempest-CreateVolumesFromImageTest-1912033071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1d8a80c2-87c6-4650-b09b-8291845ccc95 tempest-CreateVolumesFromImageTest-1912033071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1d8a80c2-87c6-4650-b09b-8291845ccc95 tempest-CreateVolumesFromImageTest-1912033071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1d8a80c2-87c6-4650-b09b-8291845ccc95 tempest-CreateVolumesFromImageTest-1912033071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1d8a80c2-87c6-4650-b09b-8291845ccc95 tempest-CreateVolumesFromImageTest-1912033071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1d8a80c2-87c6-4650-b09b-8291845ccc95 tempest-CreateVolumesFromImageTest-1912033071 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:22:21 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-1d8a80c2-87c6-4650-b09b-8291845ccc95 tempest-CreateVolumesFromImageTest-1912033071 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1d8a80c2-87c6-4650-b09b-8291845ccc95 tempest-CreateVolumesFromImageTest-1912033071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b85e133d-7c40-4e58-adee-b25bffcd8b59 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:21 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa95ee61-4aee-4c1a-a148-4f2195a25ba6_vzxv8nl7devstack@QuobyteHD" returned: 1 in 0.328s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa95ee61-4aee-4c1a-a148-4f2195a25ba6_vzxv8nl7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Temporary image aa95ee61-4aee-4c1a-a148-4f2195a25ba6 is fetched for user a742c71f228042acb9f454060b261cbe. {{(pid=86856) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 06 17:22:21 devstack sudo[104553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b85e133d-7c40-4e58-adee-b25bffcd8b59 1073741824
Nov 06 17:22:21 devstack sudo[104553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-66d80f8e-ac0c-4120-8da2-8a1876ff42b0 tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (494f89b9-2435-4a9c-ad15-2acc2c2330b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-903ae728-ff5f-4c81-aad4-3453de31b3d9', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-66d80f8e-ac0c-4120-8da2-8a1876ff42b0 tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644b98dc-08a8-48f0-89f1-1f13e3da4db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:21 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-66d80f8e-ac0c-4120-8da2-8a1876ff42b0 tempest-CreateVolumesFromImageTest-1912033071 None] Volume volume-903ae728-ff5f-4c81-aad4-3453de31b3d9 (903ae728-ff5f-4c81-aad4-3453de31b3d9): created successfully
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-66d80f8e-ac0c-4120-8da2-8a1876ff42b0 tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644b98dc-08a8-48f0-89f1-1f13e3da4db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:21 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-66d80f8e-ac0c-4120-8da2-8a1876ff42b0 tempest-CreateVolumesFromImageTest-1912033071 None] Flow 'volume_create_manager' (60a56ce4-81f6-4b0c-97ef-7e7f8286d354) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:22 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-66d80f8e-ac0c-4120-8da2-8a1876ff42b0 tempest-CreateVolumesFromImageTest-1912033071 None] Created volume successfully.
Nov 06 17:22:22 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f83fc6a-d95f-44c7-a213-b4fefc50c156]: (4, 'raw') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:22:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa95ee61-4aee-4c1a-a148-4f2195a25ba6_vzxv8nl7devstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:22 devstack sudo[104555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa95ee61-4aee-4c1a-a148-4f2195a25ba6_vzxv8nl7devstack@QuobyteHD
Nov 06 17:22:22 devstack sudo[104555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:22 devstack sudo[104555]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa95ee61-4aee-4c1a-a148-4f2195a25ba6_vzxv8nl7devstack@QuobyteHD" returned: 0 in 0.387s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa95ee61-4aee-4c1a-a148-4f2195a25ba6_vzxv8nl7devstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:22 devstack sudo[104553]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1d8a80c2-87c6-4650-b09b-8291845ccc95 tempest-CreateVolumesFromImageTest-1912033071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b85e133d-7c40-4e58-adee-b25bffcd8b59 1073741824" returned: 0 in 0.510s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1d8a80c2-87c6-4650-b09b-8291845ccc95 tempest-CreateVolumesFromImageTest-1912033071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b85e133d-7c40-4e58-adee-b25bffcd8b59 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:22 devstack sudo[104563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b85e133d-7c40-4e58-adee-b25bffcd8b59
Nov 06 17:22:22 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:22 devstack sudo[104562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa95ee61-4aee-4c1a-a148-4f2195a25ba6_vzxv8nl7devstack@QuobyteHD
Nov 06 17:22:22 devstack sudo[104562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:22 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1d8a80c2-87c6-4650-b09b-8291845ccc95 tempest-CreateVolumesFromImageTest-1912033071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b85e133d-7c40-4e58-adee-b25bffcd8b59" returned: 0 in 0.256s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:22 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1d8a80c2-87c6-4650-b09b-8291845ccc95 tempest-CreateVolumesFromImageTest-1912033071 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:22:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1d8a80c2-87c6-4650-b09b-8291845ccc95 tempest-CreateVolumesFromImageTest-1912033071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a665e457-3454-4ae6-9722-db4c9d3ba0ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.916s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:22 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a665e457-3454-4ae6-9722-db4c9d3ba0ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1668406515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b851a049-d6ad-45d1-9633-566e1e4af273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db74ff59d184f3a88e5aa9c8714ea78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:20Z,use_quota=True,user_id='beba513901474f2fbc012ec76f6e0034',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:22:22 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-a665e457-3454-4ae6-9722-db4c9d3ba0ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Creating volume b851a049-d6ad-45d1-9633-566e1e4af273 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:22:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a665e457-3454-4ae6-9722-db4c9d3ba0ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a665e457-3454-4ae6-9722-db4c9d3ba0ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:22 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a665e457-3454-4ae6-9722-db4c9d3ba0ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:22 devstack sudo[104562]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:22 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a665e457-3454-4ae6-9722-db4c9d3ba0ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a665e457-3454-4ae6-9722-db4c9d3ba0ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:22 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a665e457-3454-4ae6-9722-db4c9d3ba0ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:22:22 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-a665e457-3454-4ae6-9722-db4c9d3ba0ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:22:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a665e457-3454-4ae6-9722-db4c9d3ba0ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b851a049-d6ad-45d1-9633-566e1e4af273 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa95ee61-4aee-4c1a-a148-4f2195a25ba6_vzxv8nl7devstack@QuobyteHD" returned: 1 in 0.339s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa95ee61-4aee-4c1a-a148-4f2195a25ba6_vzxv8nl7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 17:22:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:22 devstack sudo[104570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b851a049-d6ad-45d1-9633-566e1e4af273 1073741824
Nov 06 17:22:22 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1d8a80c2-87c6-4650-b09b-8291845ccc95 tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c2cf7e6-c313-4565-a44c-4122fb7d7b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b85e133d-7c40-4e58-adee-b25bffcd8b59', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1d8a80c2-87c6-4650-b09b-8291845ccc95 tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57c57f2e-7c9c-4623-b3fe-bf5836fad5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:22 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-1d8a80c2-87c6-4650-b09b-8291845ccc95 tempest-CreateVolumesFromImageTest-1912033071 None] Volume volume-b85e133d-7c40-4e58-adee-b25bffcd8b59 (b85e133d-7c40-4e58-adee-b25bffcd8b59): created successfully
Nov 06 17:22:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1d8a80c2-87c6-4650-b09b-8291845ccc95 tempest-CreateVolumesFromImageTest-1912033071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57c57f2e-7c9c-4623-b3fe-bf5836fad5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1d8a80c2-87c6-4650-b09b-8291845ccc95 tempest-CreateVolumesFromImageTest-1912033071 None] Flow 'volume_create_manager' (a5dac745-34b1-4ced-ac63-aa0b17b6b5bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:22 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-1d8a80c2-87c6-4650-b09b-8291845ccc95 tempest-CreateVolumesFromImageTest-1912033071 None] Created volume successfully.
Nov 06 17:22:23 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a665e457-3454-4ae6-9722-db4c9d3ba0ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b851a049-d6ad-45d1-9633-566e1e4af273 1073741824" returned: 0 in 0.421s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a665e457-3454-4ae6-9722-db4c9d3ba0ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b851a049-d6ad-45d1-9633-566e1e4af273 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:23 devstack sudo[104576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b851a049-d6ad-45d1-9633-566e1e4af273
Nov 06 17:22:23 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:23 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a665e457-3454-4ae6-9722-db4c9d3ba0ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b851a049-d6ad-45d1-9633-566e1e4af273" returned: 0 in 0.267s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:23 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a665e457-3454-4ae6-9722-db4c9d3ba0ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:22:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a665e457-3454-4ae6-9722-db4c9d3ba0ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b150df8c-7840-4956-8dfd-8aa0f9704fef tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.050s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:23 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-b150df8c-7840-4956-8dfd-8aa0f9704fef tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1304177836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86e5c615-4b00-49ee-a13f-bdbd9793d414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db74ff59d184f3a88e5aa9c8714ea78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:20Z,use_quota=True,user_id='beba513901474f2fbc012ec76f6e0034',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:22:23 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-b150df8c-7840-4956-8dfd-8aa0f9704fef tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Creating volume 86e5c615-4b00-49ee-a13f-bdbd9793d414 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:22:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b150df8c-7840-4956-8dfd-8aa0f9704fef tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b150df8c-7840-4956-8dfd-8aa0f9704fef tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:23 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-b150df8c-7840-4956-8dfd-8aa0f9704fef tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:23 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-b150df8c-7840-4956-8dfd-8aa0f9704fef tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b150df8c-7840-4956-8dfd-8aa0f9704fef tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:23 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-b150df8c-7840-4956-8dfd-8aa0f9704fef tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:22:23 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-b150df8c-7840-4956-8dfd-8aa0f9704fef tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:22:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b150df8c-7840-4956-8dfd-8aa0f9704fef tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-86e5c615-4b00-49ee-a13f-bdbd9793d414 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:23 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a665e457-3454-4ae6-9722-db4c9d3ba0ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a3366f5-430c-4953-a97a-8d81650f2894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b851a049-d6ad-45d1-9633-566e1e4af273', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:23 devstack sudo[104579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-86e5c615-4b00-49ee-a13f-bdbd9793d414 1073741824
Nov 06 17:22:23 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:23 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a665e457-3454-4ae6-9722-db4c9d3ba0ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50900ea7-afdf-46af-8e53-6d045c33ec39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:23 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-a665e457-3454-4ae6-9722-db4c9d3ba0ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Volume volume-b851a049-d6ad-45d1-9633-566e1e4af273 (b851a049-d6ad-45d1-9633-566e1e4af273): created successfully
Nov 06 17:22:23 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a665e457-3454-4ae6-9722-db4c9d3ba0ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50900ea7-afdf-46af-8e53-6d045c33ec39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:23 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a665e457-3454-4ae6-9722-db4c9d3ba0ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Flow 'volume_create_manager' (961e6c57-858d-4284-ad6f-1f9042104315) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:23 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-0542ebb4-cb40-41d4-b135-00c6a6989fd5 tempest-CreateVolumesFromImageTest-1912033071 None] Acquiring lock "cinder-b85e133d-7c40-4e58-adee-b25bffcd8b59-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:23 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-a665e457-3454-4ae6-9722-db4c9d3ba0ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Created volume successfully.
Nov 06 17:22:23 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-0542ebb4-cb40-41d4-b135-00c6a6989fd5 tempest-CreateVolumesFromImageTest-1912033071 None] Lock "cinder-b85e133d-7c40-4e58-adee-b25bffcd8b59-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:23 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-0542ebb4-cb40-41d4-b135-00c6a6989fd5 tempest-CreateVolumesFromImageTest-1912033071 None] Acquiring lock "cinder-quobyte-b85e133d-7c40-4e58-adee-b25bffcd8b59" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:23 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-0542ebb4-cb40-41d4-b135-00c6a6989fd5 tempest-CreateVolumesFromImageTest-1912033071 None] Lock "cinder-quobyte-b85e133d-7c40-4e58-adee-b25bffcd8b59" acquired by "delete_volume" :: waited 0.017s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:23 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[709588fb-64e7-40e0-a599-0337966f1c80]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:22:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0542ebb4-cb40-41d4-b135-00c6a6989fd5 tempest-CreateVolumesFromImageTest-1912033071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b85e133d-7c40-4e58-adee-b25bffcd8b59 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:23 devstack sudo[104581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b85e133d-7c40-4e58-adee-b25bffcd8b59
Nov 06 17:22:23 devstack sudo[104581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:23 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b150df8c-7840-4956-8dfd-8aa0f9704fef tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-86e5c615-4b00-49ee-a13f-bdbd9793d414 1073741824" returned: 0 in 0.428s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b150df8c-7840-4956-8dfd-8aa0f9704fef tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-86e5c615-4b00-49ee-a13f-bdbd9793d414 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:23 devstack sudo[104586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-86e5c615-4b00-49ee-a13f-bdbd9793d414
Nov 06 17:22:23 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:24 devstack sudo[104581]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0542ebb4-cb40-41d4-b135-00c6a6989fd5 tempest-CreateVolumesFromImageTest-1912033071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b85e133d-7c40-4e58-adee-b25bffcd8b59" returned: 0 in 0.394s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0542ebb4-cb40-41d4-b135-00c6a6989fd5 tempest-CreateVolumesFromImageTest-1912033071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b85e133d-7c40-4e58-adee-b25bffcd8b59 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:24 devstack sudo[104591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b85e133d-7c40-4e58-adee-b25bffcd8b59
Nov 06 17:22:24 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:24 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b150df8c-7840-4956-8dfd-8aa0f9704fef tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-86e5c615-4b00-49ee-a13f-bdbd9793d414" returned: 0 in 0.269s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:24 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-b150df8c-7840-4956-8dfd-8aa0f9704fef tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:22:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b150df8c-7840-4956-8dfd-8aa0f9704fef tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1bea6b9d-171e-46de-9308-bbc123930e23 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.624s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:24 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1bea6b9d-171e-46de-9308-bbc123930e23 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-525982894',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7d7d638-c0f8-4e73-9cb4-9976d827d113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db74ff59d184f3a88e5aa9c8714ea78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:20Z,use_quota=True,user_id='beba513901474f2fbc012ec76f6e0034',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:22:24 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-1bea6b9d-171e-46de-9308-bbc123930e23 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Creating volume e7d7d638-c0f8-4e73-9cb4-9976d827d113 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:22:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1bea6b9d-171e-46de-9308-bbc123930e23 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1bea6b9d-171e-46de-9308-bbc123930e23 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:24 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1bea6b9d-171e-46de-9308-bbc123930e23 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:24 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1bea6b9d-171e-46de-9308-bbc123930e23 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1bea6b9d-171e-46de-9308-bbc123930e23 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:24 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1bea6b9d-171e-46de-9308-bbc123930e23 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:22:24 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-1bea6b9d-171e-46de-9308-bbc123930e23 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:22:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1bea6b9d-171e-46de-9308-bbc123930e23 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e7d7d638-c0f8-4e73-9cb4-9976d827d113 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:24 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b150df8c-7840-4956-8dfd-8aa0f9704fef tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56fb7ab8-c577-4151-a8e6-5ee4589ffe67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86e5c615-4b00-49ee-a13f-bdbd9793d414', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:24 devstack sudo[104594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e7d7d638-c0f8-4e73-9cb4-9976d827d113 1073741824
Nov 06 17:22:24 devstack sudo[104594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:24 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b150df8c-7840-4956-8dfd-8aa0f9704fef tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28848e56-e9f0-433a-8fae-13ea84afdd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:24 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-b150df8c-7840-4956-8dfd-8aa0f9704fef tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Volume volume-86e5c615-4b00-49ee-a13f-bdbd9793d414 (86e5c615-4b00-49ee-a13f-bdbd9793d414): created successfully
Nov 06 17:22:24 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b150df8c-7840-4956-8dfd-8aa0f9704fef tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28848e56-e9f0-433a-8fae-13ea84afdd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:24 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b150df8c-7840-4956-8dfd-8aa0f9704fef tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Flow 'volume_create_manager' (efffc698-d80c-4289-911f-6ca215b0d5b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:24 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-b150df8c-7840-4956-8dfd-8aa0f9704fef tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Created volume successfully.
Nov 06 17:22:24 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0542ebb4-cb40-41d4-b135-00c6a6989fd5 tempest-CreateVolumesFromImageTest-1912033071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b85e133d-7c40-4e58-adee-b25bffcd8b59" returned: 0 in 0.294s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:24 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-0542ebb4-cb40-41d4-b135-00c6a6989fd5 tempest-CreateVolumesFromImageTest-1912033071 None] Lock "cinder-quobyte-b85e133d-7c40-4e58-adee-b25bffcd8b59" released by "delete_volume" :: held 0.729s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:24 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-0542ebb4-cb40-41d4-b135-00c6a6989fd5 tempest-CreateVolumesFromImageTest-1912033071 None] Created reservations ['7a11a5e1-b6c3-4691-82af-ef1a35c97936', 'c2dc220a-9220-4829-9442-c813408dcfd6', '2529f89e-a219-43e5-a5c4-fb524aa405f4', '1afa77a0-fe34-402b-b4aa-9d5d5f572009'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:22:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0542ebb4-cb40-41d4-b135-00c6a6989fd5 tempest-CreateVolumesFromImageTest-1912033071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0542ebb4-cb40-41d4-b135-00c6a6989fd5 tempest-CreateVolumesFromImageTest-1912033071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:24 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0542ebb4-cb40-41d4-b135-00c6a6989fd5 tempest-CreateVolumesFromImageTest-1912033071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:24 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0542ebb4-cb40-41d4-b135-00c6a6989fd5 tempest-CreateVolumesFromImageTest-1912033071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0542ebb4-cb40-41d4-b135-00c6a6989fd5 tempest-CreateVolumesFromImageTest-1912033071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0542ebb4-cb40-41d4-b135-00c6a6989fd5 tempest-CreateVolumesFromImageTest-1912033071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:24 devstack sudo[104600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:22:24 devstack sudo[104600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:24 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-44e1e366-a435-4ee4-bbde-d43ee8785b72 tempest-CreateVolumesFromImageTest-1912033071 None] Acquiring lock "cinder-903ae728-ff5f-4c81-aad4-3453de31b3d9-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:24 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-44e1e366-a435-4ee4-bbde-d43ee8785b72 tempest-CreateVolumesFromImageTest-1912033071 None] Lock "cinder-903ae728-ff5f-4c81-aad4-3453de31b3d9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:24 devstack sudo[104594]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1bea6b9d-171e-46de-9308-bbc123930e23 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e7d7d638-c0f8-4e73-9cb4-9976d827d113 1073741824" returned: 0 in 0.532s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:24 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-44e1e366-a435-4ee4-bbde-d43ee8785b72 tempest-CreateVolumesFromImageTest-1912033071 None] Acquiring lock "cinder-quobyte-903ae728-ff5f-4c81-aad4-3453de31b3d9" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1bea6b9d-171e-46de-9308-bbc123930e23 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e7d7d638-c0f8-4e73-9cb4-9976d827d113 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:24 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-44e1e366-a435-4ee4-bbde-d43ee8785b72 tempest-CreateVolumesFromImageTest-1912033071 None] Lock "cinder-quobyte-903ae728-ff5f-4c81-aad4-3453de31b3d9" acquired by "delete_volume" :: waited 0.031s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:24 devstack sudo[104600]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:24 devstack sudo[104604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e7d7d638-c0f8-4e73-9cb4-9976d827d113
Nov 06 17:22:24 devstack sudo[104604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0542ebb4-cb40-41d4-b135-00c6a6989fd5 tempest-CreateVolumesFromImageTest-1912033071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.306s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:24 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-0542ebb4-cb40-41d4-b135-00c6a6989fd5 tempest-CreateVolumesFromImageTest-1912033071 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:22:24 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-0542ebb4-cb40-41d4-b135-00c6a6989fd5 tempest-CreateVolumesFromImageTest-1912033071 None] Deleted volume successfully.
Nov 06 17:22:24 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec819fe1-fdd9-4bea-a5fa-83f28168d4a2]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:22:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-44e1e366-a435-4ee4-bbde-d43ee8785b72 tempest-CreateVolumesFromImageTest-1912033071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-903ae728-ff5f-4c81-aad4-3453de31b3d9 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:24 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-0542ebb4-cb40-41d4-b135-00c6a6989fd5 tempest-CreateVolumesFromImageTest-1912033071 None] Lock "cinder-b85e133d-7c40-4e58-adee-b25bffcd8b59-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:25 devstack sudo[104606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-903ae728-ff5f-4c81-aad4-3453de31b3d9
Nov 06 17:22:25 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:25 devstack sudo[104604]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1bea6b9d-171e-46de-9308-bbc123930e23 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e7d7d638-c0f8-4e73-9cb4-9976d827d113" returned: 0 in 0.257s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1bea6b9d-171e-46de-9308-bbc123930e23 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1bea6b9d-171e-46de-9308-bbc123930e23 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a2d19cb9-d33f-4af1-99d4-52baeab3083f tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.974s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a2d19cb9-d33f-4af1-99d4-52baeab3083f tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-991265519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7034bddf-7db0-4c7f-a4f2-f2a410a00322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db74ff59d184f3a88e5aa9c8714ea78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:21Z,use_quota=True,user_id='beba513901474f2fbc012ec76f6e0034',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-a2d19cb9-d33f-4af1-99d4-52baeab3083f tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Creating volume 7034bddf-7db0-4c7f-a4f2-f2a410a00322 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a2d19cb9-d33f-4af1-99d4-52baeab3083f tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a2d19cb9-d33f-4af1-99d4-52baeab3083f tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a2d19cb9-d33f-4af1-99d4-52baeab3083f tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a2d19cb9-d33f-4af1-99d4-52baeab3083f tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a2d19cb9-d33f-4af1-99d4-52baeab3083f tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a2d19cb9-d33f-4af1-99d4-52baeab3083f tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:22:25 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-a2d19cb9-d33f-4af1-99d4-52baeab3083f tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a2d19cb9-d33f-4af1-99d4-52baeab3083f tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7034bddf-7db0-4c7f-a4f2-f2a410a00322 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1bea6b9d-171e-46de-9308-bbc123930e23 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76977a2a-a4a1-474f-a575-5dd05180b427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7d7d638-c0f8-4e73-9cb4-9976d827d113', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:25 devstack sudo[104609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7034bddf-7db0-4c7f-a4f2-f2a410a00322 1073741824
Nov 06 17:22:25 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1bea6b9d-171e-46de-9308-bbc123930e23 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f9c1550-c348-4693-b18c-3a4d5a1b9bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:25 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-1bea6b9d-171e-46de-9308-bbc123930e23 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Volume volume-e7d7d638-c0f8-4e73-9cb4-9976d827d113 (e7d7d638-c0f8-4e73-9cb4-9976d827d113): created successfully
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1bea6b9d-171e-46de-9308-bbc123930e23 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f9c1550-c348-4693-b18c-3a4d5a1b9bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1bea6b9d-171e-46de-9308-bbc123930e23 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Flow 'volume_create_manager' (e7056f14-7ee2-46a6-bb89-11a42c565e9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:25 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-1bea6b9d-171e-46de-9308-bbc123930e23 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Created volume successfully.
Nov 06 17:22:25 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-44e1e366-a435-4ee4-bbde-d43ee8785b72 tempest-CreateVolumesFromImageTest-1912033071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-903ae728-ff5f-4c81-aad4-3453de31b3d9" returned: 0 in 0.385s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-44e1e366-a435-4ee4-bbde-d43ee8785b72 tempest-CreateVolumesFromImageTest-1912033071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-903ae728-ff5f-4c81-aad4-3453de31b3d9 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:25 devstack sudo[104614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-903ae728-ff5f-4c81-aad4-3453de31b3d9
Nov 06 17:22:25 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:25 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-44e1e366-a435-4ee4-bbde-d43ee8785b72 tempest-CreateVolumesFromImageTest-1912033071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-903ae728-ff5f-4c81-aad4-3453de31b3d9" returned: 0 in 0.262s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-44e1e366-a435-4ee4-bbde-d43ee8785b72 tempest-CreateVolumesFromImageTest-1912033071 None] Lock "cinder-quobyte-903ae728-ff5f-4c81-aad4-3453de31b3d9" released by "delete_volume" :: held 0.704s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:25 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a2d19cb9-d33f-4af1-99d4-52baeab3083f tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7034bddf-7db0-4c7f-a4f2-f2a410a00322 1073741824" returned: 0 in 0.467s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a2d19cb9-d33f-4af1-99d4-52baeab3083f tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7034bddf-7db0-4c7f-a4f2-f2a410a00322 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-44e1e366-a435-4ee4-bbde-d43ee8785b72 tempest-CreateVolumesFromImageTest-1912033071 None] Created reservations ['339595fe-0861-46fd-8c7d-50af0d7639c6', '54f14058-90db-4cb1-b6d9-b46a7d047bd5', '27197fd7-92cb-4cc8-8127-3d3808b56bae', '47a9b297-d76c-48d5-a815-fbec3ea15f70'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:22:25 devstack sudo[104620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7034bddf-7db0-4c7f-a4f2-f2a410a00322
Nov 06 17:22:25 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-44e1e366-a435-4ee4-bbde-d43ee8785b72 tempest-CreateVolumesFromImageTest-1912033071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-44e1e366-a435-4ee4-bbde-d43ee8785b72 tempest-CreateVolumesFromImageTest-1912033071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-44e1e366-a435-4ee4-bbde-d43ee8785b72 tempest-CreateVolumesFromImageTest-1912033071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-44e1e366-a435-4ee4-bbde-d43ee8785b72 tempest-CreateVolumesFromImageTest-1912033071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-44e1e366-a435-4ee4-bbde-d43ee8785b72 tempest-CreateVolumesFromImageTest-1912033071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-44e1e366-a435-4ee4-bbde-d43ee8785b72 tempest-CreateVolumesFromImageTest-1912033071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:25 devstack sudo[104622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:22:25 devstack sudo[104622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:25 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a2d19cb9-d33f-4af1-99d4-52baeab3083f tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7034bddf-7db0-4c7f-a4f2-f2a410a00322" returned: 0 in 0.280s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a2d19cb9-d33f-4af1-99d4-52baeab3083f tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a2d19cb9-d33f-4af1-99d4-52baeab3083f tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ab16f6e3-76b1-41cc-ad4c-ebf803a01974 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.463s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a2d19cb9-d33f-4af1-99d4-52baeab3083f tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6809a277-3d31-4c16-8dec-d950ed2aefd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7034bddf-7db0-4c7f-a4f2-f2a410a00322', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a2d19cb9-d33f-4af1-99d4-52baeab3083f tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a903ed34-dbf4-4399-b9bf-e6a4ebc5780d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c6d32099-bf4f-4b44-9a75-03145d1d3b89 tempest-CreateVolumesFromImageTest-1912033071 None] Acquiring lock "cinder-beca139f-86f2-4942-8b5e-656b6cdb5d93-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-ab16f6e3-76b1-41cc-ad4c-ebf803a01974 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Creating offline snapshot 87300090-b117-4c7b-a022-2fe564131fb7 of volume a6394a35-58a2-4020-9e81-e90144bdc174 {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:22:25 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-a2d19cb9-d33f-4af1-99d4-52baeab3083f tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Volume volume-7034bddf-7db0-4c7f-a4f2-f2a410a00322 (7034bddf-7db0-4c7f-a4f2-f2a410a00322): created successfully
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a2d19cb9-d33f-4af1-99d4-52baeab3083f tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a903ed34-dbf4-4399-b9bf-e6a4ebc5780d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:25 devstack sudo[104622]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a2d19cb9-d33f-4af1-99d4-52baeab3083f tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Flow 'volume_create_manager' (924fd01f-4fe0-447f-8e67-a541e153c0ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c6d32099-bf4f-4b44-9a75-03145d1d3b89 tempest-CreateVolumesFromImageTest-1912033071 None] Lock "cinder-beca139f-86f2-4942-8b5e-656b6cdb5d93-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1446897-9b1a-45c4-8d72-df4483b7f4e0]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab16f6e3-76b1-41cc-ad4c-ebf803a01974 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-44e1e366-a435-4ee4-bbde-d43ee8785b72 tempest-CreateVolumesFromImageTest-1912033071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.305s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:25 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-44e1e366-a435-4ee4-bbde-d43ee8785b72 tempest-CreateVolumesFromImageTest-1912033071 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:22:26 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-44e1e366-a435-4ee4-bbde-d43ee8785b72 tempest-CreateVolumesFromImageTest-1912033071 None] Deleted volume successfully.
Nov 06 17:22:26 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-a2d19cb9-d33f-4af1-99d4-52baeab3083f tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Created volume successfully.
Nov 06 17:22:26 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c6d32099-bf4f-4b44-9a75-03145d1d3b89 tempest-CreateVolumesFromImageTest-1912033071 None] Acquiring lock "cinder-quobyte-beca139f-86f2-4942-8b5e-656b6cdb5d93" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:26 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-44e1e366-a435-4ee4-bbde-d43ee8785b72 tempest-CreateVolumesFromImageTest-1912033071 None] Lock "cinder-903ae728-ff5f-4c81-aad4-3453de31b3d9-delete_volume" released by "delete_volume" :: held 1.289s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:26 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c6d32099-bf4f-4b44-9a75-03145d1d3b89 tempest-CreateVolumesFromImageTest-1912033071 None] Lock "cinder-quobyte-beca139f-86f2-4942-8b5e-656b6cdb5d93" acquired by "delete_volume" :: waited 0.017s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:26 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c855beb-cf20-441f-809a-ee7ea71daa39]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:22:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c6d32099-bf4f-4b44-9a75-03145d1d3b89 tempest-CreateVolumesFromImageTest-1912033071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-beca139f-86f2-4942-8b5e-656b6cdb5d93 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:26 devstack sudo[104626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174
Nov 06 17:22:26 devstack sudo[104626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:26 devstack sudo[104627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-beca139f-86f2-4942-8b5e-656b6cdb5d93
Nov 06 17:22:26 devstack sudo[104627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:26 devstack sudo[104626]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab16f6e3-76b1-41cc-ad4c-ebf803a01974 tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174" returned: 0 in 0.392s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab16f6e3-76b1-41cc-ad4c-ebf803a01974 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174.87300090-b117-4c7b-a022-2fe564131fb7 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:26 devstack sudo[104633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174.87300090-b117-4c7b-a022-2fe564131fb7 1G
Nov 06 17:22:26 devstack sudo[104633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:26 devstack sudo[104627]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c6d32099-bf4f-4b44-9a75-03145d1d3b89 tempest-CreateVolumesFromImageTest-1912033071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-beca139f-86f2-4942-8b5e-656b6cdb5d93" returned: 0 in 0.386s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c6d32099-bf4f-4b44-9a75-03145d1d3b89 tempest-CreateVolumesFromImageTest-1912033071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-beca139f-86f2-4942-8b5e-656b6cdb5d93 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:26 devstack sudo[104638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-beca139f-86f2-4942-8b5e-656b6cdb5d93
Nov 06 17:22:26 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:26 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c6d32099-bf4f-4b44-9a75-03145d1d3b89 tempest-CreateVolumesFromImageTest-1912033071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-beca139f-86f2-4942-8b5e-656b6cdb5d93" returned: 0 in 0.289s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:26 devstack sudo[104633]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab16f6e3-76b1-41cc-ad4c-ebf803a01974 tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174.87300090-b117-4c7b-a022-2fe564131fb7 1G" returned: 0 in 0.409s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab16f6e3-76b1-41cc-ad4c-ebf803a01974 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6394a35-58a2-4020-9e81-e90144bdc174 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174.87300090-b117-4c7b-a022-2fe564131fb7 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:26 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c6d32099-bf4f-4b44-9a75-03145d1d3b89 tempest-CreateVolumesFromImageTest-1912033071 None] Lock "cinder-quobyte-beca139f-86f2-4942-8b5e-656b6cdb5d93" released by "delete_volume" :: held 0.733s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:26 devstack sudo[104645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6394a35-58a2-4020-9e81-e90144bdc174 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174.87300090-b117-4c7b-a022-2fe564131fb7
Nov 06 17:22:26 devstack sudo[104645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:26 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-c6d32099-bf4f-4b44-9a75-03145d1d3b89 tempest-CreateVolumesFromImageTest-1912033071 None] Created reservations ['952a8499-3d35-4ea9-a1a4-373883c5c04e', '26d4e87f-ce5a-40a6-a4fe-2162cd4de461', 'f0e81c84-e6ad-434d-810a-fbb241a2037d', '1f9a90a2-9676-4159-b8df-3b4ab1a86b58'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:22:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c6d32099-bf4f-4b44-9a75-03145d1d3b89 tempest-CreateVolumesFromImageTest-1912033071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c6d32099-bf4f-4b44-9a75-03145d1d3b89 tempest-CreateVolumesFromImageTest-1912033071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:26 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c6d32099-bf4f-4b44-9a75-03145d1d3b89 tempest-CreateVolumesFromImageTest-1912033071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:26 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c6d32099-bf4f-4b44-9a75-03145d1d3b89 tempest-CreateVolumesFromImageTest-1912033071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c6d32099-bf4f-4b44-9a75-03145d1d3b89 tempest-CreateVolumesFromImageTest-1912033071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c6d32099-bf4f-4b44-9a75-03145d1d3b89 tempest-CreateVolumesFromImageTest-1912033071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:26 devstack sudo[104647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:22:26 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:27 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c6dd2cfd-619f-4d40-b3a3-d6a49f6e9889 tempest-CreateVolumesFromImageTest-1912033071 None] Acquiring lock "cinder-0fb80b86-ef5d-4a5e-97d3-0c60f9489090-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:27 devstack sudo[104645]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab16f6e3-76b1-41cc-ad4c-ebf803a01974 tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6394a35-58a2-4020-9e81-e90144bdc174 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174.87300090-b117-4c7b-a022-2fe564131fb7" returned: 0 in 0.350s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:27 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-ab16f6e3-76b1-41cc-ad4c-ebf803a01974 tempest-CreateVolumesFromSnapshotTest-1490455522 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174.87300090-b117-4c7b-a022-2fe564131fb7 is being set with open permissions: ugo+rw
Nov 06 17:22:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab16f6e3-76b1-41cc-ad4c-ebf803a01974 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174.87300090-b117-4c7b-a022-2fe564131fb7 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:27 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c6dd2cfd-619f-4d40-b3a3-d6a49f6e9889 tempest-CreateVolumesFromImageTest-1912033071 None] Lock "cinder-0fb80b86-ef5d-4a5e-97d3-0c60f9489090-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:27 devstack sudo[104653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174.87300090-b117-4c7b-a022-2fe564131fb7
Nov 06 17:22:27 devstack sudo[104653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:27 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:27 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c6dd2cfd-619f-4d40-b3a3-d6a49f6e9889 tempest-CreateVolumesFromImageTest-1912033071 None] Acquiring lock "cinder-quobyte-0fb80b86-ef5d-4a5e-97d3-0c60f9489090" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c6d32099-bf4f-4b44-9a75-03145d1d3b89 tempest-CreateVolumesFromImageTest-1912033071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.291s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:27 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-c6d32099-bf4f-4b44-9a75-03145d1d3b89 tempest-CreateVolumesFromImageTest-1912033071 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:22:27 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-c6d32099-bf4f-4b44-9a75-03145d1d3b89 tempest-CreateVolumesFromImageTest-1912033071 None] Deleted volume successfully.
Nov 06 17:22:27 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c6dd2cfd-619f-4d40-b3a3-d6a49f6e9889 tempest-CreateVolumesFromImageTest-1912033071 None] Lock "cinder-quobyte-0fb80b86-ef5d-4a5e-97d3-0c60f9489090" acquired by "delete_volume" :: waited 0.033s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:27 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c6d32099-bf4f-4b44-9a75-03145d1d3b89 tempest-CreateVolumesFromImageTest-1912033071 None] Lock "cinder-beca139f-86f2-4942-8b5e-656b6cdb5d93-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:27 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[26cc0b51-cb12-48c3-a5f7-b356869a4e3f]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:22:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c6dd2cfd-619f-4d40-b3a3-d6a49f6e9889 tempest-CreateVolumesFromImageTest-1912033071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0fb80b86-ef5d-4a5e-97d3-0c60f9489090 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:27 devstack sudo[104653]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:27 devstack sudo[104656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0fb80b86-ef5d-4a5e-97d3-0c60f9489090
Nov 06 17:22:27 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab16f6e3-76b1-41cc-ad4c-ebf803a01974 tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174.87300090-b117-4c7b-a022-2fe564131fb7" returned: 0 in 0.255s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab16f6e3-76b1-41cc-ad4c-ebf803a01974 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:27 devstack sudo[104659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174.info
Nov 06 17:22:27 devstack sudo[104659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:27 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c6dd2cfd-619f-4d40-b3a3-d6a49f6e9889 tempest-CreateVolumesFromImageTest-1912033071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0fb80b86-ef5d-4a5e-97d3-0c60f9489090" returned: 0 in 0.365s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c6dd2cfd-619f-4d40-b3a3-d6a49f6e9889 tempest-CreateVolumesFromImageTest-1912033071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0fb80b86-ef5d-4a5e-97d3-0c60f9489090 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:27 devstack sudo[104665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0fb80b86-ef5d-4a5e-97d3-0c60f9489090
Nov 06 17:22:27 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:27 devstack sudo[104659]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab16f6e3-76b1-41cc-ad4c-ebf803a01974 tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174.info" returned: 0 in 0.262s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:27 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-ab16f6e3-76b1-41cc-ad4c-ebf803a01974 tempest-CreateVolumesFromSnapshotTest-1490455522 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174.info is being set with open permissions: ugo+rw
Nov 06 17:22:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab16f6e3-76b1-41cc-ad4c-ebf803a01974 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:27 devstack sudo[104667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174.info
Nov 06 17:22:27 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:27 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c6dd2cfd-619f-4d40-b3a3-d6a49f6e9889 tempest-CreateVolumesFromImageTest-1912033071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0fb80b86-ef5d-4a5e-97d3-0c60f9489090" returned: 0 in 0.254s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:27 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c6dd2cfd-619f-4d40-b3a3-d6a49f6e9889 tempest-CreateVolumesFromImageTest-1912033071 None] Lock "cinder-quobyte-0fb80b86-ef5d-4a5e-97d3-0c60f9489090" released by "delete_volume" :: held 0.669s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:27 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab16f6e3-76b1-41cc-ad4c-ebf803a01974 tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174.info" returned: 0 in 0.252s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ab16f6e3-76b1-41cc-ad4c-ebf803a01974 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.067s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4be864ef-37e4-46f6-bcb7-c0383acb8e90 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.359s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:27 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4be864ef-37e4-46f6-bcb7-c0383acb8e90 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1670734902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9ace20b-954f-477a-beb3-088b7634076d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db74ff59d184f3a88e5aa9c8714ea78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:21Z,use_quota=True,user_id='beba513901474f2fbc012ec76f6e0034',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:22:27 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-4be864ef-37e4-46f6-bcb7-c0383acb8e90 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Creating volume f9ace20b-954f-477a-beb3-088b7634076d {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:22:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4be864ef-37e4-46f6-bcb7-c0383acb8e90 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4be864ef-37e4-46f6-bcb7-c0383acb8e90 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:27 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4be864ef-37e4-46f6-bcb7-c0383acb8e90 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:27 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4be864ef-37e4-46f6-bcb7-c0383acb8e90 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4be864ef-37e4-46f6-bcb7-c0383acb8e90 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:27 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4be864ef-37e4-46f6-bcb7-c0383acb8e90 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:22:27 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-4be864ef-37e4-46f6-bcb7-c0383acb8e90 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:22:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4be864ef-37e4-46f6-bcb7-c0383acb8e90 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9ace20b-954f-477a-beb3-088b7634076d 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:27 devstack sudo[104671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9ace20b-954f-477a-beb3-088b7634076d 1073741824
Nov 06 17:22:27 devstack sudo[104671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:28 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-ab16f6e3-76b1-41cc-ad4c-ebf803a01974 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Create snapshot completed successfully
Nov 06 17:22:28 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-c6dd2cfd-619f-4d40-b3a3-d6a49f6e9889 tempest-CreateVolumesFromImageTest-1912033071 None] Created reservations ['1f22caf2-6049-4bc6-aa5a-1e38b9865abd', '40fa758c-5f6f-49ad-b7f0-3ec6a562e636', 'ef1de197-a8bf-4d53-8b8b-76e74191178f', 'ced7c6ce-5676-4987-b09b-4b940b920613'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:22:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c6dd2cfd-619f-4d40-b3a3-d6a49f6e9889 tempest-CreateVolumesFromImageTest-1912033071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c6dd2cfd-619f-4d40-b3a3-d6a49f6e9889 tempest-CreateVolumesFromImageTest-1912033071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:28 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c6dd2cfd-619f-4d40-b3a3-d6a49f6e9889 tempest-CreateVolumesFromImageTest-1912033071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:28 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c6dd2cfd-619f-4d40-b3a3-d6a49f6e9889 tempest-CreateVolumesFromImageTest-1912033071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c6dd2cfd-619f-4d40-b3a3-d6a49f6e9889 tempest-CreateVolumesFromImageTest-1912033071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c6dd2cfd-619f-4d40-b3a3-d6a49f6e9889 tempest-CreateVolumesFromImageTest-1912033071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:28 devstack sudo[104673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:22:28 devstack sudo[104673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:28 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1bfbf44e-9064-4f96-a9bb-fd710cccc41b tempest-CreateVolumesFromImageTest-1912033071 None] Acquiring lock "cinder-b6211de1-b2ec-4989-bf58-ae4bb9868c4f-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:28 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1bfbf44e-9064-4f96-a9bb-fd710cccc41b tempest-CreateVolumesFromImageTest-1912033071 None] Lock "cinder-b6211de1-b2ec-4989-bf58-ae4bb9868c4f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:28 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1bfbf44e-9064-4f96-a9bb-fd710cccc41b tempest-CreateVolumesFromImageTest-1912033071 None] Acquiring lock "cinder-quobyte-b6211de1-b2ec-4989-bf58-ae4bb9868c4f" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:28 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1bfbf44e-9064-4f96-a9bb-fd710cccc41b tempest-CreateVolumesFromImageTest-1912033071 None] Lock "cinder-quobyte-b6211de1-b2ec-4989-bf58-ae4bb9868c4f" acquired by "delete_volume" :: waited 0.015s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:28 devstack sudo[104673]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c6dd2cfd-619f-4d40-b3a3-d6a49f6e9889 tempest-CreateVolumesFromImageTest-1912033071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.300s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:28 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-c6dd2cfd-619f-4d40-b3a3-d6a49f6e9889 tempest-CreateVolumesFromImageTest-1912033071 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:22:28 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-c6dd2cfd-619f-4d40-b3a3-d6a49f6e9889 tempest-CreateVolumesFromImageTest-1912033071 None] Deleted volume successfully.
Nov 06 17:22:28 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b7abd2-d343-449c-b750-ba8028480973]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:22:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1bfbf44e-9064-4f96-a9bb-fd710cccc41b tempest-CreateVolumesFromImageTest-1912033071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b6211de1-b2ec-4989-bf58-ae4bb9868c4f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:28 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c6dd2cfd-619f-4d40-b3a3-d6a49f6e9889 tempest-CreateVolumesFromImageTest-1912033071 None] Lock "cinder-0fb80b86-ef5d-4a5e-97d3-0c60f9489090-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:28 devstack sudo[104671]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4be864ef-37e4-46f6-bcb7-c0383acb8e90 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9ace20b-954f-477a-beb3-088b7634076d 1073741824" returned: 0 in 0.557s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:28 devstack sudo[104680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b6211de1-b2ec-4989-bf58-ae4bb9868c4f
Nov 06 17:22:28 devstack sudo[104680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4be864ef-37e4-46f6-bcb7-c0383acb8e90 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9ace20b-954f-477a-beb3-088b7634076d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:28 devstack sudo[104682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9ace20b-954f-477a-beb3-088b7634076d
Nov 06 17:22:28 devstack sudo[104682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:28 devstack sudo[104682]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4be864ef-37e4-46f6-bcb7-c0383acb8e90 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9ace20b-954f-477a-beb3-088b7634076d" returned: 0 in 0.268s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:28 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4be864ef-37e4-46f6-bcb7-c0383acb8e90 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:22:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4be864ef-37e4-46f6-bcb7-c0383acb8e90 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:28 devstack sudo[104680]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.071s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:28 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9466ace0-4bae-46cc-861f-85f7f215b03c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57cb1b1847a64db8a86923811113fffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:20Z,use_quota=True,user_id='a742c71f228042acb9f454060b261cbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(100939b4-59aa-4d31-99d8-cf194b77a8ef),volume_type_id=100939b4-59aa-4d31-99d8-cf194b77a8ef)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:22:28 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Creating volume 9466ace0-4bae-46cc-861f-85f7f215b03c {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:22:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:28 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:28 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:28 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:22:28 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:22:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9466ace0-4bae-46cc-861f-85f7f215b03c 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1bfbf44e-9064-4f96-a9bb-fd710cccc41b tempest-CreateVolumesFromImageTest-1912033071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b6211de1-b2ec-4989-bf58-ae4bb9868c4f" returned: 0 in 0.447s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1bfbf44e-9064-4f96-a9bb-fd710cccc41b tempest-CreateVolumesFromImageTest-1912033071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b6211de1-b2ec-4989-bf58-ae4bb9868c4f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:28 devstack sudo[104688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9466ace0-4bae-46cc-861f-85f7f215b03c 1073741824
Nov 06 17:22:28 devstack sudo[104688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:28 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4be864ef-37e4-46f6-bcb7-c0383acb8e90 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93299ed8-0e63-429d-8c08-d7a18f4ce30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9ace20b-954f-477a-beb3-088b7634076d', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:28 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4be864ef-37e4-46f6-bcb7-c0383acb8e90 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1365464f-c8cf-4591-8ec2-a512e7a3106b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:28 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-4be864ef-37e4-46f6-bcb7-c0383acb8e90 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Volume volume-f9ace20b-954f-477a-beb3-088b7634076d (f9ace20b-954f-477a-beb3-088b7634076d): created successfully
Nov 06 17:22:28 devstack sudo[104689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b6211de1-b2ec-4989-bf58-ae4bb9868c4f
Nov 06 17:22:28 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:28 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4be864ef-37e4-46f6-bcb7-c0383acb8e90 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1365464f-c8cf-4591-8ec2-a512e7a3106b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:28 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4be864ef-37e4-46f6-bcb7-c0383acb8e90 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Flow 'volume_create_manager' (12e13460-29bc-410b-82d8-c19d841d9137) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:28 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-4be864ef-37e4-46f6-bcb7-c0383acb8e90 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Created volume successfully.
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b24c6f7-fc4f-4b88-bc3f-dd63d5660bab tempest-CreateVolumesFromSnapshotTest-1490455522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3b24c6f7-fc4f-4b88-bc3f-dd63d5660bab tempest-CreateVolumesFromSnapshotTest-1490455522 None] Flow 'volume_create_manager' (9e6b1cde-4b47-4fc9-889c-1b4f2918c1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3b24c6f7-fc4f-4b88-bc3f-dd63d5660bab tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b035bc1a-aabf-4df9-993c-e5534456f219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3b24c6f7-fc4f-4b88-bc3f-dd63d5660bab tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b035bc1a-aabf-4df9-993c-e5534456f219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1631426012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f857917-12f2-4fbc-891d-9aacff363767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b370004be334cc79fcdf16a23d99fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:29Z,use_quota=True,user_id='f1820ef89e6a4e2e923396a6b57e59d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3b24c6f7-fc4f-4b88-bc3f-dd63d5660bab tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deec1e1e-bccb-4e2c-9909-21a75b3a0c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3b24c6f7-fc4f-4b88-bc3f-dd63d5660bab tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deec1e1e-bccb-4e2c-9909-21a75b3a0c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3b24c6f7-fc4f-4b88-bc3f-dd63d5660bab tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c95958-f4ea-45d1-9689-436f28237ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:29 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3b24c6f7-fc4f-4b88-bc3f-dd63d5660bab tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c95958-f4ea-45d1-9689-436f28237ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f857917-12f2-4fbc-891d-9aacff363767', 'volume_name': 'volume-6f857917-12f2-4fbc-891d-9aacff363767', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3b24c6f7-fc4f-4b88-bc3f-dd63d5660bab tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (655fef3d-5742-4374-a678-d3d4260f2502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3b24c6f7-fc4f-4b88-bc3f-dd63d5660bab tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (655fef3d-5742-4374-a678-d3d4260f2502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3b24c6f7-fc4f-4b88-bc3f-dd63d5660bab tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80278226-b825-4778-9c3c-3ff246823e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:29 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-3b24c6f7-fc4f-4b88-bc3f-dd63d5660bab tempest-CreateVolumesFromSnapshotTest-1490455522 None] Volume 6f857917-12f2-4fbc-891d-9aacff363767: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f857917-12f2-4fbc-891d-9aacff363767', 'volume_size': 1}
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3b24c6f7-fc4f-4b88-bc3f-dd63d5660bab tempest-CreateVolumesFromSnapshotTest-1490455522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-132494fd-c5a4-45c3-a5fd-f79e51c521ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Acquiring lock "cinder-f9ace20b-954f-477a-beb3-088b7634076d-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1bfbf44e-9064-4f96-a9bb-fd710cccc41b tempest-CreateVolumesFromImageTest-1912033071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b6211de1-b2ec-4989-bf58-ae4bb9868c4f" returned: 0 in 0.420s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1bfbf44e-9064-4f96-a9bb-fd710cccc41b tempest-CreateVolumesFromImageTest-1912033071 None] Lock "cinder-quobyte-b6211de1-b2ec-4989-bf58-ae4bb9868c4f" released by "delete_volume" :: held 0.934s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-132494fd-c5a4-45c3-a5fd-f79e51c521ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "cinder-f9ace20b-954f-477a-beb3-088b7634076d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-132494fd-c5a4-45c3-a5fd-f79e51c521ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Acquiring lock "cinder-quobyte-f9ace20b-954f-477a-beb3-088b7634076d" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-1bfbf44e-9064-4f96-a9bb-fd710cccc41b tempest-CreateVolumesFromImageTest-1912033071 None] Created reservations ['82d22002-769b-4017-bff0-1fc1f375cc3f', '079e1c45-0065-444d-a329-91f61e72938d', 'e22b56f2-c090-4f94-9acf-e3697cea48d5', 'd723ed85-8a30-418e-8d05-8c562a530cc9'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-132494fd-c5a4-45c3-a5fd-f79e51c521ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "cinder-quobyte-f9ace20b-954f-477a-beb3-088b7634076d" acquired by "delete_volume" :: waited 0.030s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[b417b53e-20b3-4086-8917-3cfdae2f43f5]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-132494fd-c5a4-45c3-a5fd-f79e51c521ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9ace20b-954f-477a-beb3-088b7634076d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:29 devstack sudo[104688]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9466ace0-4bae-46cc-861f-85f7f215b03c 1073741824" returned: 0 in 0.700s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1bfbf44e-9064-4f96-a9bb-fd710cccc41b tempest-CreateVolumesFromImageTest-1912033071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1bfbf44e-9064-4f96-a9bb-fd710cccc41b tempest-CreateVolumesFromImageTest-1912033071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1bfbf44e-9064-4f96-a9bb-fd710cccc41b tempest-CreateVolumesFromImageTest-1912033071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1bfbf44e-9064-4f96-a9bb-fd710cccc41b tempest-CreateVolumesFromImageTest-1912033071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1bfbf44e-9064-4f96-a9bb-fd710cccc41b tempest-CreateVolumesFromImageTest-1912033071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1bfbf44e-9064-4f96-a9bb-fd710cccc41b tempest-CreateVolumesFromImageTest-1912033071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9466ace0-4bae-46cc-861f-85f7f215b03c {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:29 devstack sudo[104697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9ace20b-954f-477a-beb3-088b7634076d
Nov 06 17:22:29 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:29 devstack sudo[104698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:22:29 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:29 devstack sudo[104701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9466ace0-4bae-46cc-861f-85f7f215b03c
Nov 06 17:22:29 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd711b17-db9c-45e2-aa11-74350c621fb2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bd711b17-db9c-45e2-aa11-74350c621fb2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Flow 'volume_create_manager' (d0bca658-5bd8-4dba-9d28-57975987c199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bd711b17-db9c-45e2-aa11-74350c621fb2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d51cdf92-9358-4129-b786-4ae6b7b3e486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bd711b17-db9c-45e2-aa11-74350c621fb2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d51cdf92-9358-4129-b786-4ae6b7b3e486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1096595209',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a64bb65-99bd-4654-b63a-47eab30bfdc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b370004be334cc79fcdf16a23d99fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:30Z,use_quota=True,user_id='f1820ef89e6a4e2e923396a6b57e59d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bd711b17-db9c-45e2-aa11-74350c621fb2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c32f14d0-c412-4735-af07-758870d8ebb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bd711b17-db9c-45e2-aa11-74350c621fb2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c32f14d0-c412-4735-af07-758870d8ebb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bd711b17-db9c-45e2-aa11-74350c621fb2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (112ce9d4-ecf2-4268-9f99-f0167ecc9490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bd711b17-db9c-45e2-aa11-74350c621fb2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (112ce9d4-ecf2-4268-9f99-f0167ecc9490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a64bb65-99bd-4654-b63a-47eab30bfdc3', 'volume_name': 'volume-1a64bb65-99bd-4654-b63a-47eab30bfdc3', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bd711b17-db9c-45e2-aa11-74350c621fb2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14273eba-4c70-4e44-8220-8acfe9d575b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bd711b17-db9c-45e2-aa11-74350c621fb2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14273eba-4c70-4e44-8220-8acfe9d575b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bd711b17-db9c-45e2-aa11-74350c621fb2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b74d17cc-059d-4023-9fd7-26db2bf529e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:29 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-bd711b17-db9c-45e2-aa11-74350c621fb2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Volume 1a64bb65-99bd-4654-b63a-47eab30bfdc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a64bb65-99bd-4654-b63a-47eab30bfdc3', 'volume_size': 1}
Nov 06 17:22:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bd711b17-db9c-45e2-aa11-74350c621fb2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:30 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:30 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-132494fd-c5a4-45c3-a5fd-f79e51c521ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9ace20b-954f-477a-beb3-088b7634076d" returned: 0 in 0.621s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-132494fd-c5a4-45c3-a5fd-f79e51c521ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9ace20b-954f-477a-beb3-088b7634076d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9466ace0-4bae-46cc-861f-85f7f215b03c" returned: 0 in 0.449s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:30 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] <== create_volume: return (1269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.274s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3b24c6f7-fc4f-4b88-bc3f-dd63d5660bab tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.839s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3b24c6f7-fc4f-4b88-bc3f-dd63d5660bab tempest-CreateVolumesFromSnapshotTest-1490455522 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1631426012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f857917-12f2-4fbc-891d-9aacff363767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b370004be334cc79fcdf16a23d99fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:29Z,use_quota=True,user_id='f1820ef89e6a4e2e923396a6b57e59d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-3b24c6f7-fc4f-4b88-bc3f-dd63d5660bab tempest-CreateVolumesFromSnapshotTest-1490455522 None] Creating volume 6f857917-12f2-4fbc-891d-9aacff363767 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3b24c6f7-fc4f-4b88-bc3f-dd63d5660bab tempest-CreateVolumesFromSnapshotTest-1490455522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3b24c6f7-fc4f-4b88-bc3f-dd63d5660bab tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3b24c6f7-fc4f-4b88-bc3f-dd63d5660bab tempest-CreateVolumesFromSnapshotTest-1490455522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:30 devstack sudo[104710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9ace20b-954f-477a-beb3-088b7634076d
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3b24c6f7-fc4f-4b88-bc3f-dd63d5660bab tempest-CreateVolumesFromSnapshotTest-1490455522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3b24c6f7-fc4f-4b88-bc3f-dd63d5660bab tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3b24c6f7-fc4f-4b88-bc3f-dd63d5660bab tempest-CreateVolumesFromSnapshotTest-1490455522 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:22:30 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:30 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-3b24c6f7-fc4f-4b88-bc3f-dd63d5660bab tempest-CreateVolumesFromSnapshotTest-1490455522 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3b24c6f7-fc4f-4b88-bc3f-dd63d5660bab tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6f857917-12f2-4fbc-891d-9aacff363767 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1bfbf44e-9064-4f96-a9bb-fd710cccc41b tempest-CreateVolumesFromImageTest-1912033071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.574s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-1bfbf44e-9064-4f96-a9bb-fd710cccc41b tempest-CreateVolumesFromImageTest-1912033071 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:22:30 devstack sudo[104712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6f857917-12f2-4fbc-891d-9aacff363767 1073741824
Nov 06 17:22:30 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:30 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-1bfbf44e-9064-4f96-a9bb-fd710cccc41b tempest-CreateVolumesFromImageTest-1912033071 None] Deleted volume successfully.
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG cinder.volume.volume_utils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Attempting download of aa95ee61-4aee-4c1a-a148-4f2195a25ba6 ((None, [{'url': 'file:///opt/stack/data/glance/images/aa95ee61-4aee-4c1a-a148-4f2195a25ba6', 'metadata': {}}])) to volume 9466ace0-4bae-46cc-861f-85f7f215b03c. {{(pid=86856) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-83d9fa5f-559b-4635-a2e6-bec9cb89a107 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-83d9fa5f-559b-4635-a2e6-bec9cb89a107 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Flow 'volume_create_manager' (48fc73ec-1560-418e-9029-b448a57fed86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-83d9fa5f-559b-4635-a2e6-bec9cb89a107 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be3c8635-f11c-433b-8079-9e6c73106fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-83d9fa5f-559b-4635-a2e6-bec9cb89a107 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be3c8635-f11c-433b-8079-9e6c73106fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-457293287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c9c3531-64cd-4741-bcd3-090369f8ed2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b370004be334cc79fcdf16a23d99fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:30Z,use_quota=True,user_id='f1820ef89e6a4e2e923396a6b57e59d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-83d9fa5f-559b-4635-a2e6-bec9cb89a107 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81f03dba-c613-498f-9c57-07706d4dfd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-83d9fa5f-559b-4635-a2e6-bec9cb89a107 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81f03dba-c613-498f-9c57-07706d4dfd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-83d9fa5f-559b-4635-a2e6-bec9cb89a107 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a093c255-5d79-4a37-8b2b-b77ed8e8b0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-83d9fa5f-559b-4635-a2e6-bec9cb89a107 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a093c255-5d79-4a37-8b2b-b77ed8e8b0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c9c3531-64cd-4741-bcd3-090369f8ed2b', 'volume_name': 'volume-8c9c3531-64cd-4741-bcd3-090369f8ed2b', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-83d9fa5f-559b-4635-a2e6-bec9cb89a107 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c372c16-2289-42a1-904a-704090103bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-83d9fa5f-559b-4635-a2e6-bec9cb89a107 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c372c16-2289-42a1-904a-704090103bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-83d9fa5f-559b-4635-a2e6-bec9cb89a107 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56e979f4-bb2c-41db-9b00-92d4789ab156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:30 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-83d9fa5f-559b-4635-a2e6-bec9cb89a107 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Volume 8c9c3531-64cd-4741-bcd3-090369f8ed2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c9c3531-64cd-4741-bcd3-090369f8ed2b', 'volume_size': 1}
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-83d9fa5f-559b-4635-a2e6-bec9cb89a107 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1bfbf44e-9064-4f96-a9bb-fd710cccc41b tempest-CreateVolumesFromImageTest-1912033071 None] Lock "cinder-b6211de1-b2ec-4989-bf58-ae4bb9868c4f-delete_volume" released by "delete_volume" :: held 2.055s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c354779-9b1c-410a-9c2e-2cd5d32e7828]: (4, 'raw') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa95ee61-4aee-4c1a-a148-4f2195a25ba6_k2uu513x {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:30 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-132494fd-c5a4-45c3-a5fd-f79e51c521ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f9ace20b-954f-477a-beb3-088b7634076d" returned: 0 in 0.458s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-132494fd-c5a4-45c3-a5fd-f79e51c521ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "cinder-quobyte-f9ace20b-954f-477a-beb3-088b7634076d" released by "delete_volume" :: held 1.175s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:30 devstack sudo[104715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa95ee61-4aee-4c1a-a148-4f2195a25ba6_k2uu513x
Nov 06 17:22:30 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-132494fd-c5a4-45c3-a5fd-f79e51c521ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Created reservations ['d7bc4206-d6b2-45b0-b5ac-b7fe87f0cce8', '412cd8f2-7177-42c0-a7b0-cba2d9542494', '39b6ab00-9762-4419-8414-e7a527ef04d3', '0df5afb8-830d-401c-82f2-974aa72be55b'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-132494fd-c5a4-45c3-a5fd-f79e51c521ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-132494fd-c5a4-45c3-a5fd-f79e51c521ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-132494fd-c5a4-45c3-a5fd-f79e51c521ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-132494fd-c5a4-45c3-a5fd-f79e51c521ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-132494fd-c5a4-45c3-a5fd-f79e51c521ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-132494fd-c5a4-45c3-a5fd-f79e51c521ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:30 devstack sudo[104720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:22:30 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:30 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3b24c6f7-fc4f-4b88-bc3f-dd63d5660bab tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6f857917-12f2-4fbc-891d-9aacff363767 1073741824" returned: 0 in 0.817s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:30 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa95ee61-4aee-4c1a-a148-4f2195a25ba6_k2uu513x" returned: 0 in 0.561s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa95ee61-4aee-4c1a-a148-4f2195a25ba6_k2uu513x {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:30 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-934d96a5-ce9d-4a2c-ab50-7b1b7d996ba6 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-934d96a5-ce9d-4a2c-ab50-7b1b7d996ba6 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Flow 'volume_create_manager' (c043793e-0fe8-4360-82f2-9cac3edf371d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-934d96a5-ce9d-4a2c-ab50-7b1b7d996ba6 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29e546a1-c58d-4299-b9d8-63252693b16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-934d96a5-ce9d-4a2c-ab50-7b1b7d996ba6 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29e546a1-c58d-4299-b9d8-63252693b16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-182892377',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d012fe6-da06-489c-a53d-f96844195fca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b370004be334cc79fcdf16a23d99fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:31Z,use_quota=True,user_id='f1820ef89e6a4e2e923396a6b57e59d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-934d96a5-ce9d-4a2c-ab50-7b1b7d996ba6 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e93a81a-c5ae-43e4-b43c-c8f21eb8d776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-934d96a5-ce9d-4a2c-ab50-7b1b7d996ba6 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e93a81a-c5ae-43e4-b43c-c8f21eb8d776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-934d96a5-ce9d-4a2c-ab50-7b1b7d996ba6 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1496b5cc-7cfa-4bbb-8c05-3ff80ef9d3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-934d96a5-ce9d-4a2c-ab50-7b1b7d996ba6 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1496b5cc-7cfa-4bbb-8c05-3ff80ef9d3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d012fe6-da06-489c-a53d-f96844195fca', 'volume_name': 'volume-1d012fe6-da06-489c-a53d-f96844195fca', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-934d96a5-ce9d-4a2c-ab50-7b1b7d996ba6 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84d4bcdc-439a-4948-bfd2-9d40b4a72272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-934d96a5-ce9d-4a2c-ab50-7b1b7d996ba6 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84d4bcdc-439a-4948-bfd2-9d40b4a72272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-934d96a5-ce9d-4a2c-ab50-7b1b7d996ba6 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5255a224-722c-44a4-bd20-0149307024db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:31 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-934d96a5-ce9d-4a2c-ab50-7b1b7d996ba6 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Volume 1d012fe6-da06-489c-a53d-f96844195fca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d012fe6-da06-489c-a53d-f96844195fca', 'volume_size': 1}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-934d96a5-ce9d-4a2c-ab50-7b1b7d996ba6 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3b24c6f7-fc4f-4b88-bc3f-dd63d5660bab tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6f857917-12f2-4fbc-891d-9aacff363767 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:31 devstack sudo[104725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa95ee61-4aee-4c1a-a148-4f2195a25ba6_k2uu513x
Nov 06 17:22:31 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:31 devstack sudo[104726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6f857917-12f2-4fbc-891d-9aacff363767
Nov 06 17:22:31 devstack sudo[104726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:31 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-132494fd-c5a4-45c3-a5fd-f79e51c521ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.451s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-132494fd-c5a4-45c3-a5fd-f79e51c521ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:22:31 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-132494fd-c5a4-45c3-a5fd-f79e51c521ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Deleted volume successfully.
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-132494fd-c5a4-45c3-a5fd-f79e51c521ca tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "cinder-f9ace20b-954f-477a-beb3-088b7634076d-delete_volume" released by "delete_volume" :: held 1.942s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb5209cd-3a06-499a-8639-bd56bc007f87 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cb5209cd-3a06-499a-8639-bd56bc007f87 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Flow 'volume_create_manager' (9082d404-0793-4cd5-9022-636e550aa9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cb5209cd-3a06-499a-8639-bd56bc007f87 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb3897b2-ed79-4a67-92bc-fd2dace53999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:31 devstack sudo[104726]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cb5209cd-3a06-499a-8639-bd56bc007f87 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb3897b2-ed79-4a67-92bc-fd2dace53999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-447114415',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fc5f213-944c-4e04-a341-3a5d6074c606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b370004be334cc79fcdf16a23d99fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:31Z,use_quota=True,user_id='f1820ef89e6a4e2e923396a6b57e59d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cb5209cd-3a06-499a-8639-bd56bc007f87 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (714c84d5-fc3d-490b-9d5a-e74528320e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cb5209cd-3a06-499a-8639-bd56bc007f87 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (714c84d5-fc3d-490b-9d5a-e74528320e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:31 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cb5209cd-3a06-499a-8639-bd56bc007f87 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80a1736a-7615-484c-8b7c-c8f68d2940cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cb5209cd-3a06-499a-8639-bd56bc007f87 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80a1736a-7615-484c-8b7c-c8f68d2940cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fc5f213-944c-4e04-a341-3a5d6074c606', 'volume_name': 'volume-6fc5f213-944c-4e04-a341-3a5d6074c606', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cb5209cd-3a06-499a-8639-bd56bc007f87 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1498368-c498-4255-ad89-6a5c009782ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cb5209cd-3a06-499a-8639-bd56bc007f87 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1498368-c498-4255-ad89-6a5c009782ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cb5209cd-3a06-499a-8639-bd56bc007f87 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a3e99e3-64e5-4aab-9315-e03b984f1a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:31 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-cb5209cd-3a06-499a-8639-bd56bc007f87 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Volume 6fc5f213-944c-4e04-a341-3a5d6074c606: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fc5f213-944c-4e04-a341-3a5d6074c606', 'volume_size': 1}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-cb5209cd-3a06-499a-8639-bd56bc007f87 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa95ee61-4aee-4c1a-a148-4f2195a25ba6_k2uu513x" returned: 1 in 0.557s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa95ee61-4aee-4c1a-a148-4f2195a25ba6_k2uu513x' failed. Not Retrying. {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3b24c6f7-fc4f-4b88-bc3f-dd63d5660bab tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6f857917-12f2-4fbc-891d-9aacff363767" returned: 0 in 0.401s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3b24c6f7-fc4f-4b88-bc3f-dd63d5660bab tempest-CreateVolumesFromSnapshotTest-1490455522 None] <== create_volume: return (1407ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3b24c6f7-fc4f-4b88-bc3f-dd63d5660bab tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.411s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d865efa-5288-4853-9040-49f404fb741e]: (4, 'raw') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bd711b17-db9c-45e2-aa11-74350c621fb2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.607s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bd711b17-db9c-45e2-aa11-74350c621fb2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1096595209',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a64bb65-99bd-4654-b63a-47eab30bfdc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b370004be334cc79fcdf16a23d99fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:30Z,use_quota=True,user_id='f1820ef89e6a4e2e923396a6b57e59d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-bd711b17-db9c-45e2-aa11-74350c621fb2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Creating volume 1a64bb65-99bd-4654-b63a-47eab30bfdc3 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bd711b17-db9c-45e2-aa11-74350c621fb2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bd711b17-db9c-45e2-aa11-74350c621fb2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bd711b17-db9c-45e2-aa11-74350c621fb2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bd711b17-db9c-45e2-aa11-74350c621fb2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bd711b17-db9c-45e2-aa11-74350c621fb2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bd711b17-db9c-45e2-aa11-74350c621fb2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:22:31 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-bd711b17-db9c-45e2-aa11-74350c621fb2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bd711b17-db9c-45e2-aa11-74350c621fb2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a64bb65-99bd-4654-b63a-47eab30bfdc3 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa95ee61-4aee-4c1a-a148-4f2195a25ba6_vzxv8nl7devstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:31 devstack sudo[104733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a64bb65-99bd-4654-b63a-47eab30bfdc3 1073741824
Nov 06 17:22:31 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3b24c6f7-fc4f-4b88-bc3f-dd63d5660bab tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80278226-b825-4778-9c3c-3ff246823e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f857917-12f2-4fbc-891d-9aacff363767', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3b24c6f7-fc4f-4b88-bc3f-dd63d5660bab tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01003833-6ea6-41f9-b024-a369f4558c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:31 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-3b24c6f7-fc4f-4b88-bc3f-dd63d5660bab tempest-CreateVolumesFromSnapshotTest-1490455522 None] Volume volume-6f857917-12f2-4fbc-891d-9aacff363767 (6f857917-12f2-4fbc-891d-9aacff363767): created successfully
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3b24c6f7-fc4f-4b88-bc3f-dd63d5660bab tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01003833-6ea6-41f9-b024-a369f4558c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3b24c6f7-fc4f-4b88-bc3f-dd63d5660bab tempest-CreateVolumesFromSnapshotTest-1490455522 None] Flow 'volume_create_manager' (9e6b1cde-4b47-4fc9-889c-1b4f2918c1de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:31 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-3b24c6f7-fc4f-4b88-bc3f-dd63d5660bab tempest-CreateVolumesFromSnapshotTest-1490455522 None] Created volume successfully.
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-2a5292de-7e8b-4d36-9c9e-eaf7d62a6265 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Acquiring lock "cinder-7034bddf-7db0-4c7f-a4f2-f2a410a00322-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-2a5292de-7e8b-4d36-9c9e-eaf7d62a6265 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "cinder-7034bddf-7db0-4c7f-a4f2-f2a410a00322-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:31 devstack sudo[104734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa95ee61-4aee-4c1a-a148-4f2195a25ba6_vzxv8nl7devstack@QuobyteHD
Nov 06 17:22:31 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-2a5292de-7e8b-4d36-9c9e-eaf7d62a6265 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Acquiring lock "cinder-quobyte-7034bddf-7db0-4c7f-a4f2-f2a410a00322" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-2a5292de-7e8b-4d36-9c9e-eaf7d62a6265 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "cinder-quobyte-7034bddf-7db0-4c7f-a4f2-f2a410a00322" acquired by "delete_volume" :: waited 0.040s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad53216-ebd3-433f-9cc5-525627f090df]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:22:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2a5292de-7e8b-4d36-9c9e-eaf7d62a6265 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7034bddf-7db0-4c7f-a4f2-f2a410a00322 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:32 devstack sudo[104743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7034bddf-7db0-4c7f-a4f2-f2a410a00322
Nov 06 17:22:32 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:32 devstack sudo[104743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa95ee61-4aee-4c1a-a148-4f2195a25ba6_vzxv8nl7devstack@QuobyteHD" returned: 0 in 0.638s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa95ee61-4aee-4c1a-a148-4f2195a25ba6_vzxv8nl7devstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:32 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bd711b17-db9c-45e2-aa11-74350c621fb2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a64bb65-99bd-4654-b63a-47eab30bfdc3 1073741824" returned: 0 in 0.732s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bd711b17-db9c-45e2-aa11-74350c621fb2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a64bb65-99bd-4654-b63a-47eab30bfdc3 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:32 devstack sudo[104749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa95ee61-4aee-4c1a-a148-4f2195a25ba6_vzxv8nl7devstack@QuobyteHD
Nov 06 17:22:32 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:32 devstack sudo[104750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a64bb65-99bd-4654-b63a-47eab30bfdc3
Nov 06 17:22:32 devstack sudo[104750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:32 devstack sudo[104743]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2a5292de-7e8b-4d36-9c9e-eaf7d62a6265 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7034bddf-7db0-4c7f-a4f2-f2a410a00322" returned: 0 in 0.609s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2a5292de-7e8b-4d36-9c9e-eaf7d62a6265 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7034bddf-7db0-4c7f-a4f2-f2a410a00322 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:32 devstack sudo[104757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7034bddf-7db0-4c7f-a4f2-f2a410a00322
Nov 06 17:22:32 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:32 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa95ee61-4aee-4c1a-a148-4f2195a25ba6_vzxv8nl7devstack@QuobyteHD" returned: 1 in 0.438s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa95ee61-4aee-4c1a-a148-4f2195a25ba6_vzxv8nl7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 17:22:32 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] aa95ee61-4aee-4c1a-a148-4f2195a25ba6 was raw, converting to qcow2 {{(pid=86856) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 06 17:22:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_aa95ee61-4aee-4c1a-a148-4f2195a25ba6_vzxv8nl7devstack@QuobyteHD /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9466ace0-4bae-46cc-861f-85f7f215b03c {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:32 devstack sudo[104750]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bd711b17-db9c-45e2-aa11-74350c621fb2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a64bb65-99bd-4654-b63a-47eab30bfdc3" returned: 0 in 0.340s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:32 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bd711b17-db9c-45e2-aa11-74350c621fb2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:22:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bd711b17-db9c-45e2-aa11-74350c621fb2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-83d9fa5f-559b-4635-a2e6-bec9cb89a107 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.299s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:32 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-83d9fa5f-559b-4635-a2e6-bec9cb89a107 tempest-CreateVolumesFromSnapshotTest-1490455522 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-457293287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c9c3531-64cd-4741-bcd3-090369f8ed2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b370004be334cc79fcdf16a23d99fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:30Z,use_quota=True,user_id='f1820ef89e6a4e2e923396a6b57e59d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:22:32 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-83d9fa5f-559b-4635-a2e6-bec9cb89a107 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Creating volume 8c9c3531-64cd-4741-bcd3-090369f8ed2b {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:22:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-83d9fa5f-559b-4635-a2e6-bec9cb89a107 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-83d9fa5f-559b-4635-a2e6-bec9cb89a107 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:32 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-83d9fa5f-559b-4635-a2e6-bec9cb89a107 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:32 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-83d9fa5f-559b-4635-a2e6-bec9cb89a107 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-83d9fa5f-559b-4635-a2e6-bec9cb89a107 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:32 devstack sudo[104762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_aa95ee61-4aee-4c1a-a148-4f2195a25ba6_vzxv8nl7devstack@QuobyteHD /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9466ace0-4bae-46cc-861f-85f7f215b03c
Nov 06 17:22:32 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:32 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-83d9fa5f-559b-4635-a2e6-bec9cb89a107 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:22:32 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-83d9fa5f-559b-4635-a2e6-bec9cb89a107 tempest-CreateVolumesFromSnapshotTest-1490455522 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:22:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-83d9fa5f-559b-4635-a2e6-bec9cb89a107 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8c9c3531-64cd-4741-bcd3-090369f8ed2b 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bd711b17-db9c-45e2-aa11-74350c621fb2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b74d17cc-059d-4023-9fd7-26db2bf529e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a64bb65-99bd-4654-b63a-47eab30bfdc3', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:32 devstack sudo[104764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8c9c3531-64cd-4741-bcd3-090369f8ed2b 1073741824
Nov 06 17:22:32 devstack sudo[104764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bd711b17-db9c-45e2-aa11-74350c621fb2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7159a3d1-1fe8-4bd0-8ef5-c8c42f0609de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:32 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-bd711b17-db9c-45e2-aa11-74350c621fb2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Volume volume-1a64bb65-99bd-4654-b63a-47eab30bfdc3 (1a64bb65-99bd-4654-b63a-47eab30bfdc3): created successfully
Nov 06 17:22:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bd711b17-db9c-45e2-aa11-74350c621fb2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7159a3d1-1fe8-4bd0-8ef5-c8c42f0609de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-bd711b17-db9c-45e2-aa11-74350c621fb2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Flow 'volume_create_manager' (d0bca658-5bd8-4dba-9d28-57975987c199) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:32 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-bd711b17-db9c-45e2-aa11-74350c621fb2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Created volume successfully.
Nov 06 17:22:32 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2a5292de-7e8b-4d36-9c9e-eaf7d62a6265 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7034bddf-7db0-4c7f-a4f2-f2a410a00322" returned: 0 in 0.342s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:32 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-2a5292de-7e8b-4d36-9c9e-eaf7d62a6265 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "cinder-quobyte-7034bddf-7db0-4c7f-a4f2-f2a410a00322" released by "delete_volume" :: held 1.028s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:32 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-2a5292de-7e8b-4d36-9c9e-eaf7d62a6265 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Created reservations ['cd54cb54-4874-4dd1-8153-1304255cc49e', '4ba7fe5d-fa5d-4e00-8a42-6c05a5c1f7d6', '253022c0-8f37-4c61-bd65-130b1a200bd1', '7494253b-c908-4591-9a7a-3b64a0d4d189'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2a5292de-7e8b-4d36-9c9e-eaf7d62a6265 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2a5292de-7e8b-4d36-9c9e-eaf7d62a6265 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-2a5292de-7e8b-4d36-9c9e-eaf7d62a6265 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-2a5292de-7e8b-4d36-9c9e-eaf7d62a6265 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2a5292de-7e8b-4d36-9c9e-eaf7d62a6265 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2a5292de-7e8b-4d36-9c9e-eaf7d62a6265 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:33 devstack sudo[104773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:22:33 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:33 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_aa95ee61-4aee-4c1a-a148-4f2195a25ba6_vzxv8nl7devstack@QuobyteHD /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9466ace0-4bae-46cc-861f-85f7f215b03c" returned: 0 in 0.572s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_aa95ee61-4aee-4c1a-a148-4f2195a25ba6_vzxv8nl7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9466ace0-4bae-46cc-861f-85f7f215b03c {{(pid=86856) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 17:22:33 devstack cinder-volume[86856]: INFO cinder.image.image_utils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Converted 0.00 MB image at 0.00 MB/s
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9466ace0-4bae-46cc-861f-85f7f215b03c 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:33 devstack sudo[104775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9466ace0-4bae-46cc-861f-85f7f215b03c 1G
Nov 06 17:22:33 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:33 devstack sudo[104764]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-83d9fa5f-559b-4635-a2e6-bec9cb89a107 tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8c9c3531-64cd-4741-bcd3-090369f8ed2b 1073741824" returned: 0 in 0.612s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-83d9fa5f-559b-4635-a2e6-bec9cb89a107 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8c9c3531-64cd-4741-bcd3-090369f8ed2b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:33 devstack sudo[104779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8c9c3531-64cd-4741-bcd3-090369f8ed2b
Nov 06 17:22:33 devstack sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:33 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2a5292de-7e8b-4d36-9c9e-eaf7d62a6265 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.333s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-2a5292de-7e8b-4d36-9c9e-eaf7d62a6265 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:22:33 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-2a5292de-7e8b-4d36-9c9e-eaf7d62a6265 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Deleted volume successfully.
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-2a5292de-7e8b-4d36-9c9e-eaf7d62a6265 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "cinder-7034bddf-7db0-4c7f-a4f2-f2a410a00322-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:33 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9466ace0-4bae-46cc-861f-85f7f215b03c 1G" returned: 0 in 0.400s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG cinder.volume.volume_utils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Downloaded image aa95ee61-4aee-4c1a-a148-4f2195a25ba6 ((None, [{'url': 'file:///opt/stack/data/glance/images/aa95ee61-4aee-4c1a-a148-4f2195a25ba6', 'metadata': {}}])) to volume 9466ace0-4bae-46cc-861f-85f7f215b03c successfully. {{(pid=86856) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Temporary image aa95ee61-4aee-4c1a-a148-4f2195a25ba6 for user a742c71f228042acb9f454060b261cbe is deleted. {{(pid=86856) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG cinder.volume.volume_utils [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Marking volume 9466ace0-4bae-46cc-861f-85f7f215b03c as bootable. {{(pid=86856) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Copying metadata from image aa95ee61-4aee-4c1a-a148-4f2195a25ba6 to 9466ace0-4bae-46cc-861f-85f7f215b03c. {{(pid=86856) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Creating volume glance metadata for volume 9466ace0-4bae-46cc-861f-85f7f215b03c backed by image aa95ee61-4aee-4c1a-a148-4f2195a25ba6 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'aa95ee61-4aee-4c1a-a148-4f2195a25ba6', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '23fb3cce86f2768348eb1b0c9685b104', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86856) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 06 17:22:33 devstack sudo[104779]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-83d9fa5f-559b-4635-a2e6-bec9cb89a107 tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8c9c3531-64cd-4741-bcd3-090369f8ed2b" returned: 0 in 0.313s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-83d9fa5f-559b-4635-a2e6-bec9cb89a107 tempest-CreateVolumesFromSnapshotTest-1490455522 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-83d9fa5f-559b-4635-a2e6-bec9cb89a107 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-934d96a5-ce9d-4a2c-ab50-7b1b7d996ba6 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.544s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-934d96a5-ce9d-4a2c-ab50-7b1b7d996ba6 tempest-CreateVolumesFromSnapshotTest-1490455522 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-182892377',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d012fe6-da06-489c-a53d-f96844195fca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b370004be334cc79fcdf16a23d99fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:31Z,use_quota=True,user_id='f1820ef89e6a4e2e923396a6b57e59d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-934d96a5-ce9d-4a2c-ab50-7b1b7d996ba6 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Creating volume 1d012fe6-da06-489c-a53d-f96844195fca {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-934d96a5-ce9d-4a2c-ab50-7b1b7d996ba6 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-934d96a5-ce9d-4a2c-ab50-7b1b7d996ba6 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-934d96a5-ce9d-4a2c-ab50-7b1b7d996ba6 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-934d96a5-ce9d-4a2c-ab50-7b1b7d996ba6 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-934d96a5-ce9d-4a2c-ab50-7b1b7d996ba6 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-934d96a5-ce9d-4a2c-ab50-7b1b7d996ba6 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:22:33 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-934d96a5-ce9d-4a2c-ab50-7b1b7d996ba6 tempest-CreateVolumesFromSnapshotTest-1490455522 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-934d96a5-ce9d-4a2c-ab50-7b1b7d996ba6 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d012fe6-da06-489c-a53d-f96844195fca 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:33 devstack sudo[104786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d012fe6-da06-489c-a53d-f96844195fca 1073741824
Nov 06 17:22:33 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-83d9fa5f-559b-4635-a2e6-bec9cb89a107 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56e979f4-bb2c-41db-9b00-92d4789ab156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c9c3531-64cd-4741-bcd3-090369f8ed2b', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-83d9fa5f-559b-4635-a2e6-bec9cb89a107 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d106d95e-e8da-4094-9b43-2d76311521a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:33 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-83d9fa5f-559b-4635-a2e6-bec9cb89a107 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Volume volume-8c9c3531-64cd-4741-bcd3-090369f8ed2b (8c9c3531-64cd-4741-bcd3-090369f8ed2b): created successfully
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-83d9fa5f-559b-4635-a2e6-bec9cb89a107 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d106d95e-e8da-4094-9b43-2d76311521a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-83d9fa5f-559b-4635-a2e6-bec9cb89a107 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Flow 'volume_create_manager' (48fc73ec-1560-418e-9029-b448a57fed86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:33 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-83d9fa5f-559b-4635-a2e6-bec9cb89a107 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Created volume successfully.
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adff9033-85f0-464b-8aee-a2e53493bf70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9466ace0-4bae-46cc-861f-85f7f215b03c', 'volume_size': 1, 'image_id': 'aa95ee61-4aee-4c1a-a148-4f2195a25ba6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa95ee61-4aee-4c1a-a148-4f2195a25ba6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '23fb3cce86f2768348eb1b0c9685b104', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '57cb1b1847a64db8a86923811113fffc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4ce634667a3faae6e3dfd07ff73493841d6899be9c62d51420ca738daa7286f19bb1e5eda661af04e4bfb360b7c2bad1714ce2f583c2ca13809a2798f29fd385', 'id': 'aa95ee61-4aee-4c1a-a148-4f2195a25ba6', 'created_at': datetime.datetime(2026, 11, 6, 16, 22, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 16, 22, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa95ee61-4aee-4c1a-a148-4f2195a25ba6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x71da66ddfaa0>}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb494205-4695-43c1-80a9-15020aac8aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:33 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Volume volume-9466ace0-4bae-46cc-861f-85f7f215b03c (9466ace0-4bae-46cc-861f-85f7f215b03c): created successfully
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb494205-4695-43c1-80a9-15020aac8aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:33 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Flow 'volume_create_manager' (bca27152-d672-4227-8403-4df8481dd7e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:33 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-947fea92-b76b-4950-ba83-52afa30ee962 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Created volume successfully.
Nov 06 17:22:34 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-6faf1c8d-a910-457f-a1b3-7e714966a3cb tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Acquiring lock "cinder-e7d7d638-c0f8-4e73-9cb4-9976d827d113-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:34 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-6faf1c8d-a910-457f-a1b3-7e714966a3cb tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "cinder-e7d7d638-c0f8-4e73-9cb4-9976d827d113-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:34 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-6faf1c8d-a910-457f-a1b3-7e714966a3cb tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Acquiring lock "cinder-quobyte-e7d7d638-c0f8-4e73-9cb4-9976d827d113" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:34 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-6faf1c8d-a910-457f-a1b3-7e714966a3cb tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "cinder-quobyte-e7d7d638-c0f8-4e73-9cb4-9976d827d113" acquired by "delete_volume" :: waited 0.034s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:34 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2cd7e8-aaa8-4e75-afe6-f8933e02b0d0]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:22:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6faf1c8d-a910-457f-a1b3-7e714966a3cb tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e7d7d638-c0f8-4e73-9cb4-9976d827d113 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:34 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-934d96a5-ce9d-4a2c-ab50-7b1b7d996ba6 tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d012fe6-da06-489c-a53d-f96844195fca 1073741824" returned: 0 in 0.559s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-934d96a5-ce9d-4a2c-ab50-7b1b7d996ba6 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d012fe6-da06-489c-a53d-f96844195fca {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:34 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5f0cfa78-2e37-4563-bc0f-125c7847ea05 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Acquiring lock "cinder-9466ace0-4bae-46cc-861f-85f7f215b03c-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:34 devstack sudo[104793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d012fe6-da06-489c-a53d-f96844195fca
Nov 06 17:22:34 devstack sudo[104793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:34 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5f0cfa78-2e37-4563-bc0f-125c7847ea05 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Lock "cinder-9466ace0-4bae-46cc-861f-85f7f215b03c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:34 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5f0cfa78-2e37-4563-bc0f-125c7847ea05 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Acquiring lock "cinder-quobyte-9466ace0-4bae-46cc-861f-85f7f215b03c" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:34 devstack sudo[104792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e7d7d638-c0f8-4e73-9cb4-9976d827d113
Nov 06 17:22:34 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:34 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5f0cfa78-2e37-4563-bc0f-125c7847ea05 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Lock "cinder-quobyte-9466ace0-4bae-46cc-861f-85f7f215b03c" acquired by "delete_volume" :: waited 0.034s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:34 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[1313eb67-7c03-4d3d-8128-1a998c8bc8b3]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:22:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5f0cfa78-2e37-4563-bc0f-125c7847ea05 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9466ace0-4bae-46cc-861f-85f7f215b03c {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:34 devstack sudo[104793]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-934d96a5-ce9d-4a2c-ab50-7b1b7d996ba6 tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d012fe6-da06-489c-a53d-f96844195fca" returned: 0 in 0.286s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-934d96a5-ce9d-4a2c-ab50-7b1b7d996ba6 tempest-CreateVolumesFromSnapshotTest-1490455522 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:22:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-934d96a5-ce9d-4a2c-ab50-7b1b7d996ba6 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-cb5209cd-3a06-499a-8639-bd56bc007f87 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.032s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-cb5209cd-3a06-499a-8639-bd56bc007f87 tempest-CreateVolumesFromSnapshotTest-1490455522 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-447114415',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fc5f213-944c-4e04-a341-3a5d6074c606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b370004be334cc79fcdf16a23d99fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:31Z,use_quota=True,user_id='f1820ef89e6a4e2e923396a6b57e59d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:22:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-cb5209cd-3a06-499a-8639-bd56bc007f87 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Creating volume 6fc5f213-944c-4e04-a341-3a5d6074c606 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:22:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-cb5209cd-3a06-499a-8639-bd56bc007f87 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-cb5209cd-3a06-499a-8639-bd56bc007f87 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-cb5209cd-3a06-499a-8639-bd56bc007f87 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-cb5209cd-3a06-499a-8639-bd56bc007f87 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-cb5209cd-3a06-499a-8639-bd56bc007f87 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-cb5209cd-3a06-499a-8639-bd56bc007f87 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:22:34 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-cb5209cd-3a06-499a-8639-bd56bc007f87 tempest-CreateVolumesFromSnapshotTest-1490455522 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:22:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cb5209cd-3a06-499a-8639-bd56bc007f87 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6fc5f213-944c-4e04-a341-3a5d6074c606 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:34 devstack sudo[104798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6fc5f213-944c-4e04-a341-3a5d6074c606 1073741824
Nov 06 17:22:34 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:34 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-934d96a5-ce9d-4a2c-ab50-7b1b7d996ba6 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5255a224-722c-44a4-bd20-0149307024db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d012fe6-da06-489c-a53d-f96844195fca', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:34 devstack sudo[104796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9466ace0-4bae-46cc-861f-85f7f215b03c
Nov 06 17:22:34 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:34 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-934d96a5-ce9d-4a2c-ab50-7b1b7d996ba6 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6d76566-e372-4214-8455-420ef40440c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:34 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-934d96a5-ce9d-4a2c-ab50-7b1b7d996ba6 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Volume volume-1d012fe6-da06-489c-a53d-f96844195fca (1d012fe6-da06-489c-a53d-f96844195fca): created successfully
Nov 06 17:22:34 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-934d96a5-ce9d-4a2c-ab50-7b1b7d996ba6 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6d76566-e372-4214-8455-420ef40440c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:34 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-934d96a5-ce9d-4a2c-ab50-7b1b7d996ba6 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Flow 'volume_create_manager' (c043793e-0fe8-4360-82f2-9cac3edf371d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:34 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-934d96a5-ce9d-4a2c-ab50-7b1b7d996ba6 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Created volume successfully.
Nov 06 17:22:34 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6faf1c8d-a910-457f-a1b3-7e714966a3cb tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e7d7d638-c0f8-4e73-9cb4-9976d827d113" returned: 0 in 0.598s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6faf1c8d-a910-457f-a1b3-7e714966a3cb tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e7d7d638-c0f8-4e73-9cb4-9976d827d113 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:34 devstack sudo[104804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e7d7d638-c0f8-4e73-9cb4-9976d827d113
Nov 06 17:22:34 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:34 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5f0cfa78-2e37-4563-bc0f-125c7847ea05 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9466ace0-4bae-46cc-861f-85f7f215b03c" returned: 0 in 0.541s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5f0cfa78-2e37-4563-bc0f-125c7847ea05 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9466ace0-4bae-46cc-861f-85f7f215b03c {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:35 devstack sudo[104812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9466ace0-4bae-46cc-861f-85f7f215b03c
Nov 06 17:22:35 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:35 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6faf1c8d-a910-457f-a1b3-7e714966a3cb tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e7d7d638-c0f8-4e73-9cb4-9976d827d113" returned: 0 in 0.333s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:35 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cb5209cd-3a06-499a-8639-bd56bc007f87 tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6fc5f213-944c-4e04-a341-3a5d6074c606 1073741824" returned: 0 in 0.581s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:35 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-6faf1c8d-a910-457f-a1b3-7e714966a3cb tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "cinder-quobyte-e7d7d638-c0f8-4e73-9cb4-9976d827d113" released by "delete_volume" :: held 0.991s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cb5209cd-3a06-499a-8639-bd56bc007f87 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6fc5f213-944c-4e04-a341-3a5d6074c606 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:35 devstack sudo[104816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6fc5f213-944c-4e04-a341-3a5d6074c606
Nov 06 17:22:35 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:35 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-6faf1c8d-a910-457f-a1b3-7e714966a3cb tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Created reservations ['30370995-f326-453b-9ad2-fd4d813627eb', 'c0f4c7ad-9a53-4ee1-b5f1-5b968ef72381', '17d84573-53db-4f3b-9c20-94aa40383749', '64c4d612-aad3-45fe-a733-3e00a3a6b46e'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:22:35 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5f0cfa78-2e37-4563-bc0f-125c7847ea05 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9466ace0-4bae-46cc-861f-85f7f215b03c" returned: 0 in 0.315s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:35 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5f0cfa78-2e37-4563-bc0f-125c7847ea05 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Lock "cinder-quobyte-9466ace0-4bae-46cc-861f-85f7f215b03c" released by "delete_volume" :: held 0.935s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6faf1c8d-a910-457f-a1b3-7e714966a3cb tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6faf1c8d-a910-457f-a1b3-7e714966a3cb tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-6faf1c8d-a910-457f-a1b3-7e714966a3cb tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-6faf1c8d-a910-457f-a1b3-7e714966a3cb tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6faf1c8d-a910-457f-a1b3-7e714966a3cb tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6faf1c8d-a910-457f-a1b3-7e714966a3cb tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:35 devstack sudo[104819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:22:35 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-5f0cfa78-2e37-4563-bc0f-125c7847ea05 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Created reservations ['e6c045b3-e41e-4034-91ea-53e580c462c4', 'dd8dda6d-33af-4b5a-b3fa-18b1b3e10700', 'd7db2c16-5601-42a6-85ba-e2bdd2de4c3d', 'd11e1ac3-6c12-4a8c-b75b-63688021672c'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:22:35 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5f0cfa78-2e37-4563-bc0f-125c7847ea05 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5f0cfa78-2e37-4563-bc0f-125c7847ea05 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5f0cfa78-2e37-4563-bc0f-125c7847ea05 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5f0cfa78-2e37-4563-bc0f-125c7847ea05 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5f0cfa78-2e37-4563-bc0f-125c7847ea05 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5f0cfa78-2e37-4563-bc0f-125c7847ea05 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:35 devstack sudo[104822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:22:35 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:35 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cb5209cd-3a06-499a-8639-bd56bc007f87 tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6fc5f213-944c-4e04-a341-3a5d6074c606" returned: 0 in 0.382s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-cb5209cd-3a06-499a-8639-bd56bc007f87 tempest-CreateVolumesFromSnapshotTest-1490455522 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:22:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-cb5209cd-3a06-499a-8639-bd56bc007f87 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:35 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cb5209cd-3a06-499a-8639-bd56bc007f87 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a3e99e3-64e5-4aab-9315-e03b984f1a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fc5f213-944c-4e04-a341-3a5d6074c606', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:35 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cb5209cd-3a06-499a-8639-bd56bc007f87 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9b85530-54a0-4be7-9f6d-a35f17916551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:35 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-cb5209cd-3a06-499a-8639-bd56bc007f87 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Volume volume-6fc5f213-944c-4e04-a341-3a5d6074c606 (6fc5f213-944c-4e04-a341-3a5d6074c606): created successfully
Nov 06 17:22:35 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cb5209cd-3a06-499a-8639-bd56bc007f87 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9b85530-54a0-4be7-9f6d-a35f17916551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:35 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-cb5209cd-3a06-499a-8639-bd56bc007f87 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Flow 'volume_create_manager' (9082d404-0793-4cd5-9022-636e550aa9f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:35 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-cb5209cd-3a06-499a-8639-bd56bc007f87 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Created volume successfully.
Nov 06 17:22:35 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6faf1c8d-a910-457f-a1b3-7e714966a3cb tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.342s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:35 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-6faf1c8d-a910-457f-a1b3-7e714966a3cb tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:22:35 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-6faf1c8d-a910-457f-a1b3-7e714966a3cb tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Deleted volume successfully.
Nov 06 17:22:35 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-6faf1c8d-a910-457f-a1b3-7e714966a3cb tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "cinder-e7d7d638-c0f8-4e73-9cb4-9976d827d113-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:35 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5f0cfa78-2e37-4563-bc0f-125c7847ea05 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.302s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:35 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-5f0cfa78-2e37-4563-bc0f-125c7847ea05 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:22:35 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-5f0cfa78-2e37-4563-bc0f-125c7847ea05 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Deleted volume successfully.
Nov 06 17:22:35 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5f0cfa78-2e37-4563-bc0f-125c7847ea05 tempest-VolumeAndVolumeTypeFromImageTest-1398504981 None] Lock "cinder-9466ace0-4bae-46cc-861f-85f7f215b03c-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:36 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1f28257b-11e9-427a-8fe1-d30c0f354e57 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Acquiring lock "cinder-6fc5f213-944c-4e04-a341-3a5d6074c606-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:36 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1f28257b-11e9-427a-8fe1-d30c0f354e57 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "cinder-6fc5f213-944c-4e04-a341-3a5d6074c606-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:36 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1f28257b-11e9-427a-8fe1-d30c0f354e57 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Acquiring lock "cinder-quobyte-6fc5f213-944c-4e04-a341-3a5d6074c606" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:36 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1f28257b-11e9-427a-8fe1-d30c0f354e57 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "cinder-quobyte-6fc5f213-944c-4e04-a341-3a5d6074c606" acquired by "delete_volume" :: waited 0.034s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:36 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[b049cb1e-8000-43c2-a2e5-f893b18f4515]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:22:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1f28257b-11e9-427a-8fe1-d30c0f354e57 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6fc5f213-944c-4e04-a341-3a5d6074c606 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:36 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-60300585-27af-44ef-8529-6b80185759ab tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Acquiring lock "cinder-86e5c615-4b00-49ee-a13f-bdbd9793d414-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:36 devstack sudo[104826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6fc5f213-944c-4e04-a341-3a5d6074c606
Nov 06 17:22:36 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:36 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-60300585-27af-44ef-8529-6b80185759ab tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "cinder-86e5c615-4b00-49ee-a13f-bdbd9793d414-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:36 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-60300585-27af-44ef-8529-6b80185759ab tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Acquiring lock "cinder-quobyte-86e5c615-4b00-49ee-a13f-bdbd9793d414" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:36 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-60300585-27af-44ef-8529-6b80185759ab tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "cinder-quobyte-86e5c615-4b00-49ee-a13f-bdbd9793d414" acquired by "delete_volume" :: waited 0.018s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:36 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[38392902-435d-470c-95ee-8e367c67e036]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:22:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-60300585-27af-44ef-8529-6b80185759ab tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-86e5c615-4b00-49ee-a13f-bdbd9793d414 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:36 devstack sudo[104828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-86e5c615-4b00-49ee-a13f-bdbd9793d414
Nov 06 17:22:36 devstack sudo[104828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:36 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1f28257b-11e9-427a-8fe1-d30c0f354e57 tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6fc5f213-944c-4e04-a341-3a5d6074c606" returned: 0 in 0.495s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1f28257b-11e9-427a-8fe1-d30c0f354e57 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6fc5f213-944c-4e04-a341-3a5d6074c606 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:36 devstack sudo[104834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6fc5f213-944c-4e04-a341-3a5d6074c606
Nov 06 17:22:36 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:36 devstack sudo[104828]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-60300585-27af-44ef-8529-6b80185759ab tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-86e5c615-4b00-49ee-a13f-bdbd9793d414" returned: 0 in 0.422s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-60300585-27af-44ef-8529-6b80185759ab tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-86e5c615-4b00-49ee-a13f-bdbd9793d414 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:36 devstack sudo[104839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-86e5c615-4b00-49ee-a13f-bdbd9793d414
Nov 06 17:22:36 devstack sudo[104839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:37 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1f28257b-11e9-427a-8fe1-d30c0f354e57 tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6fc5f213-944c-4e04-a341-3a5d6074c606" returned: 0 in 0.341s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1f28257b-11e9-427a-8fe1-d30c0f354e57 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "cinder-quobyte-6fc5f213-944c-4e04-a341-3a5d6074c606" released by "delete_volume" :: held 0.896s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:37 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-1f28257b-11e9-427a-8fe1-d30c0f354e57 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Created reservations ['e38832a7-8572-478b-b6ac-b0487ca7c84c', 'f585d1c8-43a0-42e8-b2bd-dd27e1669f4a', 'a5616710-c32f-4b83-b230-659284f3812d', '08a5884f-7d3c-41dc-ad34-75a692832382'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:22:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1f28257b-11e9-427a-8fe1-d30c0f354e57 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1f28257b-11e9-427a-8fe1-d30c0f354e57 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:37 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1f28257b-11e9-427a-8fe1-d30c0f354e57 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:37 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1f28257b-11e9-427a-8fe1-d30c0f354e57 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1f28257b-11e9-427a-8fe1-d30c0f354e57 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1f28257b-11e9-427a-8fe1-d30c0f354e57 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:37 devstack sudo[104839]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-60300585-27af-44ef-8529-6b80185759ab tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-86e5c615-4b00-49ee-a13f-bdbd9793d414" returned: 0 in 0.322s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:37 devstack sudo[104843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:22:37 devstack sudo[104843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-60300585-27af-44ef-8529-6b80185759ab tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "cinder-quobyte-86e5c615-4b00-49ee-a13f-bdbd9793d414" released by "delete_volume" :: held 0.817s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a7b7a4b2-f020-4d37-8b4e-d8c1a17e66e2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Acquiring lock "cinder-1d012fe6-da06-489c-a53d-f96844195fca-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a7b7a4b2-f020-4d37-8b4e-d8c1a17e66e2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "cinder-1d012fe6-da06-489c-a53d-f96844195fca-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:37 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-60300585-27af-44ef-8529-6b80185759ab tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Created reservations ['7974b2d4-f81e-4f9b-9904-679d5ac9a7c1', 'af126ad1-0620-431d-89e1-1d047e84cb22', 'a9fae1c8-ca2c-4b99-8507-2bdeb2ad1519', 'c2125b86-cd69-4286-be1d-989157fc334b'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:22:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a7b7a4b2-f020-4d37-8b4e-d8c1a17e66e2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Acquiring lock "cinder-quobyte-1d012fe6-da06-489c-a53d-f96844195fca" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a7b7a4b2-f020-4d37-8b4e-d8c1a17e66e2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "cinder-quobyte-1d012fe6-da06-489c-a53d-f96844195fca" acquired by "delete_volume" :: waited 0.035s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:37 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[b516ae5b-55f6-4684-baf6-c20b9c3a51d1]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:22:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a7b7a4b2-f020-4d37-8b4e-d8c1a17e66e2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d012fe6-da06-489c-a53d-f96844195fca {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:37 devstack sudo[104843]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1f28257b-11e9-427a-8fe1-d30c0f354e57 tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.362s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:37 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-1f28257b-11e9-427a-8fe1-d30c0f354e57 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:22:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-60300585-27af-44ef-8529-6b80185759ab tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-60300585-27af-44ef-8529-6b80185759ab tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:37 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-60300585-27af-44ef-8529-6b80185759ab tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:37 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-60300585-27af-44ef-8529-6b80185759ab tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-60300585-27af-44ef-8529-6b80185759ab tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-60300585-27af-44ef-8529-6b80185759ab tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-db3662c5-9c5d-4878-8889-96fd2ed1cf7d tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Acquiring lock "cinder-b851a049-d6ad-45d1-9633-566e1e4af273-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:37 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-1f28257b-11e9-427a-8fe1-d30c0f354e57 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Deleted volume successfully.
Nov 06 17:22:37 devstack sudo[104847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:22:37 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-db3662c5-9c5d-4878-8889-96fd2ed1cf7d tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "cinder-b851a049-d6ad-45d1-9633-566e1e4af273-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1f28257b-11e9-427a-8fe1-d30c0f354e57 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "cinder-6fc5f213-944c-4e04-a341-3a5d6074c606-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:37 devstack sudo[104846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d012fe6-da06-489c-a53d-f96844195fca
Nov 06 17:22:37 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-db3662c5-9c5d-4878-8889-96fd2ed1cf7d tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Acquiring lock "cinder-quobyte-b851a049-d6ad-45d1-9633-566e1e4af273" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-db3662c5-9c5d-4878-8889-96fd2ed1cf7d tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "cinder-quobyte-b851a049-d6ad-45d1-9633-566e1e4af273" acquired by "delete_volume" :: waited 0.026s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:37 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb512206-4c9a-436a-9168-ed19e204f43d]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:22:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-db3662c5-9c5d-4878-8889-96fd2ed1cf7d tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b851a049-d6ad-45d1-9633-566e1e4af273 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:37 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-60300585-27af-44ef-8529-6b80185759ab tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.359s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:38 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-60300585-27af-44ef-8529-6b80185759ab tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:22:38 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-60300585-27af-44ef-8529-6b80185759ab tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Deleted volume successfully.
Nov 06 17:22:38 devstack sudo[104850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b851a049-d6ad-45d1-9633-566e1e4af273
Nov 06 17:22:38 devstack sudo[104850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:38 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-60300585-27af-44ef-8529-6b80185759ab tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "cinder-86e5c615-4b00-49ee-a13f-bdbd9793d414-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:38 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a7b7a4b2-f020-4d37-8b4e-d8c1a17e66e2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d012fe6-da06-489c-a53d-f96844195fca" returned: 0 in 0.582s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a7b7a4b2-f020-4d37-8b4e-d8c1a17e66e2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d012fe6-da06-489c-a53d-f96844195fca {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:38 devstack sudo[104856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d012fe6-da06-489c-a53d-f96844195fca
Nov 06 17:22:38 devstack sudo[104856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:38 devstack sudo[104850]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-db3662c5-9c5d-4878-8889-96fd2ed1cf7d tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b851a049-d6ad-45d1-9633-566e1e4af273" returned: 0 in 0.484s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-db3662c5-9c5d-4878-8889-96fd2ed1cf7d tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b851a049-d6ad-45d1-9633-566e1e4af273 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:38 devstack sudo[104861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b851a049-d6ad-45d1-9633-566e1e4af273
Nov 06 17:22:38 devstack sudo[104861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:38 devstack sudo[104856]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a7b7a4b2-f020-4d37-8b4e-d8c1a17e66e2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d012fe6-da06-489c-a53d-f96844195fca" returned: 0 in 0.334s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:38 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a7b7a4b2-f020-4d37-8b4e-d8c1a17e66e2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "cinder-quobyte-1d012fe6-da06-489c-a53d-f96844195fca" released by "delete_volume" :: held 1.005s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:38 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-a7b7a4b2-f020-4d37-8b4e-d8c1a17e66e2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Created reservations ['b2a36e34-ac28-49f2-8c86-d6b0370bef8e', '1d95b560-72d2-4da1-ac5d-00c9402dc80e', 'ab2145b4-7cff-436a-a177-1f5ba8e5f647', 'c4d56ac2-d086-4130-a45b-377fb8747648'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:22:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a7b7a4b2-f020-4d37-8b4e-d8c1a17e66e2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a7b7a4b2-f020-4d37-8b4e-d8c1a17e66e2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:38 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a7b7a4b2-f020-4d37-8b4e-d8c1a17e66e2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:38 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a7b7a4b2-f020-4d37-8b4e-d8c1a17e66e2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a7b7a4b2-f020-4d37-8b4e-d8c1a17e66e2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a7b7a4b2-f020-4d37-8b4e-d8c1a17e66e2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:38 devstack sudo[104861]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-db3662c5-9c5d-4878-8889-96fd2ed1cf7d tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b851a049-d6ad-45d1-9633-566e1e4af273" returned: 0 in 0.389s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:38 devstack sudo[104865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:22:38 devstack sudo[104865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:38 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-db3662c5-9c5d-4878-8889-96fd2ed1cf7d tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "cinder-quobyte-b851a049-d6ad-45d1-9633-566e1e4af273" released by "delete_volume" :: held 0.941s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:38 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-db3662c5-9c5d-4878-8889-96fd2ed1cf7d tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Created reservations ['c8319584-aabf-4ef3-9d36-50a47d625f05', '7de23bf6-18ef-42b8-84ff-28ff82fcd7bf', '10e23af3-34ff-4a61-8f57-d36cfda28fe0', 'c8fe409e-3eb6-4436-9728-e80e33d00d3e'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:22:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-db3662c5-9c5d-4878-8889-96fd2ed1cf7d tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-db3662c5-9c5d-4878-8889-96fd2ed1cf7d tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:38 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-db3662c5-9c5d-4878-8889-96fd2ed1cf7d tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:38 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-db3662c5-9c5d-4878-8889-96fd2ed1cf7d tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-db3662c5-9c5d-4878-8889-96fd2ed1cf7d tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-db3662c5-9c5d-4878-8889-96fd2ed1cf7d tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:39 devstack sudo[104867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:22:39 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:39 devstack sudo[104865]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a7b7a4b2-f020-4d37-8b4e-d8c1a17e66e2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.330s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:39 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-a7b7a4b2-f020-4d37-8b4e-d8c1a17e66e2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:22:39 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-a7b7a4b2-f020-4d37-8b4e-d8c1a17e66e2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Deleted volume successfully.
Nov 06 17:22:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a7b7a4b2-f020-4d37-8b4e-d8c1a17e66e2 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "cinder-1d012fe6-da06-489c-a53d-f96844195fca-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:39 devstack sudo[104867]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-db3662c5-9c5d-4878-8889-96fd2ed1cf7d tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.310s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:39 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-db3662c5-9c5d-4878-8889-96fd2ed1cf7d tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:22:39 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-db3662c5-9c5d-4878-8889-96fd2ed1cf7d tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Deleted volume successfully.
Nov 06 17:22:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-db3662c5-9c5d-4878-8889-96fd2ed1cf7d tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "cinder-b851a049-d6ad-45d1-9633-566e1e4af273-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-51466cc8-8dd5-4b92-aeb1-424c15e6e697 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Acquiring lock "cinder-8c9c3531-64cd-4741-bcd3-090369f8ed2b-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-51466cc8-8dd5-4b92-aeb1-424c15e6e697 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "cinder-8c9c3531-64cd-4741-bcd3-090369f8ed2b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-51466cc8-8dd5-4b92-aeb1-424c15e6e697 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Acquiring lock "cinder-quobyte-8c9c3531-64cd-4741-bcd3-090369f8ed2b" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-51466cc8-8dd5-4b92-aeb1-424c15e6e697 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "cinder-quobyte-8c9c3531-64cd-4741-bcd3-090369f8ed2b" acquired by "delete_volume" :: waited 0.018s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:39 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[5452261c-3cc3-425d-8489-080655fdba85]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:22:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-51466cc8-8dd5-4b92-aeb1-424c15e6e697 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8c9c3531-64cd-4741-bcd3-090369f8ed2b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:39 devstack sudo[104871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8c9c3531-64cd-4741-bcd3-090369f8ed2b
Nov 06 17:22:39 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:40 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a0dcc082-5abe-4051-a4d6-4dbe97730ff4 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Acquiring lock "cinder-05a1c607-dccb-4e84-b3b0-b1c6cd8f0238-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:40 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a0dcc082-5abe-4051-a4d6-4dbe97730ff4 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "cinder-05a1c607-dccb-4e84-b3b0-b1c6cd8f0238-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:40 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a0dcc082-5abe-4051-a4d6-4dbe97730ff4 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Acquiring lock "cinder-quobyte-05a1c607-dccb-4e84-b3b0-b1c6cd8f0238" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:40 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a0dcc082-5abe-4051-a4d6-4dbe97730ff4 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "cinder-quobyte-05a1c607-dccb-4e84-b3b0-b1c6cd8f0238" acquired by "delete_volume" :: waited 0.020s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:40 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[881eb9f7-f534-480d-a706-46ed53d2fad1]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:22:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a0dcc082-5abe-4051-a4d6-4dbe97730ff4 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-05a1c607-dccb-4e84-b3b0-b1c6cd8f0238 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:40 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-51466cc8-8dd5-4b92-aeb1-424c15e6e697 tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8c9c3531-64cd-4741-bcd3-090369f8ed2b" returned: 0 in 0.451s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-51466cc8-8dd5-4b92-aeb1-424c15e6e697 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8c9c3531-64cd-4741-bcd3-090369f8ed2b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:40 devstack sudo[104878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8c9c3531-64cd-4741-bcd3-090369f8ed2b
Nov 06 17:22:40 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:40 devstack sudo[104875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-05a1c607-dccb-4e84-b3b0-b1c6cd8f0238
Nov 06 17:22:40 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:40 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-51466cc8-8dd5-4b92-aeb1-424c15e6e697 tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-8c9c3531-64cd-4741-bcd3-090369f8ed2b" returned: 0 in 0.337s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:40 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:40 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-51466cc8-8dd5-4b92-aeb1-424c15e6e697 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "cinder-quobyte-8c9c3531-64cd-4741-bcd3-090369f8ed2b" released by "delete_volume" :: held 0.847s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a0dcc082-5abe-4051-a4d6-4dbe97730ff4 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-05a1c607-dccb-4e84-b3b0-b1c6cd8f0238" returned: 0 in 0.460s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a0dcc082-5abe-4051-a4d6-4dbe97730ff4 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-05a1c607-dccb-4e84-b3b0-b1c6cd8f0238 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:40 devstack sudo[104885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-05a1c607-dccb-4e84-b3b0-b1c6cd8f0238
Nov 06 17:22:40 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:40 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-51466cc8-8dd5-4b92-aeb1-424c15e6e697 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Created reservations ['eb92b9ae-c2f9-4815-b7e4-9a0f0ec7412b', '1bf18a48-3bc0-4595-b945-5dc1e63a7f7a', '2b838865-fb68-4242-8640-cc13888d4d8b', 'd0f36697-b4b6-4cb9-adfe-60ceae10fc31'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:22:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-51466cc8-8dd5-4b92-aeb1-424c15e6e697 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-51466cc8-8dd5-4b92-aeb1-424c15e6e697 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:40 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-51466cc8-8dd5-4b92-aeb1-424c15e6e697 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:40 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-51466cc8-8dd5-4b92-aeb1-424c15e6e697 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-51466cc8-8dd5-4b92-aeb1-424c15e6e697 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-51466cc8-8dd5-4b92-aeb1-424c15e6e697 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:40 devstack sudo[104887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:22:40 devstack sudo[104887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:40 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-90dd9dbe-d9fd-48cd-9cea-7e8b2bd6a1d3 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Acquiring lock "cinder-1a64bb65-99bd-4654-b63a-47eab30bfdc3-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:40 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-90dd9dbe-d9fd-48cd-9cea-7e8b2bd6a1d3 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "cinder-1a64bb65-99bd-4654-b63a-47eab30bfdc3-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:40 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a0dcc082-5abe-4051-a4d6-4dbe97730ff4 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-05a1c607-dccb-4e84-b3b0-b1c6cd8f0238" returned: 0 in 0.385s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-90dd9dbe-d9fd-48cd-9cea-7e8b2bd6a1d3 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Acquiring lock "cinder-quobyte-1a64bb65-99bd-4654-b63a-47eab30bfdc3" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a0dcc082-5abe-4051-a4d6-4dbe97730ff4 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "cinder-quobyte-05a1c607-dccb-4e84-b3b0-b1c6cd8f0238" released by "delete_volume" :: held 0.916s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-90dd9dbe-d9fd-48cd-9cea-7e8b2bd6a1d3 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "cinder-quobyte-1a64bb65-99bd-4654-b63a-47eab30bfdc3" acquired by "delete_volume" :: waited 0.032s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[7184bc6d-f15b-4469-ba15-13614921067a]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-90dd9dbe-d9fd-48cd-9cea-7e8b2bd6a1d3 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a64bb65-99bd-4654-b63a-47eab30bfdc3 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-a0dcc082-5abe-4051-a4d6-4dbe97730ff4 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Created reservations ['a9026994-2cec-4bbd-a288-0a8645786555', '157df7a6-3512-41b2-a8c6-ab6061003ac8', '9e4afab6-5720-4e6d-be5d-0c0c0206b4fb', '9401164a-ff5d-40a3-98b3-e1d314805b76'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:22:41 devstack sudo[104887]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-51466cc8-8dd5-4b92-aeb1-424c15e6e697 tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.424s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-51466cc8-8dd5-4b92-aeb1-424c15e6e697 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:22:41 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-51466cc8-8dd5-4b92-aeb1-424c15e6e697 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Deleted volume successfully.
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-51466cc8-8dd5-4b92-aeb1-424c15e6e697 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "cinder-8c9c3531-64cd-4741-bcd3-090369f8ed2b-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:41 devstack sudo[104890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a64bb65-99bd-4654-b63a-47eab30bfdc3
Nov 06 17:22:41 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a0dcc082-5abe-4051-a4d6-4dbe97730ff4 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a0dcc082-5abe-4051-a4d6-4dbe97730ff4 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a0dcc082-5abe-4051-a4d6-4dbe97730ff4 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a0dcc082-5abe-4051-a4d6-4dbe97730ff4 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a0dcc082-5abe-4051-a4d6-4dbe97730ff4 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a0dcc082-5abe-4051-a4d6-4dbe97730ff4 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:41 devstack sudo[104893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:22:41 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:41 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:41 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-90dd9dbe-d9fd-48cd-9cea-7e8b2bd6a1d3 tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a64bb65-99bd-4654-b63a-47eab30bfdc3" returned: 0 in 0.554s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-90dd9dbe-d9fd-48cd-9cea-7e8b2bd6a1d3 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a64bb65-99bd-4654-b63a-47eab30bfdc3 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a0dcc082-5abe-4051-a4d6-4dbe97730ff4 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.377s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-a0dcc082-5abe-4051-a4d6-4dbe97730ff4 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:22:41 devstack sudo[104900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a64bb65-99bd-4654-b63a-47eab30bfdc3
Nov 06 17:22:41 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:41 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-a0dcc082-5abe-4051-a4d6-4dbe97730ff4 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Deleted volume successfully.
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a0dcc082-5abe-4051-a4d6-4dbe97730ff4 tempest-CreateVolumesFromSourceVolumeTest-1267832758 None] Lock "cinder-05a1c607-dccb-4e84-b3b0-b1c6cd8f0238-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-de3b1095-db8d-4075-b518-3621100d7a18 tempest-ProjectReaderTests-2034096236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-de3b1095-db8d-4075-b518-3621100d7a18 tempest-ProjectReaderTests-2034096236 None] Flow 'volume_create_manager' (efe1d184-6b88-4d3b-aaf4-5c31b0d62090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-de3b1095-db8d-4075-b518-3621100d7a18 tempest-ProjectReaderTests-2034096236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c678b9a-d9ab-4af1-bf83-699701c80b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-de3b1095-db8d-4075-b518-3621100d7a18 tempest-ProjectReaderTests-2034096236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c678b9a-d9ab-4af1-bf83-699701c80b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1760592660',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=397dd0ac-d173-44d0-bbea-c2938f19b019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdceb62dff824102b323ae03b3485b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:42Z,use_quota=True,user_id='08802a9b9e694f2c9390c09e3d0ae9c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-de3b1095-db8d-4075-b518-3621100d7a18 tempest-ProjectReaderTests-2034096236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88a8779b-9557-4a34-8f5c-95cf81d13291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-de3b1095-db8d-4075-b518-3621100d7a18 tempest-ProjectReaderTests-2034096236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88a8779b-9557-4a34-8f5c-95cf81d13291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-de3b1095-db8d-4075-b518-3621100d7a18 tempest-ProjectReaderTests-2034096236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c8c7c2-7130-4991-a856-2cb6193ab056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-de3b1095-db8d-4075-b518-3621100d7a18 tempest-ProjectReaderTests-2034096236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c8c7c2-7130-4991-a856-2cb6193ab056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '397dd0ac-d173-44d0-bbea-c2938f19b019', 'volume_name': 'volume-397dd0ac-d173-44d0-bbea-c2938f19b019', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-de3b1095-db8d-4075-b518-3621100d7a18 tempest-ProjectReaderTests-2034096236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0cf1172-8666-47b9-9358-ac26fb0254aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-de3b1095-db8d-4075-b518-3621100d7a18 tempest-ProjectReaderTests-2034096236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0cf1172-8666-47b9-9358-ac26fb0254aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-de3b1095-db8d-4075-b518-3621100d7a18 tempest-ProjectReaderTests-2034096236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eec698aa-b8cd-4ebc-bc78-941ed5a128ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:41 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-de3b1095-db8d-4075-b518-3621100d7a18 tempest-ProjectReaderTests-2034096236 None] Volume 397dd0ac-d173-44d0-bbea-c2938f19b019: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-397dd0ac-d173-44d0-bbea-c2938f19b019', 'volume_size': 1}
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-de3b1095-db8d-4075-b518-3621100d7a18 tempest-ProjectReaderTests-2034096236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-de3b1095-db8d-4075-b518-3621100d7a18 tempest-ProjectReaderTests-2034096236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-de3b1095-db8d-4075-b518-3621100d7a18 tempest-ProjectReaderTests-2034096236 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1760592660',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=397dd0ac-d173-44d0-bbea-c2938f19b019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdceb62dff824102b323ae03b3485b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:42Z,use_quota=True,user_id='08802a9b9e694f2c9390c09e3d0ae9c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-de3b1095-db8d-4075-b518-3621100d7a18 tempest-ProjectReaderTests-2034096236 None] Creating volume 397dd0ac-d173-44d0-bbea-c2938f19b019 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-de3b1095-db8d-4075-b518-3621100d7a18 tempest-ProjectReaderTests-2034096236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-de3b1095-db8d-4075-b518-3621100d7a18 tempest-ProjectReaderTests-2034096236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-de3b1095-db8d-4075-b518-3621100d7a18 tempest-ProjectReaderTests-2034096236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-de3b1095-db8d-4075-b518-3621100d7a18 tempest-ProjectReaderTests-2034096236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-de3b1095-db8d-4075-b518-3621100d7a18 tempest-ProjectReaderTests-2034096236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-de3b1095-db8d-4075-b518-3621100d7a18 tempest-ProjectReaderTests-2034096236 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:22:41 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-de3b1095-db8d-4075-b518-3621100d7a18 tempest-ProjectReaderTests-2034096236 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-de3b1095-db8d-4075-b518-3621100d7a18 tempest-ProjectReaderTests-2034096236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-397dd0ac-d173-44d0-bbea-c2938f19b019 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:41 devstack sudo[104902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-397dd0ac-d173-44d0-bbea-c2938f19b019 1073741824
Nov 06 17:22:41 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:41 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-90dd9dbe-d9fd-48cd-9cea-7e8b2bd6a1d3 tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1a64bb65-99bd-4654-b63a-47eab30bfdc3" returned: 0 in 0.287s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:41 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-90dd9dbe-d9fd-48cd-9cea-7e8b2bd6a1d3 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "cinder-quobyte-1a64bb65-99bd-4654-b63a-47eab30bfdc3" released by "delete_volume" :: held 0.902s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:42 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-90dd9dbe-d9fd-48cd-9cea-7e8b2bd6a1d3 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Created reservations ['9d01b545-9582-40c2-8d1d-69b910c0778b', 'fc036127-9e5d-4134-b93a-f67fba74f930', '87965ab1-de63-40d9-96b6-5a00df8d1b89', '56ef7475-bb24-40dc-9c9c-5e461c5a0896'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:22:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-90dd9dbe-d9fd-48cd-9cea-7e8b2bd6a1d3 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-90dd9dbe-d9fd-48cd-9cea-7e8b2bd6a1d3 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-90dd9dbe-d9fd-48cd-9cea-7e8b2bd6a1d3 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-90dd9dbe-d9fd-48cd-9cea-7e8b2bd6a1d3 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-90dd9dbe-d9fd-48cd-9cea-7e8b2bd6a1d3 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-90dd9dbe-d9fd-48cd-9cea-7e8b2bd6a1d3 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:42 devstack sudo[104908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:22:42 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:42 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-de3b1095-db8d-4075-b518-3621100d7a18 tempest-ProjectReaderTests-2034096236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-397dd0ac-d173-44d0-bbea-c2938f19b019 1073741824" returned: 0 in 0.520s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:42 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-de3b1095-db8d-4075-b518-3621100d7a18 tempest-ProjectReaderTests-2034096236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-397dd0ac-d173-44d0-bbea-c2938f19b019 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-90dd9dbe-d9fd-48cd-9cea-7e8b2bd6a1d3 tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.318s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:42 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-90dd9dbe-d9fd-48cd-9cea-7e8b2bd6a1d3 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:22:42 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-90dd9dbe-d9fd-48cd-9cea-7e8b2bd6a1d3 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Deleted volume successfully.
Nov 06 17:22:42 devstack sudo[104912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-397dd0ac-d173-44d0-bbea-c2938f19b019
Nov 06 17:22:42 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:42 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-90dd9dbe-d9fd-48cd-9cea-7e8b2bd6a1d3 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "cinder-1a64bb65-99bd-4654-b63a-47eab30bfdc3-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:42 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:22:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:42 devstack sudo[104914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:22:42 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:42 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-de3b1095-db8d-4075-b518-3621100d7a18 tempest-ProjectReaderTests-2034096236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-397dd0ac-d173-44d0-bbea-c2938f19b019" returned: 0 in 0.287s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-de3b1095-db8d-4075-b518-3621100d7a18 tempest-ProjectReaderTests-2034096236 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:22:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-de3b1095-db8d-4075-b518-3621100d7a18 tempest-ProjectReaderTests-2034096236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-de3b1095-db8d-4075-b518-3621100d7a18 tempest-ProjectReaderTests-2034096236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eec698aa-b8cd-4ebc-bc78-941ed5a128ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-397dd0ac-d173-44d0-bbea-c2938f19b019', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-de3b1095-db8d-4075-b518-3621100d7a18 tempest-ProjectReaderTests-2034096236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff79c897-d1f3-46e9-b814-6ee3f0ab15a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:42 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-de3b1095-db8d-4075-b518-3621100d7a18 tempest-ProjectReaderTests-2034096236 None] Volume volume-397dd0ac-d173-44d0-bbea-c2938f19b019 (397dd0ac-d173-44d0-bbea-c2938f19b019): created successfully
Nov 06 17:22:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-de3b1095-db8d-4075-b518-3621100d7a18 tempest-ProjectReaderTests-2034096236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff79c897-d1f3-46e9-b814-6ee3f0ab15a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-de3b1095-db8d-4075-b518-3621100d7a18 tempest-ProjectReaderTests-2034096236 None] Flow 'volume_create_manager' (efe1d184-6b88-4d3b-aaf4-5c31b0d62090) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:42 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-de3b1095-db8d-4075-b518-3621100d7a18 tempest-ProjectReaderTests-2034096236 None] Created volume successfully.
Nov 06 17:22:42 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.306s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:42 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:22:42 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager._thread_info {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:22:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread count: 28 {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 17:22:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread info: [<_MainThread(MainThread, started 125183137599616)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125183027608256)>, <Thread(Thread-3 (stat_writer), started daemon 125183025243776)>, <Thread(Rabbit-heartbeat, started daemon 125183023512896)>, <Thread(Thread-5 (_runner), started daemon 125183023357120)>, <Thread(Thread-7 (_runner), started daemon 125183021306496)>, <Thread(fd_logger, started daemon 125183018711616)>, <Thread(privsep_reader, started daemon 125183017484224)>, <Thread(tpool_thread_0, started daemon 125183013742272)>, <Thread(tpool_thread_1, started daemon 125183005349568)>, <Thread(tpool_thread_2, started daemon 125182996956864)>, <Thread(tpool_thread_3, started daemon 125182988564160)>, <Thread(tpool_thread_4, started daemon 125182980171456)>, <Thread(tpool_thread_5, started daemon 125182971778752)>, <Thread(tpool_thread_6, started daemon 125182963386048)>, <Thread(tpool_thread_7, started daemon 125182954993344)>, <Thread(tpool_thread_8, started daemon 125182946600640)>, <Thread(tpool_thread_9, started daemon 125182938207936)>, <Thread(tpool_thread_10, started daemon 125182929815232)>, <Thread(tpool_thread_11, started daemon 125182921422528)>, <Thread(tpool_thread_12, started daemon 125182913013440)>, <Thread(tpool_thread_13, started daemon 125182904604352)>, <Thread(tpool_thread_14, started daemon 125182896195264)>, <Thread(tpool_thread_15, started daemon 125182887786176)>, <Thread(tpool_thread_16, started daemon 125182879377088)>, <Thread(tpool_thread_17, started daemon 125182870968000)>, <Thread(tpool_thread_18, started daemon 125182862558912)>, <Thread(tpool_thread_19, started daemon 125182854149824)>] {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 17:22:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-16d06287-9420-43b8-be40-8e749dbf8076 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Acquiring lock "cinder-6f857917-12f2-4fbc-891d-9aacff363767-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-16d06287-9420-43b8-be40-8e749dbf8076 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "cinder-6f857917-12f2-4fbc-891d-9aacff363767-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-16d06287-9420-43b8-be40-8e749dbf8076 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Acquiring lock "cinder-quobyte-6f857917-12f2-4fbc-891d-9aacff363767" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-16d06287-9420-43b8-be40-8e749dbf8076 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "cinder-quobyte-6f857917-12f2-4fbc-891d-9aacff363767" acquired by "delete_volume" :: waited 0.018s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:43 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5622280-45cc-4b81-b41e-c836b194cb26]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:22:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-16d06287-9420-43b8-be40-8e749dbf8076 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6f857917-12f2-4fbc-891d-9aacff363767 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:43 devstack sudo[104918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6f857917-12f2-4fbc-891d-9aacff363767
Nov 06 17:22:43 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:43 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-16d06287-9420-43b8-be40-8e749dbf8076 tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6f857917-12f2-4fbc-891d-9aacff363767" returned: 0 in 0.428s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-16d06287-9420-43b8-be40-8e749dbf8076 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6f857917-12f2-4fbc-891d-9aacff363767 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:43 devstack sudo[104923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6f857917-12f2-4fbc-891d-9aacff363767
Nov 06 17:22:43 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:44 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-16d06287-9420-43b8-be40-8e749dbf8076 tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6f857917-12f2-4fbc-891d-9aacff363767" returned: 0 in 0.331s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:44 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-16d06287-9420-43b8-be40-8e749dbf8076 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "cinder-quobyte-6f857917-12f2-4fbc-891d-9aacff363767" released by "delete_volume" :: held 0.816s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:44 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-16d06287-9420-43b8-be40-8e749dbf8076 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Created reservations ['e9d744c5-3970-4f14-b5bb-c2f24d803c15', 'bf57e601-d84d-482d-a076-0eebb925243f', '73f8555e-4107-45dd-b756-13e36790772d', '4b9f363d-ed99-4aba-82cf-52ed8feb6eeb'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:22:44 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c02646b2-e90d-49ae-b5c3-6902dd6f611d tempest-ProjectReaderTests-2034096236 None] Acquiring lock "cinder-397dd0ac-d173-44d0-bbea-c2938f19b019-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:44 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c02646b2-e90d-49ae-b5c3-6902dd6f611d tempest-ProjectReaderTests-2034096236 None] Lock "cinder-397dd0ac-d173-44d0-bbea-c2938f19b019-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-16d06287-9420-43b8-be40-8e749dbf8076 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-16d06287-9420-43b8-be40-8e749dbf8076 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:44 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-16d06287-9420-43b8-be40-8e749dbf8076 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:44 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-16d06287-9420-43b8-be40-8e749dbf8076 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-16d06287-9420-43b8-be40-8e749dbf8076 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-16d06287-9420-43b8-be40-8e749dbf8076 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:44 devstack sudo[104926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:22:44 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:44 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c02646b2-e90d-49ae-b5c3-6902dd6f611d tempest-ProjectReaderTests-2034096236 None] Acquiring lock "cinder-quobyte-397dd0ac-d173-44d0-bbea-c2938f19b019" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:44 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c02646b2-e90d-49ae-b5c3-6902dd6f611d tempest-ProjectReaderTests-2034096236 None] Lock "cinder-quobyte-397dd0ac-d173-44d0-bbea-c2938f19b019" acquired by "delete_volume" :: waited 0.033s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:44 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5c9937-1cba-476c-8b91-e3beddc168a0]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:22:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c02646b2-e90d-49ae-b5c3-6902dd6f611d tempest-ProjectReaderTests-2034096236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-397dd0ac-d173-44d0-bbea-c2938f19b019 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:44 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-81dc117b-c0fc-4a9a-b19e-cc746029b360 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Acquiring lock "cinder-87300090-b117-4c7b-a022-2fe564131fb7-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:44 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-81dc117b-c0fc-4a9a-b19e-cc746029b360 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "cinder-87300090-b117-4c7b-a022-2fe564131fb7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:44 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-81dc117b-c0fc-4a9a-b19e-cc746029b360 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Acquiring lock "cinder-quobyte-a6394a35-58a2-4020-9e81-e90144bdc174" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:44 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-81dc117b-c0fc-4a9a-b19e-cc746029b360 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "cinder-quobyte-a6394a35-58a2-4020-9e81-e90144bdc174" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:44 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-81dc117b-c0fc-4a9a-b19e-cc746029b360 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Acquiring lock "cinder-quobyte-87300090-b117-4c7b-a022-2fe564131fb7" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:44 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-81dc117b-c0fc-4a9a-b19e-cc746029b360 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "cinder-quobyte-87300090-b117-4c7b-a022-2fe564131fb7" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:44 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-81dc117b-c0fc-4a9a-b19e-cc746029b360 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Deleting offline snapshot 87300090-b117-4c7b-a022-2fe564131fb7 of volume a6394a35-58a2-4020-9e81-e90144bdc174 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:22:44 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-81dc117b-c0fc-4a9a-b19e-cc746029b360 tempest-CreateVolumesFromSnapshotTest-1490455522 None] snapshot_file for this snap is: volume-a6394a35-58a2-4020-9e81-e90144bdc174.87300090-b117-4c7b-a022-2fe564131fb7 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:22:44 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[a953bf1a-d17a-49ed-933c-20785979c1bb]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:22:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-81dc117b-c0fc-4a9a-b19e-cc746029b360 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174.87300090-b117-4c7b-a022-2fe564131fb7 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:44 devstack sudo[104928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-397dd0ac-d173-44d0-bbea-c2938f19b019
Nov 06 17:22:44 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:44 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-16d06287-9420-43b8-be40-8e749dbf8076 tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.390s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:44 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-16d06287-9420-43b8-be40-8e749dbf8076 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:22:44 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-16d06287-9420-43b8-be40-8e749dbf8076 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Deleted volume successfully.
Nov 06 17:22:44 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-16d06287-9420-43b8-be40-8e749dbf8076 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "cinder-6f857917-12f2-4fbc-891d-9aacff363767-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:44 devstack sudo[104931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174.87300090-b117-4c7b-a022-2fe564131fb7
Nov 06 17:22:44 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:44 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c02646b2-e90d-49ae-b5c3-6902dd6f611d tempest-ProjectReaderTests-2034096236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-397dd0ac-d173-44d0-bbea-c2938f19b019" returned: 0 in 0.536s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c02646b2-e90d-49ae-b5c3-6902dd6f611d tempest-ProjectReaderTests-2034096236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-397dd0ac-d173-44d0-bbea-c2938f19b019 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:44 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:22:44 devstack sudo[104936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-397dd0ac-d173-44d0-bbea-c2938f19b019
Nov 06 17:22:44 devstack sudo[104936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Flow 'volume_create_manager' (13b03760-6816-4dca-8df7-178ec8ba10d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecb84ed7-5301-4128-a865-d9ddae900d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:45 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecb84ed7-5301-4128-a865-d9ddae900d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fd963a0-656a-454e-9d5e-6b1b81986b95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e87534554b04c408c575a9ab94eaeeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:45Z,use_quota=True,user_id='7331f93756294512a04fc671ed035f5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:45 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8efe8c1-c802-4e54-aa4d-c2e45093eb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:45 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8efe8c1-c802-4e54-aa4d-c2e45093eb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:45 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caf0510f-000b-4c3f-a073-994428e30bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:45 devstack cinder-volume[86856]: DEBUG cinder.image.glance [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Creating Keystone auth plugin from conf {{(pid=86856) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 06 17:22:45 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-81dc117b-c0fc-4a9a-b19e-cc746029b360 tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174.87300090-b117-4c7b-a022-2fe564131fb7" returned: 0 in 0.520s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:45 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-81dc117b-c0fc-4a9a-b19e-cc746029b360 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6394a35-58a2-4020-9e81-e90144bdc174(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:22:45 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39f20cf-0fc4-47be-9bd0-f40b1614ebdf]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:22:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-81dc117b-c0fc-4a9a-b19e-cc746029b360 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:45 devstack sudo[104936]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c02646b2-e90d-49ae-b5c3-6902dd6f611d tempest-ProjectReaderTests-2034096236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-397dd0ac-d173-44d0-bbea-c2938f19b019" returned: 0 in 0.321s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:45 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c02646b2-e90d-49ae-b5c3-6902dd6f611d tempest-ProjectReaderTests-2034096236 None] Lock "cinder-quobyte-397dd0ac-d173-44d0-bbea-c2938f19b019" released by "delete_volume" :: held 0.933s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:45 devstack sudo[104941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174
Nov 06 17:22:45 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:45 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-c02646b2-e90d-49ae-b5c3-6902dd6f611d tempest-ProjectReaderTests-2034096236 None] Created reservations ['ad1c8097-a282-4c37-a11f-9b233e6b3025', '53a447e0-7957-4035-b50d-3cdf8465c6c0', '9106fa07-ca4c-4ad9-ab07-0879bfe1f6cf', '78dc4cc1-4403-41b1-9799-ec2c2a136b60'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:22:45 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caf0510f-000b-4c3f-a073-994428e30bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6fd963a0-656a-454e-9d5e-6b1b81986b95', 'volume_name': 'volume-6fd963a0-656a-454e-9d5e-6b1b81986b95', 'volume_size': 1, 'image_id': 'b5a1f157-7985-4bf6-8828-0ec04a7d8808', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5a1f157-7985-4bf6-8828-0ec04a7d8808', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'abe9a4f3829b53ac16fe2c3971aca52c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7e87534554b04c408c575a9ab94eaeeb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '184f820acdf0ad8dd752add681fc8fe227bfcf89ac43543320885e834d186c763c41b3347f621c9e395d8e302b6a4797c03766f20a036f3656ecff73a05bb622', 'id': 'b5a1f157-7985-4bf6-8828-0ec04a7d8808', 'created_at': datetime.datetime(2026, 11, 6, 16, 22, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 16, 22, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5a1f157-7985-4bf6-8828-0ec04a7d8808/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x71da670c4470>}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:45 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86805294-0293-4697-83bb-f095d0617300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:45 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86805294-0293-4697-83bb-f095d0617300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:45 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95c65948-1950-4619-b86f-ca4af981e66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:45 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Volume 6fd963a0-656a-454e-9d5e-6b1b81986b95: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6fd963a0-656a-454e-9d5e-6b1b81986b95', 'volume_size': 1, 'image_id': 'b5a1f157-7985-4bf6-8828-0ec04a7d8808', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5a1f157-7985-4bf6-8828-0ec04a7d8808', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'abe9a4f3829b53ac16fe2c3971aca52c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7e87534554b04c408c575a9ab94eaeeb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '184f820acdf0ad8dd752add681fc8fe227bfcf89ac43543320885e834d186c763c41b3347f621c9e395d8e302b6a4797c03766f20a036f3656ecff73a05bb622', 'id': 'b5a1f157-7985-4bf6-8828-0ec04a7d8808', 'created_at': datetime.datetime(2026, 11, 6, 16, 22, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 16, 22, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5a1f157-7985-4bf6-8828-0ec04a7d8808/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x71da670c4470>}
Nov 06 17:22:45 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Trying to clone 6fd963a0-656a-454e-9d5e-6b1b81986b95 from image b5a1f157-7985-4bf6-8828-0ec04a7d8808 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b5a1f157-7985-4bf6-8828-0ec04a7d8808', 'metadata': {}}]). {{(pid=86856) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 06 17:22:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c02646b2-e90d-49ae-b5c3-6902dd6f611d tempest-ProjectReaderTests-2034096236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c02646b2-e90d-49ae-b5c3-6902dd6f611d tempest-ProjectReaderTests-2034096236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:45 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c02646b2-e90d-49ae-b5c3-6902dd6f611d tempest-ProjectReaderTests-2034096236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:45 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c02646b2-e90d-49ae-b5c3-6902dd6f611d tempest-ProjectReaderTests-2034096236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c02646b2-e90d-49ae-b5c3-6902dd6f611d tempest-ProjectReaderTests-2034096236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c02646b2-e90d-49ae-b5c3-6902dd6f611d tempest-ProjectReaderTests-2034096236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:45 devstack sudo[104944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:22:45 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:45 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b5a1f157-7985-4bf6-8828-0ec04a7d8808_h49p38n0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86856) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 06 17:22:45 devstack cinder-volume[86856]: INFO cinder.image.image_utils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Image download 0.00 MB at 0.00 MB/s
Nov 06 17:22:45 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[80773062-c526-40fd-bf92-bfc8de316e09]: (4, 'raw') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:22:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a1f157-7985-4bf6-8828-0ec04a7d8808_h49p38n0devstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:45 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-81dc117b-c0fc-4a9a-b19e-cc746029b360 tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174" returned: 0 in 0.569s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-81dc117b-c0fc-4a9a-b19e-cc746029b360 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174.87300090-b117-4c7b-a022-2fe564131fb7 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:45 devstack sudo[104956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174.87300090-b117-4c7b-a022-2fe564131fb7
Nov 06 17:22:45 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:45 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c02646b2-e90d-49ae-b5c3-6902dd6f611d tempest-ProjectReaderTests-2034096236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.314s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:45 devstack sudo[104954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a1f157-7985-4bf6-8828-0ec04a7d8808_h49p38n0devstack@QuobyteHD
Nov 06 17:22:45 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:45 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-c02646b2-e90d-49ae-b5c3-6902dd6f611d tempest-ProjectReaderTests-2034096236 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:22:45 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-c02646b2-e90d-49ae-b5c3-6902dd6f611d tempest-ProjectReaderTests-2034096236 None] Deleted volume successfully.
Nov 06 17:22:45 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c02646b2-e90d-49ae-b5c3-6902dd6f611d tempest-ProjectReaderTests-2034096236 None] Lock "cinder-397dd0ac-d173-44d0-bbea-c2938f19b019-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:46 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a1f157-7985-4bf6-8828-0ec04a7d8808_h49p38n0devstack@QuobyteHD" returned: 0 in 0.417s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a1f157-7985-4bf6-8828-0ec04a7d8808_h49p38n0devstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:46 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-81dc117b-c0fc-4a9a-b19e-cc746029b360 tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174.87300090-b117-4c7b-a022-2fe564131fb7" returned: 0 in 0.439s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-81dc117b-c0fc-4a9a-b19e-cc746029b360 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174.87300090-b117-4c7b-a022-2fe564131fb7 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:46 devstack sudo[104966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174.87300090-b117-4c7b-a022-2fe564131fb7
Nov 06 17:22:46 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:46 devstack sudo[104965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a1f157-7985-4bf6-8828-0ec04a7d8808_h49p38n0devstack@QuobyteHD
Nov 06 17:22:46 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:46 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:46 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a1f157-7985-4bf6-8828-0ec04a7d8808_h49p38n0devstack@QuobyteHD" returned: 1 in 0.340s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a1f157-7985-4bf6-8828-0ec04a7d8808_h49p38n0devstack@QuobyteHD' failed. Not Retrying. {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 17:22:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-81dc117b-c0fc-4a9a-b19e-cc746029b360 tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174.87300090-b117-4c7b-a022-2fe564131fb7" returned: 0 in 0.273s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:46 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Temporary image b5a1f157-7985-4bf6-8828-0ec04a7d8808 is fetched for user 7331f93756294512a04fc671ed035f5c. {{(pid=86856) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 06 17:22:46 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-81dc117b-c0fc-4a9a-b19e-cc746029b360 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "cinder-quobyte-87300090-b117-4c7b-a022-2fe564131fb7" released by "_delete_snapshot" :: held 1.959s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:46 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-81dc117b-c0fc-4a9a-b19e-cc746029b360 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "cinder-quobyte-a6394a35-58a2-4020-9e81-e90144bdc174" released by "delete_snapshot" :: held 1.990s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:46 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bb01dd-45aa-40a6-840f-2a96d38ff579]: (4, 'raw') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:22:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a1f157-7985-4bf6-8828-0ec04a7d8808_h49p38n0devstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:46 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-81dc117b-c0fc-4a9a-b19e-cc746029b360 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Created reservations ['9161bc9f-bc0a-4344-8b0f-78c8da11cbeb', '2b669747-dc11-45eb-97de-f05f5afcbe97', '821206d2-f22b-46e1-8b8a-3f51ae520074', 'b75e8a4e-1b18-4198-afb0-58fb60160fd2'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:22:46 devstack sudo[104973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a1f157-7985-4bf6-8828-0ec04a7d8808_h49p38n0devstack@QuobyteHD
Nov 06 17:22:46 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-81dc117b-c0fc-4a9a-b19e-cc746029b360 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Delete snapshot completed successfully.
Nov 06 17:22:46 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:46 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-81dc117b-c0fc-4a9a-b19e-cc746029b360 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "cinder-87300090-b117-4c7b-a022-2fe564131fb7-delete_snapshot" released by "delete_snapshot" :: held 2.181s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:46 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a1f157-7985-4bf6-8828-0ec04a7d8808_h49p38n0devstack@QuobyteHD" returned: 0 in 0.347s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a1f157-7985-4bf6-8828-0ec04a7d8808_h49p38n0devstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:46 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-013e5a25-f764-4a72-a067-2afcd96cc05b tempest-ProjectReaderTests-2034096236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:22:46 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-013e5a25-f764-4a72-a067-2afcd96cc05b tempest-ProjectReaderTests-2034096236 None] Flow 'volume_create_manager' (23f4083a-8335-43b6-8fdc-5c24048d7e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-013e5a25-f764-4a72-a067-2afcd96cc05b tempest-ProjectReaderTests-2034096236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7de17da9-10c7-4af6-8101-b2f102bc3f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:47 devstack sudo[104977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a1f157-7985-4bf6-8828-0ec04a7d8808_h49p38n0devstack@QuobyteHD
Nov 06 17:22:47 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-013e5a25-f764-4a72-a067-2afcd96cc05b tempest-ProjectReaderTests-2034096236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7de17da9-10c7-4af6-8101-b2f102bc3f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-815998919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbd8445c-8ff9-4ed1-a7c8-4d7efe19f04d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdceb62dff824102b323ae03b3485b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:47Z,use_quota=True,user_id='08802a9b9e694f2c9390c09e3d0ae9c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-013e5a25-f764-4a72-a067-2afcd96cc05b tempest-ProjectReaderTests-2034096236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e03ef81-5892-4c12-ba3c-71dc89cbd614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-013e5a25-f764-4a72-a067-2afcd96cc05b tempest-ProjectReaderTests-2034096236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e03ef81-5892-4c12-ba3c-71dc89cbd614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-013e5a25-f764-4a72-a067-2afcd96cc05b tempest-ProjectReaderTests-2034096236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4030f8bc-9373-445b-abcb-60904945a613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-013e5a25-f764-4a72-a067-2afcd96cc05b tempest-ProjectReaderTests-2034096236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4030f8bc-9373-445b-abcb-60904945a613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbd8445c-8ff9-4ed1-a7c8-4d7efe19f04d', 'volume_name': 'volume-cbd8445c-8ff9-4ed1-a7c8-4d7efe19f04d', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-013e5a25-f764-4a72-a067-2afcd96cc05b tempest-ProjectReaderTests-2034096236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (136c7c97-c0e4-43ac-bef1-92992fa138f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-013e5a25-f764-4a72-a067-2afcd96cc05b tempest-ProjectReaderTests-2034096236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (136c7c97-c0e4-43ac-bef1-92992fa138f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-013e5a25-f764-4a72-a067-2afcd96cc05b tempest-ProjectReaderTests-2034096236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0eeb411-e01b-4925-b2f6-522ab735fd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:47 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-013e5a25-f764-4a72-a067-2afcd96cc05b tempest-ProjectReaderTests-2034096236 None] Volume cbd8445c-8ff9-4ed1-a7c8-4d7efe19f04d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbd8445c-8ff9-4ed1-a7c8-4d7efe19f04d', 'volume_size': 1}
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-013e5a25-f764-4a72-a067-2afcd96cc05b tempest-ProjectReaderTests-2034096236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-013e5a25-f764-4a72-a067-2afcd96cc05b tempest-ProjectReaderTests-2034096236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-013e5a25-f764-4a72-a067-2afcd96cc05b tempest-ProjectReaderTests-2034096236 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-815998919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbd8445c-8ff9-4ed1-a7c8-4d7efe19f04d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdceb62dff824102b323ae03b3485b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:47Z,use_quota=True,user_id='08802a9b9e694f2c9390c09e3d0ae9c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-013e5a25-f764-4a72-a067-2afcd96cc05b tempest-ProjectReaderTests-2034096236 None] Creating volume cbd8445c-8ff9-4ed1-a7c8-4d7efe19f04d {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-013e5a25-f764-4a72-a067-2afcd96cc05b tempest-ProjectReaderTests-2034096236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-013e5a25-f764-4a72-a067-2afcd96cc05b tempest-ProjectReaderTests-2034096236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-013e5a25-f764-4a72-a067-2afcd96cc05b tempest-ProjectReaderTests-2034096236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-013e5a25-f764-4a72-a067-2afcd96cc05b tempest-ProjectReaderTests-2034096236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-013e5a25-f764-4a72-a067-2afcd96cc05b tempest-ProjectReaderTests-2034096236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-013e5a25-f764-4a72-a067-2afcd96cc05b tempest-ProjectReaderTests-2034096236 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:22:47 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-013e5a25-f764-4a72-a067-2afcd96cc05b tempest-ProjectReaderTests-2034096236 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-013e5a25-f764-4a72-a067-2afcd96cc05b tempest-ProjectReaderTests-2034096236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbd8445c-8ff9-4ed1-a7c8-4d7efe19f04d 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:47 devstack sudo[104979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbd8445c-8ff9-4ed1-a7c8-4d7efe19f04d 1073741824
Nov 06 17:22:47 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:47 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a1f157-7985-4bf6-8828-0ec04a7d8808_h49p38n0devstack@QuobyteHD" returned: 1 in 0.352s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a1f157-7985-4bf6-8828-0ec04a7d8808_h49p38n0devstack@QuobyteHD' failed. Not Retrying. {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:47 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-013e5a25-f764-4a72-a067-2afcd96cc05b tempest-ProjectReaderTests-2034096236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbd8445c-8ff9-4ed1-a7c8-4d7efe19f04d 1073741824" returned: 0 in 0.461s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-013e5a25-f764-4a72-a067-2afcd96cc05b tempest-ProjectReaderTests-2034096236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbd8445c-8ff9-4ed1-a7c8-4d7efe19f04d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:47 devstack sudo[104988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbd8445c-8ff9-4ed1-a7c8-4d7efe19f04d
Nov 06 17:22:47 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bbf7ff53-08ac-4926-92dc-fb69d002efb0 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Acquiring lock "cinder-a6394a35-58a2-4020-9e81-e90144bdc174-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bbf7ff53-08ac-4926-92dc-fb69d002efb0 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "cinder-a6394a35-58a2-4020-9e81-e90144bdc174-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bbf7ff53-08ac-4926-92dc-fb69d002efb0 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Acquiring lock "cinder-quobyte-a6394a35-58a2-4020-9e81-e90144bdc174" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bbf7ff53-08ac-4926-92dc-fb69d002efb0 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "cinder-quobyte-a6394a35-58a2-4020-9e81-e90144bdc174" acquired by "delete_volume" :: waited 0.016s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:47 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-013e5a25-f764-4a72-a067-2afcd96cc05b tempest-ProjectReaderTests-2034096236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbd8445c-8ff9-4ed1-a7c8-4d7efe19f04d" returned: 0 in 0.297s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-013e5a25-f764-4a72-a067-2afcd96cc05b tempest-ProjectReaderTests-2034096236 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-013e5a25-f764-4a72-a067-2afcd96cc05b tempest-ProjectReaderTests-2034096236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.621s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fd963a0-656a-454e-9d5e-6b1b81986b95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e87534554b04c408c575a9ab94eaeeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:45Z,use_quota=True,user_id='7331f93756294512a04fc671ed035f5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Creating volume 6fd963a0-656a-454e-9d5e-6b1b81986b95 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:22:47 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6fd963a0-656a-454e-9d5e-6b1b81986b95 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c6f718-e5a9-448f-a25b-85d02b969796]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bbf7ff53-08ac-4926-92dc-fb69d002efb0 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:47 devstack sudo[104991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6fd963a0-656a-454e-9d5e-6b1b81986b95 1073741824
Nov 06 17:22:47 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-013e5a25-f764-4a72-a067-2afcd96cc05b tempest-ProjectReaderTests-2034096236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0eeb411-e01b-4925-b2f6-522ab735fd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbd8445c-8ff9-4ed1-a7c8-4d7efe19f04d', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-013e5a25-f764-4a72-a067-2afcd96cc05b tempest-ProjectReaderTests-2034096236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6700a93-6271-4d91-8d23-3dd421a0900d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:47 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-013e5a25-f764-4a72-a067-2afcd96cc05b tempest-ProjectReaderTests-2034096236 None] Volume volume-cbd8445c-8ff9-4ed1-a7c8-4d7efe19f04d (cbd8445c-8ff9-4ed1-a7c8-4d7efe19f04d): created successfully
Nov 06 17:22:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-013e5a25-f764-4a72-a067-2afcd96cc05b tempest-ProjectReaderTests-2034096236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6700a93-6271-4d91-8d23-3dd421a0900d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:48 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-013e5a25-f764-4a72-a067-2afcd96cc05b tempest-ProjectReaderTests-2034096236 None] Flow 'volume_create_manager' (23f4083a-8335-43b6-8fdc-5c24048d7e41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:48 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-013e5a25-f764-4a72-a067-2afcd96cc05b tempest-ProjectReaderTests-2034096236 None] Created volume successfully.
Nov 06 17:22:48 devstack sudo[104992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174
Nov 06 17:22:48 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:48 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bbf7ff53-08ac-4926-92dc-fb69d002efb0 tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174" returned: 0 in 0.454s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bbf7ff53-08ac-4926-92dc-fb69d002efb0 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:48 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6fd963a0-656a-454e-9d5e-6b1b81986b95 1073741824" returned: 0 in 0.486s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:48 devstack sudo[105002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174
Nov 06 17:22:48 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6fd963a0-656a-454e-9d5e-6b1b81986b95 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:48 devstack sudo[105004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6fd963a0-656a-454e-9d5e-6b1b81986b95
Nov 06 17:22:48 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:48 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bbf7ff53-08ac-4926-92dc-fb69d002efb0 tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-a6394a35-58a2-4020-9e81-e90144bdc174" returned: 0 in 0.264s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:48 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bbf7ff53-08ac-4926-92dc-fb69d002efb0 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "cinder-quobyte-a6394a35-58a2-4020-9e81-e90144bdc174" released by "delete_volume" :: held 0.817s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:48 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-bbf7ff53-08ac-4926-92dc-fb69d002efb0 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Created reservations ['8b06d50c-11d5-4e67-911e-5c29edb1b043', '90b864c5-4d48-4f56-bf0e-7699e1f25c9e', '214077ad-3bac-4e48-8537-ac5242542574', '1d8d39d8-8ea7-4e2d-9073-ae39793e23bd'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:22:48 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6fd963a0-656a-454e-9d5e-6b1b81986b95" returned: 0 in 0.264s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:48 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:22:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:48 devstack cinder-volume[86856]: DEBUG cinder.volume.volume_utils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Attempting download of b5a1f157-7985-4bf6-8828-0ec04a7d8808 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5a1f157-7985-4bf6-8828-0ec04a7d8808', 'metadata': {}}])) to volume 6fd963a0-656a-454e-9d5e-6b1b81986b95. {{(pid=86856) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 06 17:22:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bbf7ff53-08ac-4926-92dc-fb69d002efb0 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bbf7ff53-08ac-4926-92dc-fb69d002efb0 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:48 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bbf7ff53-08ac-4926-92dc-fb69d002efb0 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:48 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bbf7ff53-08ac-4926-92dc-fb69d002efb0 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bbf7ff53-08ac-4926-92dc-fb69d002efb0 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bbf7ff53-08ac-4926-92dc-fb69d002efb0 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:48 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[585f1f7f-54b8-4e4e-89ab-631109f7a8d2]: (4, 'raw') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:22:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5a1f157-7985-4bf6-8828-0ec04a7d8808_g64s7lm2 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:48 devstack sudo[105008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:22:48 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:48 devstack sudo[105009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5a1f157-7985-4bf6-8828-0ec04a7d8808_g64s7lm2
Nov 06 17:22:48 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:49 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bbf7ff53-08ac-4926-92dc-fb69d002efb0 tempest-CreateVolumesFromSnapshotTest-1490455522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.265s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:49 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-bbf7ff53-08ac-4926-92dc-fb69d002efb0 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:22:49 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-bbf7ff53-08ac-4926-92dc-fb69d002efb0 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Deleted volume successfully.
Nov 06 17:22:49 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bbf7ff53-08ac-4926-92dc-fb69d002efb0 tempest-CreateVolumesFromSnapshotTest-1490455522 None] Lock "cinder-a6394a35-58a2-4020-9e81-e90144bdc174-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:49 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-40ec91d4-7787-40d9-8c47-2765136d940c tempest-ProjectReaderTests-2034096236 None] Acquiring lock "cinder-cbd8445c-8ff9-4ed1-a7c8-4d7efe19f04d-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:49 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-40ec91d4-7787-40d9-8c47-2765136d940c tempest-ProjectReaderTests-2034096236 None] Lock "cinder-cbd8445c-8ff9-4ed1-a7c8-4d7efe19f04d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:49 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5a1f157-7985-4bf6-8828-0ec04a7d8808_g64s7lm2" returned: 0 in 0.410s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5a1f157-7985-4bf6-8828-0ec04a7d8808_g64s7lm2 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:49 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-40ec91d4-7787-40d9-8c47-2765136d940c tempest-ProjectReaderTests-2034096236 None] Acquiring lock "cinder-quobyte-cbd8445c-8ff9-4ed1-a7c8-4d7efe19f04d" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:49 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-40ec91d4-7787-40d9-8c47-2765136d940c tempest-ProjectReaderTests-2034096236 None] Lock "cinder-quobyte-cbd8445c-8ff9-4ed1-a7c8-4d7efe19f04d" acquired by "delete_volume" :: waited 0.031s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:49 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[e376ec59-85a6-4d82-abe3-96be41396adc]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:22:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-40ec91d4-7787-40d9-8c47-2765136d940c tempest-ProjectReaderTests-2034096236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbd8445c-8ff9-4ed1-a7c8-4d7efe19f04d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:49 devstack sudo[105015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5a1f157-7985-4bf6-8828-0ec04a7d8808_g64s7lm2
Nov 06 17:22:49 devstack sudo[105015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:49 devstack sudo[105017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbd8445c-8ff9-4ed1-a7c8-4d7efe19f04d
Nov 06 17:22:49 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:49 devstack sudo[105015]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5a1f157-7985-4bf6-8828-0ec04a7d8808_g64s7lm2" returned: 1 in 0.400s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5a1f157-7985-4bf6-8828-0ec04a7d8808_g64s7lm2' failed. Not Retrying. {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 17:22:49 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5ae2df-e34d-4488-aca8-0182fff06f01]: (4, 'raw') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:22:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a1f157-7985-4bf6-8828-0ec04a7d8808_h49p38n0devstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:49 devstack sudo[105021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a1f157-7985-4bf6-8828-0ec04a7d8808_h49p38n0devstack@QuobyteHD
Nov 06 17:22:49 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:49 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-40ec91d4-7787-40d9-8c47-2765136d940c tempest-ProjectReaderTests-2034096236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbd8445c-8ff9-4ed1-a7c8-4d7efe19f04d" returned: 0 in 0.469s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-40ec91d4-7787-40d9-8c47-2765136d940c tempest-ProjectReaderTests-2034096236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbd8445c-8ff9-4ed1-a7c8-4d7efe19f04d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:49 devstack sudo[105026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbd8445c-8ff9-4ed1-a7c8-4d7efe19f04d
Nov 06 17:22:49 devstack sudo[105026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:49 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a1f157-7985-4bf6-8828-0ec04a7d8808_h49p38n0devstack@QuobyteHD" returned: 0 in 0.362s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a1f157-7985-4bf6-8828-0ec04a7d8808_h49p38n0devstack@QuobyteHD {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:50 devstack sudo[105030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a1f157-7985-4bf6-8828-0ec04a7d8808_h49p38n0devstack@QuobyteHD
Nov 06 17:22:50 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:50 devstack sudo[105026]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-40ec91d4-7787-40d9-8c47-2765136d940c tempest-ProjectReaderTests-2034096236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbd8445c-8ff9-4ed1-a7c8-4d7efe19f04d" returned: 0 in 0.356s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:50 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-40ec91d4-7787-40d9-8c47-2765136d940c tempest-ProjectReaderTests-2034096236 None] Lock "cinder-quobyte-cbd8445c-8ff9-4ed1-a7c8-4d7efe19f04d" released by "delete_volume" :: held 0.883s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:50 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-40ec91d4-7787-40d9-8c47-2765136d940c tempest-ProjectReaderTests-2034096236 None] Created reservations ['81309927-eae6-452c-a166-8b0b1ac4f595', 'd5649612-3a40-426f-aa3a-39ac255f7866', '654ae666-b656-4eeb-a213-6b12b09dbdd1', '21028d70-e326-4218-8a42-45940a63b5ec'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:22:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-40ec91d4-7787-40d9-8c47-2765136d940c tempest-ProjectReaderTests-2034096236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-40ec91d4-7787-40d9-8c47-2765136d940c tempest-ProjectReaderTests-2034096236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-40ec91d4-7787-40d9-8c47-2765136d940c tempest-ProjectReaderTests-2034096236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-40ec91d4-7787-40d9-8c47-2765136d940c tempest-ProjectReaderTests-2034096236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-40ec91d4-7787-40d9-8c47-2765136d940c tempest-ProjectReaderTests-2034096236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-40ec91d4-7787-40d9-8c47-2765136d940c tempest-ProjectReaderTests-2034096236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:50 devstack sudo[105033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:22:50 devstack sudo[105033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:50 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a1f157-7985-4bf6-8828-0ec04a7d8808_h49p38n0devstack@QuobyteHD" returned: 1 in 0.511s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a1f157-7985-4bf6-8828-0ec04a7d8808_h49p38n0devstack@QuobyteHD' failed. Not Retrying. {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 17:22:50 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] b5a1f157-7985-4bf6-8828-0ec04a7d8808 was raw, converting to qcow2 {{(pid=86856) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 06 17:22:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b5a1f157-7985-4bf6-8828-0ec04a7d8808_h49p38n0devstack@QuobyteHD /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6fd963a0-656a-454e-9d5e-6b1b81986b95 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:50 devstack sudo[105038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b5a1f157-7985-4bf6-8828-0ec04a7d8808_h49p38n0devstack@QuobyteHD /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6fd963a0-656a-454e-9d5e-6b1b81986b95
Nov 06 17:22:50 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:50 devstack sudo[105033]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-40ec91d4-7787-40d9-8c47-2765136d940c tempest-ProjectReaderTests-2034096236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.399s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:50 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-40ec91d4-7787-40d9-8c47-2765136d940c tempest-ProjectReaderTests-2034096236 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:22:50 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-40ec91d4-7787-40d9-8c47-2765136d940c tempest-ProjectReaderTests-2034096236 None] Deleted volume successfully.
Nov 06 17:22:50 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-40ec91d4-7787-40d9-8c47-2765136d940c tempest-ProjectReaderTests-2034096236 None] Lock "cinder-cbd8445c-8ff9-4ed1-a7c8-4d7efe19f04d-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:50 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b5a1f157-7985-4bf6-8828-0ec04a7d8808_h49p38n0devstack@QuobyteHD /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6fd963a0-656a-454e-9d5e-6b1b81986b95" returned: 0 in 0.500s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:50 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b5a1f157-7985-4bf6-8828-0ec04a7d8808_h49p38n0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6fd963a0-656a-454e-9d5e-6b1b81986b95 {{(pid=86856) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 17:22:50 devstack cinder-volume[86856]: INFO cinder.image.image_utils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Converted 0.00 MB image at 0.00 MB/s
Nov 06 17:22:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6fd963a0-656a-454e-9d5e-6b1b81986b95 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:51 devstack sudo[105081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6fd963a0-656a-454e-9d5e-6b1b81986b95 1G
Nov 06 17:22:51 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:51 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6fd963a0-656a-454e-9d5e-6b1b81986b95 1G" returned: 0 in 0.357s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:51 devstack cinder-volume[86856]: DEBUG cinder.volume.volume_utils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Downloaded image b5a1f157-7985-4bf6-8828-0ec04a7d8808 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5a1f157-7985-4bf6-8828-0ec04a7d8808', 'metadata': {}}])) to volume 6fd963a0-656a-454e-9d5e-6b1b81986b95 successfully. {{(pid=86856) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 06 17:22:51 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Temporary image b5a1f157-7985-4bf6-8828-0ec04a7d8808 for user 7331f93756294512a04fc671ed035f5c is deleted. {{(pid=86856) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 06 17:22:51 devstack cinder-volume[86856]: DEBUG cinder.volume.volume_utils [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Marking volume 6fd963a0-656a-454e-9d5e-6b1b81986b95 as bootable. {{(pid=86856) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 06 17:22:51 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Copying metadata from image b5a1f157-7985-4bf6-8828-0ec04a7d8808 to 6fd963a0-656a-454e-9d5e-6b1b81986b95. {{(pid=86856) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 06 17:22:51 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Creating volume glance metadata for volume 6fd963a0-656a-454e-9d5e-6b1b81986b95 backed by image b5a1f157-7985-4bf6-8828-0ec04a7d8808 with: {'image_id': 'b5a1f157-7985-4bf6-8828-0ec04a7d8808', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'abe9a4f3829b53ac16fe2c3971aca52c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86856) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 06 17:22:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95c65948-1950-4619-b86f-ca4af981e66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fd963a0-656a-454e-9d5e-6b1b81986b95', 'volume_size': 1, 'image_id': 'b5a1f157-7985-4bf6-8828-0ec04a7d8808', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5a1f157-7985-4bf6-8828-0ec04a7d8808', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'abe9a4f3829b53ac16fe2c3971aca52c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7e87534554b04c408c575a9ab94eaeeb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '184f820acdf0ad8dd752add681fc8fe227bfcf89ac43543320885e834d186c763c41b3347f621c9e395d8e302b6a4797c03766f20a036f3656ecff73a05bb622', 'id': 'b5a1f157-7985-4bf6-8828-0ec04a7d8808', 'created_at': datetime.datetime(2026, 11, 6, 16, 22, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 16, 22, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5a1f157-7985-4bf6-8828-0ec04a7d8808/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x71da670c4470>}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b15a25ba-f069-4c13-a226-f63ed385afdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:51 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Volume volume-6fd963a0-656a-454e-9d5e-6b1b81986b95 (6fd963a0-656a-454e-9d5e-6b1b81986b95): created successfully
Nov 06 17:22:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b15a25ba-f069-4c13-a226-f63ed385afdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Flow 'volume_create_manager' (13b03760-6816-4dca-8df7-178ec8ba10d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:51 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-5d4377c0-8cc0-4bd1-9e64-28028d78eb85 tempest-VolumeImageDependencyTests-849283071 None] Created volume successfully.
Nov 06 17:22:52 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f58fc52d-8bd2-4f38-acb5-f798e5931900 tempest-VolumeImageDependencyTests-849283071 None] Acquiring lock "cinder-6fd963a0-656a-454e-9d5e-6b1b81986b95-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:52 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f58fc52d-8bd2-4f38-acb5-f798e5931900 tempest-VolumeImageDependencyTests-849283071 None] Lock "cinder-6fd963a0-656a-454e-9d5e-6b1b81986b95-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:52 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f58fc52d-8bd2-4f38-acb5-f798e5931900 tempest-VolumeImageDependencyTests-849283071 None] Acquiring lock "cinder-quobyte-6fd963a0-656a-454e-9d5e-6b1b81986b95" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:22:52 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f58fc52d-8bd2-4f38-acb5-f798e5931900 tempest-VolumeImageDependencyTests-849283071 None] Lock "cinder-quobyte-6fd963a0-656a-454e-9d5e-6b1b81986b95" acquired by "delete_volume" :: waited 0.015s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:22:52 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[6300aa70-588b-4394-a053-5949f2eec5d5]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:22:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f58fc52d-8bd2-4f38-acb5-f798e5931900 tempest-VolumeImageDependencyTests-849283071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6fd963a0-656a-454e-9d5e-6b1b81986b95 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:52 devstack sudo[105088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6fd963a0-656a-454e-9d5e-6b1b81986b95
Nov 06 17:22:52 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:53 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dc9e3a0-540a-4d8a-9274-a41e9e14267d tempest-VolumeDependencyTests-1670893737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:22:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3dc9e3a0-540a-4d8a-9274-a41e9e14267d tempest-VolumeDependencyTests-1670893737 None] Flow 'volume_create_manager' (adbf6c79-5e5f-4e90-aea8-04e6112ab5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3dc9e3a0-540a-4d8a-9274-a41e9e14267d tempest-VolumeDependencyTests-1670893737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d07a9726-bf79-4524-9ff1-7fdf8cd9445f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3dc9e3a0-540a-4d8a-9274-a41e9e14267d tempest-VolumeDependencyTests-1670893737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d07a9726-bf79-4524-9ff1-7fdf8cd9445f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-358640541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98efbdac-bf88-49a8-99ef-bdfd04682486,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e7fa8c65db341f0ad457cf4bc0d4cda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:53Z,use_quota=True,user_id='932c9c3e479740ebb3b15265559f0ee1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:53 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3dc9e3a0-540a-4d8a-9274-a41e9e14267d tempest-VolumeDependencyTests-1670893737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35694a2f-9d43-4f36-88c1-0d5705227ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3dc9e3a0-540a-4d8a-9274-a41e9e14267d tempest-VolumeDependencyTests-1670893737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35694a2f-9d43-4f36-88c1-0d5705227ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3dc9e3a0-540a-4d8a-9274-a41e9e14267d tempest-VolumeDependencyTests-1670893737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee6d53e7-2ecb-4449-bedd-a7200e2ab626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3dc9e3a0-540a-4d8a-9274-a41e9e14267d tempest-VolumeDependencyTests-1670893737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee6d53e7-2ecb-4449-bedd-a7200e2ab626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98efbdac-bf88-49a8-99ef-bdfd04682486', 'volume_name': 'volume-98efbdac-bf88-49a8-99ef-bdfd04682486', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3dc9e3a0-540a-4d8a-9274-a41e9e14267d tempest-VolumeDependencyTests-1670893737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b509cea5-e616-4f73-b643-076e90254424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3dc9e3a0-540a-4d8a-9274-a41e9e14267d tempest-VolumeDependencyTests-1670893737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b509cea5-e616-4f73-b643-076e90254424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3dc9e3a0-540a-4d8a-9274-a41e9e14267d tempest-VolumeDependencyTests-1670893737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d5bc535-9c19-445a-94bf-8b643644b540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:53 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-3dc9e3a0-540a-4d8a-9274-a41e9e14267d tempest-VolumeDependencyTests-1670893737 None] Volume 98efbdac-bf88-49a8-99ef-bdfd04682486: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98efbdac-bf88-49a8-99ef-bdfd04682486', 'volume_size': 1}
Nov 06 17:22:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3dc9e3a0-540a-4d8a-9274-a41e9e14267d tempest-VolumeDependencyTests-1670893737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3dc9e3a0-540a-4d8a-9274-a41e9e14267d tempest-VolumeDependencyTests-1670893737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:53 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3dc9e3a0-540a-4d8a-9274-a41e9e14267d tempest-VolumeDependencyTests-1670893737 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-358640541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98efbdac-bf88-49a8-99ef-bdfd04682486,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e7fa8c65db341f0ad457cf4bc0d4cda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:22:53Z,use_quota=True,user_id='932c9c3e479740ebb3b15265559f0ee1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:22:53 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-3dc9e3a0-540a-4d8a-9274-a41e9e14267d tempest-VolumeDependencyTests-1670893737 None] Creating volume 98efbdac-bf88-49a8-99ef-bdfd04682486 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:22:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3dc9e3a0-540a-4d8a-9274-a41e9e14267d tempest-VolumeDependencyTests-1670893737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3dc9e3a0-540a-4d8a-9274-a41e9e14267d tempest-VolumeDependencyTests-1670893737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:53 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3dc9e3a0-540a-4d8a-9274-a41e9e14267d tempest-VolumeDependencyTests-1670893737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:53 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3dc9e3a0-540a-4d8a-9274-a41e9e14267d tempest-VolumeDependencyTests-1670893737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3dc9e3a0-540a-4d8a-9274-a41e9e14267d tempest-VolumeDependencyTests-1670893737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:53 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3dc9e3a0-540a-4d8a-9274-a41e9e14267d tempest-VolumeDependencyTests-1670893737 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:22:53 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-3dc9e3a0-540a-4d8a-9274-a41e9e14267d tempest-VolumeDependencyTests-1670893737 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:22:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3dc9e3a0-540a-4d8a-9274-a41e9e14267d tempest-VolumeDependencyTests-1670893737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f58fc52d-8bd2-4f38-acb5-f798e5931900 tempest-VolumeImageDependencyTests-849283071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6fd963a0-656a-454e-9d5e-6b1b81986b95" returned: 0 in 0.657s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f58fc52d-8bd2-4f38-acb5-f798e5931900 tempest-VolumeImageDependencyTests-849283071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6fd963a0-656a-454e-9d5e-6b1b81986b95 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:53 devstack sudo[105094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486 1073741824
Nov 06 17:22:53 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:53 devstack sudo[105095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6fd963a0-656a-454e-9d5e-6b1b81986b95
Nov 06 17:22:53 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:53 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f58fc52d-8bd2-4f38-acb5-f798e5931900 tempest-VolumeImageDependencyTests-849283071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6fd963a0-656a-454e-9d5e-6b1b81986b95" returned: 0 in 0.388s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:53 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f58fc52d-8bd2-4f38-acb5-f798e5931900 tempest-VolumeImageDependencyTests-849283071 None] Lock "cinder-quobyte-6fd963a0-656a-454e-9d5e-6b1b81986b95" released by "delete_volume" :: held 1.116s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:53 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-f58fc52d-8bd2-4f38-acb5-f798e5931900 tempest-VolumeImageDependencyTests-849283071 None] Created reservations ['f5145a97-f425-43a8-8c12-a149939ec422', 'ca4b6d47-d804-4a7b-9ceb-6ef53e82534a', '0d2fda5a-1a09-4257-a675-9b02f5a3e2fe', '23e394ec-8e29-47d3-ab3d-2ce8325ada82'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:22:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f58fc52d-8bd2-4f38-acb5-f798e5931900 tempest-VolumeImageDependencyTests-849283071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f58fc52d-8bd2-4f38-acb5-f798e5931900 tempest-VolumeImageDependencyTests-849283071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:53 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-f58fc52d-8bd2-4f38-acb5-f798e5931900 tempest-VolumeImageDependencyTests-849283071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:53 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-f58fc52d-8bd2-4f38-acb5-f798e5931900 tempest-VolumeImageDependencyTests-849283071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f58fc52d-8bd2-4f38-acb5-f798e5931900 tempest-VolumeImageDependencyTests-849283071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f58fc52d-8bd2-4f38-acb5-f798e5931900 tempest-VolumeImageDependencyTests-849283071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:53 devstack sudo[105103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:22:53 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:54 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3dc9e3a0-540a-4d8a-9274-a41e9e14267d tempest-VolumeDependencyTests-1670893737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486 1073741824" returned: 0 in 0.734s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3dc9e3a0-540a-4d8a-9274-a41e9e14267d tempest-VolumeDependencyTests-1670893737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:54 devstack sudo[105105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486
Nov 06 17:22:54 devstack sudo[105105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:54 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f58fc52d-8bd2-4f38-acb5-f798e5931900 tempest-VolumeImageDependencyTests-849283071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.345s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:54 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-f58fc52d-8bd2-4f38-acb5-f798e5931900 tempest-VolumeImageDependencyTests-849283071 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:22:54 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-f58fc52d-8bd2-4f38-acb5-f798e5931900 tempest-VolumeImageDependencyTests-849283071 None] Deleted volume successfully.
Nov 06 17:22:54 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f58fc52d-8bd2-4f38-acb5-f798e5931900 tempest-VolumeImageDependencyTests-849283071 None] Lock "cinder-6fd963a0-656a-454e-9d5e-6b1b81986b95-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:22:54 devstack sudo[105105]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3dc9e3a0-540a-4d8a-9274-a41e9e14267d tempest-VolumeDependencyTests-1670893737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486" returned: 0 in 0.334s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3dc9e3a0-540a-4d8a-9274-a41e9e14267d tempest-VolumeDependencyTests-1670893737 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:22:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3dc9e3a0-540a-4d8a-9274-a41e9e14267d tempest-VolumeDependencyTests-1670893737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3dc9e3a0-540a-4d8a-9274-a41e9e14267d tempest-VolumeDependencyTests-1670893737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d5bc535-9c19-445a-94bf-8b643644b540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98efbdac-bf88-49a8-99ef-bdfd04682486', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3dc9e3a0-540a-4d8a-9274-a41e9e14267d tempest-VolumeDependencyTests-1670893737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c733ef4-21ac-4c22-a6cc-0fa08875abb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:54 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-3dc9e3a0-540a-4d8a-9274-a41e9e14267d tempest-VolumeDependencyTests-1670893737 None] Volume volume-98efbdac-bf88-49a8-99ef-bdfd04682486 (98efbdac-bf88-49a8-99ef-bdfd04682486): created successfully
Nov 06 17:22:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3dc9e3a0-540a-4d8a-9274-a41e9e14267d tempest-VolumeDependencyTests-1670893737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c733ef4-21ac-4c22-a6cc-0fa08875abb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3dc9e3a0-540a-4d8a-9274-a41e9e14267d tempest-VolumeDependencyTests-1670893737 None] Flow 'volume_create_manager' (adbf6c79-5e5f-4e90-aea8-04e6112ab5c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:54 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-3dc9e3a0-540a-4d8a-9274-a41e9e14267d tempest-VolumeDependencyTests-1670893737 None] Created volume successfully.
Nov 06 17:22:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3cefc784-d6f3-4aff-92a0-ee0d5e851094 tempest-VolumeDependencyTests-1670893737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3cefc784-d6f3-4aff-92a0-ee0d5e851094 tempest-VolumeDependencyTests-1670893737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:55 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-3cefc784-d6f3-4aff-92a0-ee0d5e851094 tempest-VolumeDependencyTests-1670893737 None] Creating offline snapshot 1c368b2d-6c78-4caa-b233-6261ddf44d71 of volume 98efbdac-bf88-49a8-99ef-bdfd04682486 {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:22:55 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe0c164-6b11-4e2f-a817-7b29f9c242f7]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:22:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3cefc784-d6f3-4aff-92a0-ee0d5e851094 tempest-VolumeDependencyTests-1670893737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:56 devstack sudo[105109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486
Nov 06 17:22:56 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:56 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3cefc784-d6f3-4aff-92a0-ee0d5e851094 tempest-VolumeDependencyTests-1670893737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486" returned: 0 in 0.442s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3cefc784-d6f3-4aff-92a0-ee0d5e851094 tempest-VolumeDependencyTests-1670893737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486.1c368b2d-6c78-4caa-b233-6261ddf44d71 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:56 devstack sudo[105114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486.1c368b2d-6c78-4caa-b233-6261ddf44d71 1G
Nov 06 17:22:56 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:56 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3cefc784-d6f3-4aff-92a0-ee0d5e851094 tempest-VolumeDependencyTests-1670893737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486.1c368b2d-6c78-4caa-b233-6261ddf44d71 1G" returned: 0 in 0.569s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3cefc784-d6f3-4aff-92a0-ee0d5e851094 tempest-VolumeDependencyTests-1670893737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98efbdac-bf88-49a8-99ef-bdfd04682486 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486.1c368b2d-6c78-4caa-b233-6261ddf44d71 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:57 devstack sudo[105120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98efbdac-bf88-49a8-99ef-bdfd04682486 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486.1c368b2d-6c78-4caa-b233-6261ddf44d71
Nov 06 17:22:57 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:57 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3cefc784-d6f3-4aff-92a0-ee0d5e851094 tempest-VolumeDependencyTests-1670893737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98efbdac-bf88-49a8-99ef-bdfd04682486 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486.1c368b2d-6c78-4caa-b233-6261ddf44d71" returned: 0 in 0.413s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:57 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-3cefc784-d6f3-4aff-92a0-ee0d5e851094 tempest-VolumeDependencyTests-1670893737 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486.1c368b2d-6c78-4caa-b233-6261ddf44d71 is being set with open permissions: ugo+rw
Nov 06 17:22:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3cefc784-d6f3-4aff-92a0-ee0d5e851094 tempest-VolumeDependencyTests-1670893737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486.1c368b2d-6c78-4caa-b233-6261ddf44d71 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:57 devstack sudo[105125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486.1c368b2d-6c78-4caa-b233-6261ddf44d71
Nov 06 17:22:57 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:57 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3cefc784-d6f3-4aff-92a0-ee0d5e851094 tempest-VolumeDependencyTests-1670893737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486.1c368b2d-6c78-4caa-b233-6261ddf44d71" returned: 0 in 0.305s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3cefc784-d6f3-4aff-92a0-ee0d5e851094 tempest-VolumeDependencyTests-1670893737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:57 devstack sudo[105128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486.info
Nov 06 17:22:57 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:58 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3cefc784-d6f3-4aff-92a0-ee0d5e851094 tempest-VolumeDependencyTests-1670893737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486.info" returned: 0 in 0.327s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:58 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-3cefc784-d6f3-4aff-92a0-ee0d5e851094 tempest-VolumeDependencyTests-1670893737 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486.info is being set with open permissions: ugo+rw
Nov 06 17:22:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3cefc784-d6f3-4aff-92a0-ee0d5e851094 tempest-VolumeDependencyTests-1670893737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:58 devstack sudo[105131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486.info
Nov 06 17:22:58 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:22:58 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root
Nov 06 17:22:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3cefc784-d6f3-4aff-92a0-ee0d5e851094 tempest-VolumeDependencyTests-1670893737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486.info" returned: 0 in 0.286s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:22:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3cefc784-d6f3-4aff-92a0-ee0d5e851094 tempest-VolumeDependencyTests-1670893737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.486s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:58 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-3cefc784-d6f3-4aff-92a0-ee0d5e851094 tempest-VolumeDependencyTests-1670893737 None] Create snapshot completed successfully
Nov 06 17:22:59 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9c63470-9b77-4de7-8b03-63555c4c4c78 tempest-ProjectReaderTests-1615857228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:22:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f9c63470-9b77-4de7-8b03-63555c4c4c78 tempest-ProjectReaderTests-1615857228 None] Flow 'volume_create_manager' (0237e1b3-001b-4ba8-b4a1-60c0f79bfdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:22:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f9c63470-9b77-4de7-8b03-63555c4c4c78 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc47fbeb-dfb4-41d5-a22c-9702010bbdca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f9c63470-9b77-4de7-8b03-63555c4c4c78 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc47fbeb-dfb4-41d5-a22c-9702010bbdca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1562999034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af75b0d-0b9a-49b1-b891-72014870c0f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e765fbd33c2345449278669b7fd8c195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:23:00Z,use_quota=True,user_id='b7b89c3c77ff44f4adddd9248571825a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f9c63470-9b77-4de7-8b03-63555c4c4c78 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b70721f0-9c74-4cb3-bd42-6d1832d89ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f9c63470-9b77-4de7-8b03-63555c4c4c78 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b70721f0-9c74-4cb3-bd42-6d1832d89ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f9c63470-9b77-4de7-8b03-63555c4c4c78 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c96c13a-e754-4af2-9319-d5a5800e8fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f9c63470-9b77-4de7-8b03-63555c4c4c78 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c96c13a-e754-4af2-9319-d5a5800e8fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6af75b0d-0b9a-49b1-b891-72014870c0f7', 'volume_name': 'volume-6af75b0d-0b9a-49b1-b891-72014870c0f7', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f9c63470-9b77-4de7-8b03-63555c4c4c78 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ed089dc-92a2-411d-ac32-b0904beb6fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f9c63470-9b77-4de7-8b03-63555c4c4c78 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ed089dc-92a2-411d-ac32-b0904beb6fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:22:59 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f9c63470-9b77-4de7-8b03-63555c4c4c78 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7837f93f-13b2-48f2-8478-8d048c0481dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:22:59 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-f9c63470-9b77-4de7-8b03-63555c4c4c78 tempest-ProjectReaderTests-1615857228 None] Volume 6af75b0d-0b9a-49b1-b891-72014870c0f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6af75b0d-0b9a-49b1-b891-72014870c0f7', 'volume_size': 1}
Nov 06 17:22:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f9c63470-9b77-4de7-8b03-63555c4c4c78 tempest-ProjectReaderTests-1615857228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f9c63470-9b77-4de7-8b03-63555c4c4c78 tempest-ProjectReaderTests-1615857228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:59 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-f9c63470-9b77-4de7-8b03-63555c4c4c78 tempest-ProjectReaderTests-1615857228 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1562999034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af75b0d-0b9a-49b1-b891-72014870c0f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e765fbd33c2345449278669b7fd8c195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:23:00Z,use_quota=True,user_id='b7b89c3c77ff44f4adddd9248571825a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:22:59 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-f9c63470-9b77-4de7-8b03-63555c4c4c78 tempest-ProjectReaderTests-1615857228 None] Creating volume 6af75b0d-0b9a-49b1-b891-72014870c0f7 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:22:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f9c63470-9b77-4de7-8b03-63555c4c4c78 tempest-ProjectReaderTests-1615857228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:22:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f9c63470-9b77-4de7-8b03-63555c4c4c78 tempest-ProjectReaderTests-1615857228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:22:59 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-f9c63470-9b77-4de7-8b03-63555c4c4c78 tempest-ProjectReaderTests-1615857228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:22:59 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-f9c63470-9b77-4de7-8b03-63555c4c4c78 tempest-ProjectReaderTests-1615857228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:22:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f9c63470-9b77-4de7-8b03-63555c4c4c78 tempest-ProjectReaderTests-1615857228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:22:59 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-f9c63470-9b77-4de7-8b03-63555c4c4c78 tempest-ProjectReaderTests-1615857228 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:22:59 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-f9c63470-9b77-4de7-8b03-63555c4c4c78 tempest-ProjectReaderTests-1615857228 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:22:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f9c63470-9b77-4de7-8b03-63555c4c4c78 tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:22:59 devstack sudo[105134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7 1073741824
Nov 06 17:22:59 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Flow 'volume_create_manager' (ad89c6e1-193f-46cb-ab2b-2f6d59477d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1828895c-d589-46b2-af76-4f671f70c2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1828895c-d589-46b2-af76-4f671f70c2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1500694070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14c47e46-a98c-4107-9f16-8e79ffb26c1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e7fa8c65db341f0ad457cf4bc0d4cda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1c368b2d-6c78-4caa-b233-6261ddf44d71,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:23:00Z,use_quota=True,user_id='932c9c3e479740ebb3b15265559f0ee1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5775ae6-5aae-4fa0-ba3f-c0a3c60f234d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5775ae6-5aae-4fa0-ba3f-c0a3c60f234d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe495b69-7c9d-4e4c-9d8f-03a011f6361b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe495b69-7c9d-4e4c-9d8f-03a011f6361b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '14c47e46-a98c-4107-9f16-8e79ffb26c1d', 'volume_name': 'volume-14c47e46-a98c-4107-9f16-8e79ffb26c1d', 'volume_size': 1, 'snapshot_id': '1c368b2d-6c78-4caa-b233-6261ddf44d71'}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e54d44f2-8aa4-412d-9956-399142aba9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e54d44f2-8aa4-412d-9956-399142aba9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f035350-ab87-45d8-9c47-56949bdf058c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:00 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Volume 14c47e46-a98c-4107-9f16-8e79ffb26c1d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-14c47e46-a98c-4107-9f16-8e79ffb26c1d', 'volume_size': 1, 'snapshot_id': '1c368b2d-6c78-4caa-b233-6261ddf44d71'}
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:00 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f9c63470-9b77-4de7-8b03-63555c4c4c78 tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7 1073741824" returned: 0 in 0.598s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f9c63470-9b77-4de7-8b03-63555c4c4c78 tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:00 devstack sudo[105141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7
Nov 06 17:23:00 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:00 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f9c63470-9b77-4de7-8b03-63555c4c4c78 tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7" returned: 0 in 0.283s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-f9c63470-9b77-4de7-8b03-63555c4c4c78 tempest-ProjectReaderTests-1615857228 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f9c63470-9b77-4de7-8b03-63555c4c4c78 tempest-ProjectReaderTests-1615857228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.403s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Acquiring lock "cinder-quobyte-1c368b2d-6c78-4caa-b233-6261ddf44d71-14c47e46-a98c-4107-9f16-8e79ffb26c1d" by "_create_volume_from_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f9c63470-9b77-4de7-8b03-63555c4c4c78 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7837f93f-13b2-48f2-8478-8d048c0481dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6af75b0d-0b9a-49b1-b891-72014870c0f7', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f9c63470-9b77-4de7-8b03-63555c4c4c78 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18dc2f42-1736-460e-8eb3-cb785817ebd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Lock "cinder-quobyte-1c368b2d-6c78-4caa-b233-6261ddf44d71-14c47e46-a98c-4107-9f16-8e79ffb26c1d" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Creating volume 14c47e46-a98c-4107-9f16-8e79ffb26c1d from snapshot 1c368b2d-6c78-4caa-b233-6261ddf44d71 {{(pid=86856) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Acquiring lock "cinder-quobyte-14c47e46-a98c-4107-9f16-8e79ffb26c1d" by "_copy_volume_from_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:00 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-f9c63470-9b77-4de7-8b03-63555c4c4c78 tempest-ProjectReaderTests-1615857228 None] Volume volume-6af75b0d-0b9a-49b1-b891-72014870c0f7 (6af75b0d-0b9a-49b1-b891-72014870c0f7): created successfully
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f9c63470-9b77-4de7-8b03-63555c4c4c78 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18dc2f42-1736-460e-8eb3-cb785817ebd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f9c63470-9b77-4de7-8b03-63555c4c4c78 tempest-ProjectReaderTests-1615857228 None] Flow 'volume_create_manager' (0237e1b3-001b-4ba8-b4a1-60c0f79bfdd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Lock "cinder-quobyte-14c47e46-a98c-4107-9f16-8e79ffb26c1d" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] snapshot: 1c368b2d-6c78-4caa-b233-6261ddf44d71, volume: 14c47e46-a98c-4107-9f16-8e79ffb26c1d,  {{(pid=86856) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:00 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-f9c63470-9b77-4de7-8b03-63555c4c4c78 tempest-ProjectReaderTests-1615857228 None] Created volume successfully.
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[282dcfe7-e4f0-435b-9a38-527b0a912e16]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:23:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486.1c368b2d-6c78-4caa-b233-6261ddf44d71 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:00 devstack sudo[105144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486.1c368b2d-6c78-4caa-b233-6261ddf44d71
Nov 06 17:23:00 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-706a654f-885d-466e-a6a7-f645174e7bfa tempest-ProjectReaderTests-1615857228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:01 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486.1c368b2d-6c78-4caa-b233-6261ddf44d71" returned: 0 in 0.498s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:01 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98efbdac-bf88-49a8-99ef-bdfd04682486(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:23:01 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[1727285d-70ee-44fa-aa21-958621daaa63]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:23:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:01 devstack sudo[105149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486
Nov 06 17:23:01 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:01 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486" returned: 0 in 0.421s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:01 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486 {{(pid=86856) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 06 17:23:01 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Creating direct copy from snapshot {{(pid=86856) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 06 17:23:01 devstack cinder-volume[86856]: DEBUG cinder.utils [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Path /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-14c47e46-a98c-4107-9f16-8e79ffb26c1d not found in is_blk_device check {{(pid=86856) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 06 17:23:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-14c47e46-a98c-4107-9f16-8e79ffb26c1d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:01 devstack sudo[105155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-14c47e46-a98c-4107-9f16-8e79ffb26c1d
Nov 06 17:23:01 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:10 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-14c47e46-a98c-4107-9f16-8e79ffb26c1d" returned: 0 in 8.677s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:10 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Image conversion details: src /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486, size 1024.00 MB, duration 8.68 sec, destination /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-14c47e46-a98c-4107-9f16-8e79ffb26c1d {{(pid=86856) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 17:23:10 devstack cinder-volume[86856]: INFO cinder.image.image_utils [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Converted 1024.00 MB image at 118.00 MB/s
Nov 06 17:23:10 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-14c47e46-a98c-4107-9f16-8e79ffb26c1d is being set with open permissions: ugo+rw
Nov 06 17:23:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-14c47e46-a98c-4107-9f16-8e79ffb26c1d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:10 devstack sudo[105168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-14c47e46-a98c-4107-9f16-8e79ffb26c1d
Nov 06 17:23:10 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:10 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-14c47e46-a98c-4107-9f16-8e79ffb26c1d" returned: 0 in 0.267s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:10 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Lock "cinder-quobyte-14c47e46-a98c-4107-9f16-8e79ffb26c1d" released by "_copy_volume_from_snapshot" :: held 9.965s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:10 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=184,cinder:UPDATE=249,cinder:INSERT=61,cinder:DELETE=22 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:23:10 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=172,cinder:UPDATE=251,cinder:INSERT=71,cinder:DELETE=24 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:23:10 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Lock "cinder-quobyte-1c368b2d-6c78-4caa-b233-6261ddf44d71-14c47e46-a98c-4107-9f16-8e79ffb26c1d" released by "_create_volume_from_snapshot" :: held 10.080s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.113s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-706a654f-885d-466e-a6a7-f645174e7bfa tempest-ProjectReaderTests-1615857228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.530s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:10 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-706a654f-885d-466e-a6a7-f645174e7bfa tempest-ProjectReaderTests-1615857228 None] Creating offline snapshot ba748fbb-1636-42ef-a21d-a058af1849a0 of volume 6af75b0d-0b9a-49b1-b891-72014870c0f7 {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:23:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f035350-ab87-45d8-9c47-56949bdf058c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14c47e46-a98c-4107-9f16-8e79ffb26c1d', 'volume_size': 1, 'snapshot_id': '1c368b2d-6c78-4caa-b233-6261ddf44d71'}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb021874-8e78-4bbc-bf87-671d8c093872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:10 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[14eb623a-3b2f-4543-8131-91a06e7cf34b]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:23:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-706a654f-885d-466e-a6a7-f645174e7bfa tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:10 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Volume volume-14c47e46-a98c-4107-9f16-8e79ffb26c1d (14c47e46-a98c-4107-9f16-8e79ffb26c1d): created successfully
Nov 06 17:23:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb021874-8e78-4bbc-bf87-671d8c093872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:10 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Flow 'volume_create_manager' (ad89c6e1-193f-46cb-ab2b-2f6d59477d77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:23:10 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-e807511d-5878-440c-944a-2fbce141ce1b tempest-VolumeDependencyTests-1670893737 None] Created volume successfully.
Nov 06 17:23:11 devstack sudo[105172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7
Nov 06 17:23:11 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5d6a6516-25d1-4f59-941d-2b08f1136be9 tempest-VolumeDependencyTests-1670893737 None] Acquiring lock "cinder-1c368b2d-6c78-4caa-b233-6261ddf44d71-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5d6a6516-25d1-4f59-941d-2b08f1136be9 tempest-VolumeDependencyTests-1670893737 None] Lock "cinder-1c368b2d-6c78-4caa-b233-6261ddf44d71-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5d6a6516-25d1-4f59-941d-2b08f1136be9 tempest-VolumeDependencyTests-1670893737 None] Acquiring lock "cinder-quobyte-98efbdac-bf88-49a8-99ef-bdfd04682486" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5d6a6516-25d1-4f59-941d-2b08f1136be9 tempest-VolumeDependencyTests-1670893737 None] Lock "cinder-quobyte-98efbdac-bf88-49a8-99ef-bdfd04682486" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5d6a6516-25d1-4f59-941d-2b08f1136be9 tempest-VolumeDependencyTests-1670893737 None] Acquiring lock "cinder-quobyte-1c368b2d-6c78-4caa-b233-6261ddf44d71" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5d6a6516-25d1-4f59-941d-2b08f1136be9 tempest-VolumeDependencyTests-1670893737 None] Lock "cinder-quobyte-1c368b2d-6c78-4caa-b233-6261ddf44d71" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:11 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-5d6a6516-25d1-4f59-941d-2b08f1136be9 tempest-VolumeDependencyTests-1670893737 None] Deleting offline snapshot 1c368b2d-6c78-4caa-b233-6261ddf44d71 of volume 98efbdac-bf88-49a8-99ef-bdfd04682486 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:23:11 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-5d6a6516-25d1-4f59-941d-2b08f1136be9 tempest-VolumeDependencyTests-1670893737 None] snapshot_file for this snap is: volume-98efbdac-bf88-49a8-99ef-bdfd04682486.1c368b2d-6c78-4caa-b233-6261ddf44d71 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:23:11 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d00bab-d95e-458c-bde8-673d938f1ee2]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:23:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d6a6516-25d1-4f59-941d-2b08f1136be9 tempest-VolumeDependencyTests-1670893737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486.1c368b2d-6c78-4caa-b233-6261ddf44d71 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:11 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-706a654f-885d-466e-a6a7-f645174e7bfa tempest-ProjectReaderTests-1615857228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7" returned: 0 in 0.531s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-706a654f-885d-466e-a6a7-f645174e7bfa tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7.ba748fbb-1636-42ef-a21d-a058af1849a0 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:11 devstack sudo[105179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7.ba748fbb-1636-42ef-a21d-a058af1849a0 1G
Nov 06 17:23:11 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:11 devstack sudo[105178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486.1c368b2d-6c78-4caa-b233-6261ddf44d71
Nov 06 17:23:11 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:11 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d6a6516-25d1-4f59-941d-2b08f1136be9 tempest-VolumeDependencyTests-1670893737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486.1c368b2d-6c78-4caa-b233-6261ddf44d71" returned: 0 in 0.541s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:11 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-5d6a6516-25d1-4f59-941d-2b08f1136be9 tempest-VolumeDependencyTests-1670893737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98efbdac-bf88-49a8-99ef-bdfd04682486(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:23:11 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7e7464-54f4-44a6-92d1-c89a1938462d]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:23:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d6a6516-25d1-4f59-941d-2b08f1136be9 tempest-VolumeDependencyTests-1670893737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:12 devstack sudo[105190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486
Nov 06 17:23:12 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:12 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-706a654f-885d-466e-a6a7-f645174e7bfa tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7.ba748fbb-1636-42ef-a21d-a058af1849a0 1G" returned: 0 in 0.740s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-706a654f-885d-466e-a6a7-f645174e7bfa tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6af75b0d-0b9a-49b1-b891-72014870c0f7 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7.ba748fbb-1636-42ef-a21d-a058af1849a0 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:12 devstack sudo[105192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6af75b0d-0b9a-49b1-b891-72014870c0f7 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7.ba748fbb-1636-42ef-a21d-a058af1849a0
Nov 06 17:23:12 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:12 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-706a654f-885d-466e-a6a7-f645174e7bfa tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6af75b0d-0b9a-49b1-b891-72014870c0f7 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7.ba748fbb-1636-42ef-a21d-a058af1849a0" returned: 0 in 0.450s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:12 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-706a654f-885d-466e-a6a7-f645174e7bfa tempest-ProjectReaderTests-1615857228 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7.ba748fbb-1636-42ef-a21d-a058af1849a0 is being set with open permissions: ugo+rw
Nov 06 17:23:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-706a654f-885d-466e-a6a7-f645174e7bfa tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7.ba748fbb-1636-42ef-a21d-a058af1849a0 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:12 devstack sudo[105200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7.ba748fbb-1636-42ef-a21d-a058af1849a0
Nov 06 17:23:12 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:12 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d6a6516-25d1-4f59-941d-2b08f1136be9 tempest-VolumeDependencyTests-1670893737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486" returned: 0 in 0.700s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d6a6516-25d1-4f59-941d-2b08f1136be9 tempest-VolumeDependencyTests-1670893737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486.1c368b2d-6c78-4caa-b233-6261ddf44d71 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:12 devstack sudo[105204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486.1c368b2d-6c78-4caa-b233-6261ddf44d71
Nov 06 17:23:12 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:12 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-706a654f-885d-466e-a6a7-f645174e7bfa tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7.ba748fbb-1636-42ef-a21d-a058af1849a0" returned: 0 in 0.323s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-706a654f-885d-466e-a6a7-f645174e7bfa tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:13 devstack sudo[105209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7.info
Nov 06 17:23:13 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:13 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d6a6516-25d1-4f59-941d-2b08f1136be9 tempest-VolumeDependencyTests-1670893737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486.1c368b2d-6c78-4caa-b233-6261ddf44d71" returned: 0 in 0.483s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d6a6516-25d1-4f59-941d-2b08f1136be9 tempest-VolumeDependencyTests-1670893737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486.1c368b2d-6c78-4caa-b233-6261ddf44d71 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:13 devstack sudo[105212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486.1c368b2d-6c78-4caa-b233-6261ddf44d71
Nov 06 17:23:13 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:13 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-706a654f-885d-466e-a6a7-f645174e7bfa tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7.info" returned: 0 in 0.358s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:13 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-706a654f-885d-466e-a6a7-f645174e7bfa tempest-ProjectReaderTests-1615857228 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7.info is being set with open permissions: ugo+rw
Nov 06 17:23:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-706a654f-885d-466e-a6a7-f645174e7bfa tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:13 devstack sudo[105215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7.info
Nov 06 17:23:13 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:13 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5d6a6516-25d1-4f59-941d-2b08f1136be9 tempest-VolumeDependencyTests-1670893737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486.1c368b2d-6c78-4caa-b233-6261ddf44d71" returned: 0 in 0.300s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:13 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5d6a6516-25d1-4f59-941d-2b08f1136be9 tempest-VolumeDependencyTests-1670893737 None] Lock "cinder-quobyte-1c368b2d-6c78-4caa-b233-6261ddf44d71" released by "_delete_snapshot" :: held 2.226s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:13 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5d6a6516-25d1-4f59-941d-2b08f1136be9 tempest-VolumeDependencyTests-1670893737 None] Lock "cinder-quobyte-98efbdac-bf88-49a8-99ef-bdfd04682486" released by "delete_snapshot" :: held 2.256s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:13 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-5d6a6516-25d1-4f59-941d-2b08f1136be9 tempest-VolumeDependencyTests-1670893737 None] Created reservations ['c7498d09-be02-4935-8c24-894a1b346b4d', '8d6183df-1a94-4722-a727-cfce8c1de334', '29483952-b17d-408f-a8d7-9e425c937a57', '19c25362-0eb4-4a09-9371-fa8130eae78c'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:23:13 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-706a654f-885d-466e-a6a7-f645174e7bfa tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7.info" returned: 0 in 0.378s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-706a654f-885d-466e-a6a7-f645174e7bfa tempest-ProjectReaderTests-1615857228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.928s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:13 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-706a654f-885d-466e-a6a7-f645174e7bfa tempest-ProjectReaderTests-1615857228 None] Create snapshot completed successfully
Nov 06 17:23:13 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-5d6a6516-25d1-4f59-941d-2b08f1136be9 tempest-VolumeDependencyTests-1670893737 None] Delete snapshot completed successfully.
Nov 06 17:23:13 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5d6a6516-25d1-4f59-941d-2b08f1136be9 tempest-VolumeDependencyTests-1670893737 None] Lock "cinder-1c368b2d-6c78-4caa-b233-6261ddf44d71-delete_snapshot" released by "delete_snapshot" :: held 2.539s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:14 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-740a3580-bcc3-403e-9fd4-28a487055406 tempest-ProjectReaderTests-1615857228 None] Acquiring lock "cinder-ba748fbb-1636-42ef-a21d-a058af1849a0-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:14 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-740a3580-bcc3-403e-9fd4-28a487055406 tempest-ProjectReaderTests-1615857228 None] Lock "cinder-ba748fbb-1636-42ef-a21d-a058af1849a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:14 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-740a3580-bcc3-403e-9fd4-28a487055406 tempest-ProjectReaderTests-1615857228 None] Acquiring lock "cinder-quobyte-6af75b0d-0b9a-49b1-b891-72014870c0f7" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:14 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-740a3580-bcc3-403e-9fd4-28a487055406 tempest-ProjectReaderTests-1615857228 None] Lock "cinder-quobyte-6af75b0d-0b9a-49b1-b891-72014870c0f7" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:14 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-740a3580-bcc3-403e-9fd4-28a487055406 tempest-ProjectReaderTests-1615857228 None] Acquiring lock "cinder-quobyte-ba748fbb-1636-42ef-a21d-a058af1849a0" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:14 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-740a3580-bcc3-403e-9fd4-28a487055406 tempest-ProjectReaderTests-1615857228 None] Lock "cinder-quobyte-ba748fbb-1636-42ef-a21d-a058af1849a0" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:14 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-740a3580-bcc3-403e-9fd4-28a487055406 tempest-ProjectReaderTests-1615857228 None] Deleting offline snapshot ba748fbb-1636-42ef-a21d-a058af1849a0 of volume 6af75b0d-0b9a-49b1-b891-72014870c0f7 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:23:14 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-740a3580-bcc3-403e-9fd4-28a487055406 tempest-ProjectReaderTests-1615857228 None] snapshot_file for this snap is: volume-6af75b0d-0b9a-49b1-b891-72014870c0f7.ba748fbb-1636-42ef-a21d-a058af1849a0 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:23:14 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[09158855-87e4-4f6e-a3b1-9563ecb01ec3]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:23:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-740a3580-bcc3-403e-9fd4-28a487055406 tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7.ba748fbb-1636-42ef-a21d-a058af1849a0 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:14 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e4f4a58a-99f3-4864-a0e0-63aede12e478 tempest-VolumeDependencyTests-1670893737 None] Acquiring lock "cinder-98efbdac-bf88-49a8-99ef-bdfd04682486-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:14 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e4f4a58a-99f3-4864-a0e0-63aede12e478 tempest-VolumeDependencyTests-1670893737 None] Lock "cinder-98efbdac-bf88-49a8-99ef-bdfd04682486-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:14 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e4f4a58a-99f3-4864-a0e0-63aede12e478 tempest-VolumeDependencyTests-1670893737 None] Acquiring lock "cinder-quobyte-98efbdac-bf88-49a8-99ef-bdfd04682486" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:14 devstack sudo[105219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7.ba748fbb-1636-42ef-a21d-a058af1849a0
Nov 06 17:23:14 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:14 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e4f4a58a-99f3-4864-a0e0-63aede12e478 tempest-VolumeDependencyTests-1670893737 None] Lock "cinder-quobyte-98efbdac-bf88-49a8-99ef-bdfd04682486" acquired by "delete_volume" :: waited 0.024s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:14 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c934a8a-9b52-4ef0-acd4-16fc462e2006]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:23:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e4f4a58a-99f3-4864-a0e0-63aede12e478 tempest-VolumeDependencyTests-1670893737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:14 devstack sudo[105221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486
Nov 06 17:23:14 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:15 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-740a3580-bcc3-403e-9fd4-28a487055406 tempest-ProjectReaderTests-1615857228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7.ba748fbb-1636-42ef-a21d-a058af1849a0" returned: 0 in 0.501s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:15 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-740a3580-bcc3-403e-9fd4-28a487055406 tempest-ProjectReaderTests-1615857228 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6af75b0d-0b9a-49b1-b891-72014870c0f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:23:15 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d15963-baab-415f-af2a-c4b8163ab4df]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:23:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-740a3580-bcc3-403e-9fd4-28a487055406 tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:15 devstack sudo[105226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7
Nov 06 17:23:15 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:15 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e4f4a58a-99f3-4864-a0e0-63aede12e478 tempest-VolumeDependencyTests-1670893737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486" returned: 0 in 0.522s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e4f4a58a-99f3-4864-a0e0-63aede12e478 tempest-VolumeDependencyTests-1670893737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:15 devstack sudo[105232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486
Nov 06 17:23:15 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:15 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-740a3580-bcc3-403e-9fd4-28a487055406 tempest-ProjectReaderTests-1615857228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7" returned: 0 in 0.493s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-740a3580-bcc3-403e-9fd4-28a487055406 tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7.ba748fbb-1636-42ef-a21d-a058af1849a0 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:15 devstack sudo[105237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7.ba748fbb-1636-42ef-a21d-a058af1849a0
Nov 06 17:23:15 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:15 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e4f4a58a-99f3-4864-a0e0-63aede12e478 tempest-VolumeDependencyTests-1670893737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-98efbdac-bf88-49a8-99ef-bdfd04682486" returned: 0 in 0.380s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:15 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e4f4a58a-99f3-4864-a0e0-63aede12e478 tempest-VolumeDependencyTests-1670893737 None] Lock "cinder-quobyte-98efbdac-bf88-49a8-99ef-bdfd04682486" released by "delete_volume" :: held 0.989s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:15 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-e4f4a58a-99f3-4864-a0e0-63aede12e478 tempest-VolumeDependencyTests-1670893737 None] Created reservations ['c840fa5a-d923-46d4-8464-d73800fc949c', '4a2020d4-f040-460b-a42e-8b7e218b2faa', 'e9166d17-f10d-4731-a3e8-530f96b984c6', 'ed926a6a-3cc3-4705-9db9-aa2e578e1c94'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:23:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e4f4a58a-99f3-4864-a0e0-63aede12e478 tempest-VolumeDependencyTests-1670893737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e4f4a58a-99f3-4864-a0e0-63aede12e478 tempest-VolumeDependencyTests-1670893737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:15 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e4f4a58a-99f3-4864-a0e0-63aede12e478 tempest-VolumeDependencyTests-1670893737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:23:15 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e4f4a58a-99f3-4864-a0e0-63aede12e478 tempest-VolumeDependencyTests-1670893737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:23:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e4f4a58a-99f3-4864-a0e0-63aede12e478 tempest-VolumeDependencyTests-1670893737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e4f4a58a-99f3-4864-a0e0-63aede12e478 tempest-VolumeDependencyTests-1670893737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:15 devstack sudo[105244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:23:15 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:16 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-740a3580-bcc3-403e-9fd4-28a487055406 tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7.ba748fbb-1636-42ef-a21d-a058af1849a0" returned: 0 in 0.429s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-740a3580-bcc3-403e-9fd4-28a487055406 tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7.ba748fbb-1636-42ef-a21d-a058af1849a0 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:16 devstack sudo[105246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7.ba748fbb-1636-42ef-a21d-a058af1849a0
Nov 06 17:23:16 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:16 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e4f4a58a-99f3-4864-a0e0-63aede12e478 tempest-VolumeDependencyTests-1670893737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.305s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:16 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-e4f4a58a-99f3-4864-a0e0-63aede12e478 tempest-VolumeDependencyTests-1670893737 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:23:16 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-e4f4a58a-99f3-4864-a0e0-63aede12e478 tempest-VolumeDependencyTests-1670893737 None] Deleted volume successfully.
Nov 06 17:23:16 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e4f4a58a-99f3-4864-a0e0-63aede12e478 tempest-VolumeDependencyTests-1670893737 None] Lock "cinder-98efbdac-bf88-49a8-99ef-bdfd04682486-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:16 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-740a3580-bcc3-403e-9fd4-28a487055406 tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7.ba748fbb-1636-42ef-a21d-a058af1849a0" returned: 0 in 0.294s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:16 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-740a3580-bcc3-403e-9fd4-28a487055406 tempest-ProjectReaderTests-1615857228 None] Lock "cinder-quobyte-ba748fbb-1636-42ef-a21d-a058af1849a0" released by "_delete_snapshot" :: held 1.864s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:16 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-740a3580-bcc3-403e-9fd4-28a487055406 tempest-ProjectReaderTests-1615857228 None] Lock "cinder-quobyte-6af75b0d-0b9a-49b1-b891-72014870c0f7" released by "delete_snapshot" :: held 1.912s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:16 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-740a3580-bcc3-403e-9fd4-28a487055406 tempest-ProjectReaderTests-1615857228 None] Created reservations ['4f96f484-8544-477b-88a1-2bd9371818d1', '8b111e32-cf73-46c8-bef6-f3bd0f5b5d62', '46e3dee8-4622-497d-8516-7ae1abffe1be', '56ccca80-7efd-4e88-9cc7-e8980904416e'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:23:16 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-740a3580-bcc3-403e-9fd4-28a487055406 tempest-ProjectReaderTests-1615857228 None] Delete snapshot completed successfully.
Nov 06 17:23:16 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-740a3580-bcc3-403e-9fd4-28a487055406 tempest-ProjectReaderTests-1615857228 None] Lock "cinder-ba748fbb-1636-42ef-a21d-a058af1849a0-delete_snapshot" released by "delete_snapshot" :: held 2.146s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:16 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e0d4a6e8-398d-4f1b-ad7c-69c33e20a5e0 tempest-ProjectReaderTests-1615857228 None] Acquiring lock "cinder-6af75b0d-0b9a-49b1-b891-72014870c0f7-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:16 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e0d4a6e8-398d-4f1b-ad7c-69c33e20a5e0 tempest-ProjectReaderTests-1615857228 None] Lock "cinder-6af75b0d-0b9a-49b1-b891-72014870c0f7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:16 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e0d4a6e8-398d-4f1b-ad7c-69c33e20a5e0 tempest-ProjectReaderTests-1615857228 None] Acquiring lock "cinder-quobyte-6af75b0d-0b9a-49b1-b891-72014870c0f7" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:16 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e0d4a6e8-398d-4f1b-ad7c-69c33e20a5e0 tempest-ProjectReaderTests-1615857228 None] Lock "cinder-quobyte-6af75b0d-0b9a-49b1-b891-72014870c0f7" acquired by "delete_volume" :: waited 0.018s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:16 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[785589eb-a0e4-413f-b249-7c2ae6e3d756]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:23:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e0d4a6e8-398d-4f1b-ad7c-69c33e20a5e0 tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:16 devstack sudo[105250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7
Nov 06 17:23:16 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:16 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-6a277318-b3f7-4f28-b4a7-b3661488845c tempest-VolumeDependencyTests-1670893737 None] Acquiring lock "cinder-14c47e46-a98c-4107-9f16-8e79ffb26c1d-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:16 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-6a277318-b3f7-4f28-b4a7-b3661488845c tempest-VolumeDependencyTests-1670893737 None] Lock "cinder-14c47e46-a98c-4107-9f16-8e79ffb26c1d-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:17 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-6a277318-b3f7-4f28-b4a7-b3661488845c tempest-VolumeDependencyTests-1670893737 None] Acquiring lock "cinder-quobyte-14c47e46-a98c-4107-9f16-8e79ffb26c1d" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:17 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-6a277318-b3f7-4f28-b4a7-b3661488845c tempest-VolumeDependencyTests-1670893737 None] Lock "cinder-quobyte-14c47e46-a98c-4107-9f16-8e79ffb26c1d" acquired by "delete_volume" :: waited 0.025s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:17 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[12206fbe-a380-4166-aaed-06e3a84c8de9]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:23:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6a277318-b3f7-4f28-b4a7-b3661488845c tempest-VolumeDependencyTests-1670893737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-14c47e46-a98c-4107-9f16-8e79ffb26c1d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:17 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e0d4a6e8-398d-4f1b-ad7c-69c33e20a5e0 tempest-ProjectReaderTests-1615857228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7" returned: 0 in 0.462s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e0d4a6e8-398d-4f1b-ad7c-69c33e20a5e0 tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:17 devstack sudo[105256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7
Nov 06 17:23:17 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:17 devstack sudo[105255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-14c47e46-a98c-4107-9f16-8e79ffb26c1d
Nov 06 17:23:17 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:17 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e0d4a6e8-398d-4f1b-ad7c-69c33e20a5e0 tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-6af75b0d-0b9a-49b1-b891-72014870c0f7" returned: 0 in 0.338s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:17 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e0d4a6e8-398d-4f1b-ad7c-69c33e20a5e0 tempest-ProjectReaderTests-1615857228 None] Lock "cinder-quobyte-6af75b0d-0b9a-49b1-b891-72014870c0f7" released by "delete_volume" :: held 0.888s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:17 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6a277318-b3f7-4f28-b4a7-b3661488845c tempest-VolumeDependencyTests-1670893737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-14c47e46-a98c-4107-9f16-8e79ffb26c1d" returned: 0 in 0.443s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6a277318-b3f7-4f28-b4a7-b3661488845c tempest-VolumeDependencyTests-1670893737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-14c47e46-a98c-4107-9f16-8e79ffb26c1d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:17 devstack sudo[105263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-14c47e46-a98c-4107-9f16-8e79ffb26c1d
Nov 06 17:23:17 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:17 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-e0d4a6e8-398d-4f1b-ad7c-69c33e20a5e0 tempest-ProjectReaderTests-1615857228 None] Created reservations ['4e3a36c4-9067-4190-83a7-adc4c49336e5', '2a49160e-3ae4-4978-b501-38f0ea4c1077', 'c97623a5-f5c2-43e1-890d-e3472dde5baa', 'cb4cda5e-c5e4-4701-b0a9-0626892064d7'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:23:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e0d4a6e8-398d-4f1b-ad7c-69c33e20a5e0 tempest-ProjectReaderTests-1615857228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e0d4a6e8-398d-4f1b-ad7c-69c33e20a5e0 tempest-ProjectReaderTests-1615857228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:17 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e0d4a6e8-398d-4f1b-ad7c-69c33e20a5e0 tempest-ProjectReaderTests-1615857228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:23:17 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e0d4a6e8-398d-4f1b-ad7c-69c33e20a5e0 tempest-ProjectReaderTests-1615857228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:23:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e0d4a6e8-398d-4f1b-ad7c-69c33e20a5e0 tempest-ProjectReaderTests-1615857228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e0d4a6e8-398d-4f1b-ad7c-69c33e20a5e0 tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:17 devstack sudo[105265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:23:17 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:18 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6a277318-b3f7-4f28-b4a7-b3661488845c tempest-VolumeDependencyTests-1670893737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-14c47e46-a98c-4107-9f16-8e79ffb26c1d" returned: 0 in 0.425s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:18 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-6a277318-b3f7-4f28-b4a7-b3661488845c tempest-VolumeDependencyTests-1670893737 None] Lock "cinder-quobyte-14c47e46-a98c-4107-9f16-8e79ffb26c1d" released by "delete_volume" :: held 0.940s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:18 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-6a277318-b3f7-4f28-b4a7-b3661488845c tempest-VolumeDependencyTests-1670893737 None] Created reservations ['e4308343-2338-45cd-ab2b-bdc23bc723a1', '5ab87890-fde4-42f9-a423-8da62ef73d24', 'c8030537-ef2f-4675-845e-63536aba76fd', '0ff162b1-f42e-4fd3-9c22-d40e186973f6'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:23:18 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e0d4a6e8-398d-4f1b-ad7c-69c33e20a5e0 tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.435s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:18 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-e0d4a6e8-398d-4f1b-ad7c-69c33e20a5e0 tempest-ProjectReaderTests-1615857228 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:23:18 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-e0d4a6e8-398d-4f1b-ad7c-69c33e20a5e0 tempest-ProjectReaderTests-1615857228 None] Deleted volume successfully.
Nov 06 17:23:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6a277318-b3f7-4f28-b4a7-b3661488845c tempest-VolumeDependencyTests-1670893737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6a277318-b3f7-4f28-b4a7-b3661488845c tempest-VolumeDependencyTests-1670893737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:18 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-6a277318-b3f7-4f28-b4a7-b3661488845c tempest-VolumeDependencyTests-1670893737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:23:18 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-6a277318-b3f7-4f28-b4a7-b3661488845c tempest-VolumeDependencyTests-1670893737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:23:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6a277318-b3f7-4f28-b4a7-b3661488845c tempest-VolumeDependencyTests-1670893737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6a277318-b3f7-4f28-b4a7-b3661488845c tempest-VolumeDependencyTests-1670893737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:18 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e0d4a6e8-398d-4f1b-ad7c-69c33e20a5e0 tempest-ProjectReaderTests-1615857228 None] Lock "cinder-6af75b0d-0b9a-49b1-b891-72014870c0f7-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:18 devstack sudo[105269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:23:18 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:18 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bfc0c5a-f9c4-40fa-af5d-35a0334ea393 tempest-ProjectReaderTests-1615857228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:23:18 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0bfc0c5a-f9c4-40fa-af5d-35a0334ea393 tempest-ProjectReaderTests-1615857228 None] Flow 'volume_create_manager' (e624811a-52a5-4836-a990-d8e2d9c9e665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:23:18 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0bfc0c5a-f9c4-40fa-af5d-35a0334ea393 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd74c189-3c58-44b8-8ef3-44bcf74b6d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:18 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6a277318-b3f7-4f28-b4a7-b3661488845c tempest-VolumeDependencyTests-1670893737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.309s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:18 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-6a277318-b3f7-4f28-b4a7-b3661488845c tempest-VolumeDependencyTests-1670893737 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:23:18 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0bfc0c5a-f9c4-40fa-af5d-35a0334ea393 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd74c189-3c58-44b8-8ef3-44bcf74b6d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1374460100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=586070d2-1c63-4f48-a60f-37a5135c2476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e765fbd33c2345449278669b7fd8c195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:23:19Z,use_quota=True,user_id='b7b89c3c77ff44f4adddd9248571825a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:18 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0bfc0c5a-f9c4-40fa-af5d-35a0334ea393 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a567d925-ab8e-4228-810d-04df505d869b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:18 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0bfc0c5a-f9c4-40fa-af5d-35a0334ea393 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a567d925-ab8e-4228-810d-04df505d869b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:18 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0bfc0c5a-f9c4-40fa-af5d-35a0334ea393 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6907189-8863-4ddc-b714-36387dcb7560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:18 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0bfc0c5a-f9c4-40fa-af5d-35a0334ea393 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6907189-8863-4ddc-b714-36387dcb7560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '586070d2-1c63-4f48-a60f-37a5135c2476', 'volume_name': 'volume-586070d2-1c63-4f48-a60f-37a5135c2476', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:18 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0bfc0c5a-f9c4-40fa-af5d-35a0334ea393 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd8ebc77-22b9-4a64-9952-32235d91d74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:18 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0bfc0c5a-f9c4-40fa-af5d-35a0334ea393 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd8ebc77-22b9-4a64-9952-32235d91d74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:18 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0bfc0c5a-f9c4-40fa-af5d-35a0334ea393 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (505537c5-80d1-4549-9543-bc5f47d6d6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:18 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-0bfc0c5a-f9c4-40fa-af5d-35a0334ea393 tempest-ProjectReaderTests-1615857228 None] Volume 586070d2-1c63-4f48-a60f-37a5135c2476: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-586070d2-1c63-4f48-a60f-37a5135c2476', 'volume_size': 1}
Nov 06 17:23:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0bfc0c5a-f9c4-40fa-af5d-35a0334ea393 tempest-ProjectReaderTests-1615857228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0bfc0c5a-f9c4-40fa-af5d-35a0334ea393 tempest-ProjectReaderTests-1615857228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:18 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0bfc0c5a-f9c4-40fa-af5d-35a0334ea393 tempest-ProjectReaderTests-1615857228 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1374460100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=586070d2-1c63-4f48-a60f-37a5135c2476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e765fbd33c2345449278669b7fd8c195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:23:19Z,use_quota=True,user_id='b7b89c3c77ff44f4adddd9248571825a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:23:18 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-0bfc0c5a-f9c4-40fa-af5d-35a0334ea393 tempest-ProjectReaderTests-1615857228 None] Creating volume 586070d2-1c63-4f48-a60f-37a5135c2476 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:23:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0bfc0c5a-f9c4-40fa-af5d-35a0334ea393 tempest-ProjectReaderTests-1615857228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0bfc0c5a-f9c4-40fa-af5d-35a0334ea393 tempest-ProjectReaderTests-1615857228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:18 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0bfc0c5a-f9c4-40fa-af5d-35a0334ea393 tempest-ProjectReaderTests-1615857228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:23:18 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0bfc0c5a-f9c4-40fa-af5d-35a0334ea393 tempest-ProjectReaderTests-1615857228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:23:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0bfc0c5a-f9c4-40fa-af5d-35a0334ea393 tempest-ProjectReaderTests-1615857228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:18 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0bfc0c5a-f9c4-40fa-af5d-35a0334ea393 tempest-ProjectReaderTests-1615857228 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:23:18 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-0bfc0c5a-f9c4-40fa-af5d-35a0334ea393 tempest-ProjectReaderTests-1615857228 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:23:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0bfc0c5a-f9c4-40fa-af5d-35a0334ea393 tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:18 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-6a277318-b3f7-4f28-b4a7-b3661488845c tempest-VolumeDependencyTests-1670893737 None] Deleted volume successfully.
Nov 06 17:23:18 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-6a277318-b3f7-4f28-b4a7-b3661488845c tempest-VolumeDependencyTests-1670893737 None] Lock "cinder-14c47e46-a98c-4107-9f16-8e79ffb26c1d-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:18 devstack sudo[105272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476 1073741824
Nov 06 17:23:18 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:19 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0bfc0c5a-f9c4-40fa-af5d-35a0334ea393 tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476 1073741824" returned: 0 in 0.552s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0bfc0c5a-f9c4-40fa-af5d-35a0334ea393 tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:19 devstack sudo[105278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476
Nov 06 17:23:19 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:19 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0bfc0c5a-f9c4-40fa-af5d-35a0334ea393 tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476" returned: 0 in 0.435s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:19 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0bfc0c5a-f9c4-40fa-af5d-35a0334ea393 tempest-ProjectReaderTests-1615857228 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:23:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0bfc0c5a-f9c4-40fa-af5d-35a0334ea393 tempest-ProjectReaderTests-1615857228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:19 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0bfc0c5a-f9c4-40fa-af5d-35a0334ea393 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (505537c5-80d1-4549-9543-bc5f47d6d6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-586070d2-1c63-4f48-a60f-37a5135c2476', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:19 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0bfc0c5a-f9c4-40fa-af5d-35a0334ea393 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ccad2fc-0db0-415e-9453-95ea6395d171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:19 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-0bfc0c5a-f9c4-40fa-af5d-35a0334ea393 tempest-ProjectReaderTests-1615857228 None] Volume volume-586070d2-1c63-4f48-a60f-37a5135c2476 (586070d2-1c63-4f48-a60f-37a5135c2476): created successfully
Nov 06 17:23:19 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0bfc0c5a-f9c4-40fa-af5d-35a0334ea393 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ccad2fc-0db0-415e-9453-95ea6395d171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:19 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0bfc0c5a-f9c4-40fa-af5d-35a0334ea393 tempest-ProjectReaderTests-1615857228 None] Flow 'volume_create_manager' (e624811a-52a5-4836-a990-d8e2d9c9e665) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:23:19 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-0bfc0c5a-f9c4-40fa-af5d-35a0334ea393 tempest-ProjectReaderTests-1615857228 None] Created volume successfully.
Nov 06 17:23:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9d0c7091-2d55-406d-90a5-8bc8a7872e8b tempest-ProjectReaderTests-1615857228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9d0c7091-2d55-406d-90a5-8bc8a7872e8b tempest-ProjectReaderTests-1615857228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:20 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-9d0c7091-2d55-406d-90a5-8bc8a7872e8b tempest-ProjectReaderTests-1615857228 None] Creating offline snapshot ae48e846-9eff-4f6a-b7a6-1eeff6c9572b of volume 586070d2-1c63-4f48-a60f-37a5135c2476 {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:23:20 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34e918a-329b-466d-bb00-6e2e759b2f03]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:23:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9d0c7091-2d55-406d-90a5-8bc8a7872e8b tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:21 devstack sudo[105281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476
Nov 06 17:23:21 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:21 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9d0c7091-2d55-406d-90a5-8bc8a7872e8b tempest-ProjectReaderTests-1615857228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476" returned: 0 in 0.498s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9d0c7091-2d55-406d-90a5-8bc8a7872e8b tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476.ae48e846-9eff-4f6a-b7a6-1eeff6c9572b 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:21 devstack sudo[105286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476.ae48e846-9eff-4f6a-b7a6-1eeff6c9572b 1G
Nov 06 17:23:21 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:22 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9d0c7091-2d55-406d-90a5-8bc8a7872e8b tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476.ae48e846-9eff-4f6a-b7a6-1eeff6c9572b 1G" returned: 0 in 0.589s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9d0c7091-2d55-406d-90a5-8bc8a7872e8b tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-586070d2-1c63-4f48-a60f-37a5135c2476 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476.ae48e846-9eff-4f6a-b7a6-1eeff6c9572b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:22 devstack sudo[105292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-586070d2-1c63-4f48-a60f-37a5135c2476 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476.ae48e846-9eff-4f6a-b7a6-1eeff6c9572b
Nov 06 17:23:22 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:22 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9d0c7091-2d55-406d-90a5-8bc8a7872e8b tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-586070d2-1c63-4f48-a60f-37a5135c2476 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476.ae48e846-9eff-4f6a-b7a6-1eeff6c9572b" returned: 0 in 0.450s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:22 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-9d0c7091-2d55-406d-90a5-8bc8a7872e8b tempest-ProjectReaderTests-1615857228 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476.ae48e846-9eff-4f6a-b7a6-1eeff6c9572b is being set with open permissions: ugo+rw
Nov 06 17:23:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9d0c7091-2d55-406d-90a5-8bc8a7872e8b tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476.ae48e846-9eff-4f6a-b7a6-1eeff6c9572b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:22 devstack sudo[105298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476.ae48e846-9eff-4f6a-b7a6-1eeff6c9572b
Nov 06 17:23:22 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:22 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9d0c7091-2d55-406d-90a5-8bc8a7872e8b tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476.ae48e846-9eff-4f6a-b7a6-1eeff6c9572b" returned: 0 in 0.417s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9d0c7091-2d55-406d-90a5-8bc8a7872e8b tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:23 devstack sudo[105301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476.info
Nov 06 17:23:23 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:23 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9d0c7091-2d55-406d-90a5-8bc8a7872e8b tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476.info" returned: 0 in 0.444s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:23 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-9d0c7091-2d55-406d-90a5-8bc8a7872e8b tempest-ProjectReaderTests-1615857228 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476.info is being set with open permissions: ugo+rw
Nov 06 17:23:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9d0c7091-2d55-406d-90a5-8bc8a7872e8b tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:23 devstack sudo[105304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476.info
Nov 06 17:23:23 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:23 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9d0c7091-2d55-406d-90a5-8bc8a7872e8b tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476.info" returned: 0 in 0.399s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9d0c7091-2d55-406d-90a5-8bc8a7872e8b tempest-ProjectReaderTests-1615857228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.943s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:23 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-9d0c7091-2d55-406d-90a5-8bc8a7872e8b tempest-ProjectReaderTests-1615857228 None] Create snapshot completed successfully
Nov 06 17:23:24 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7b65d2a6-82bc-4b6d-a3e6-a4040be81893 tempest-ProjectReaderTests-1615857228 None] Acquiring lock "cinder-ae48e846-9eff-4f6a-b7a6-1eeff6c9572b-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:24 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7b65d2a6-82bc-4b6d-a3e6-a4040be81893 tempest-ProjectReaderTests-1615857228 None] Lock "cinder-ae48e846-9eff-4f6a-b7a6-1eeff6c9572b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:24 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7b65d2a6-82bc-4b6d-a3e6-a4040be81893 tempest-ProjectReaderTests-1615857228 None] Acquiring lock "cinder-quobyte-586070d2-1c63-4f48-a60f-37a5135c2476" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:24 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7b65d2a6-82bc-4b6d-a3e6-a4040be81893 tempest-ProjectReaderTests-1615857228 None] Lock "cinder-quobyte-586070d2-1c63-4f48-a60f-37a5135c2476" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:24 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7b65d2a6-82bc-4b6d-a3e6-a4040be81893 tempest-ProjectReaderTests-1615857228 None] Acquiring lock "cinder-quobyte-ae48e846-9eff-4f6a-b7a6-1eeff6c9572b" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:24 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7b65d2a6-82bc-4b6d-a3e6-a4040be81893 tempest-ProjectReaderTests-1615857228 None] Lock "cinder-quobyte-ae48e846-9eff-4f6a-b7a6-1eeff6c9572b" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:24 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-7b65d2a6-82bc-4b6d-a3e6-a4040be81893 tempest-ProjectReaderTests-1615857228 None] Deleting offline snapshot ae48e846-9eff-4f6a-b7a6-1eeff6c9572b of volume 586070d2-1c63-4f48-a60f-37a5135c2476 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:23:24 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-7b65d2a6-82bc-4b6d-a3e6-a4040be81893 tempest-ProjectReaderTests-1615857228 None] snapshot_file for this snap is: volume-586070d2-1c63-4f48-a60f-37a5135c2476.ae48e846-9eff-4f6a-b7a6-1eeff6c9572b {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:23:24 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[86194578-0824-451a-a678-609a26b4c44a]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:23:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7b65d2a6-82bc-4b6d-a3e6-a4040be81893 tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476.ae48e846-9eff-4f6a-b7a6-1eeff6c9572b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:24 devstack sudo[105307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476.ae48e846-9eff-4f6a-b7a6-1eeff6c9572b
Nov 06 17:23:24 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:24 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7b65d2a6-82bc-4b6d-a3e6-a4040be81893 tempest-ProjectReaderTests-1615857228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476.ae48e846-9eff-4f6a-b7a6-1eeff6c9572b" returned: 0 in 0.479s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:24 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-7b65d2a6-82bc-4b6d-a3e6-a4040be81893 tempest-ProjectReaderTests-1615857228 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-586070d2-1c63-4f48-a60f-37a5135c2476(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:23:24 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a640ad8-7a72-467b-8d8a-b3238345e59f]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:23:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7b65d2a6-82bc-4b6d-a3e6-a4040be81893 tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:25 devstack sudo[105312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476
Nov 06 17:23:25 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:25 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7b65d2a6-82bc-4b6d-a3e6-a4040be81893 tempest-ProjectReaderTests-1615857228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476" returned: 0 in 0.655s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7b65d2a6-82bc-4b6d-a3e6-a4040be81893 tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476.ae48e846-9eff-4f6a-b7a6-1eeff6c9572b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:25 devstack sudo[105317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476.ae48e846-9eff-4f6a-b7a6-1eeff6c9572b
Nov 06 17:23:25 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:25 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-794f2bff-e5ce-4ce7-98c4-b5af3c8f4c6a tempest-CinderUnicodeTest-577573497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:23:25 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-794f2bff-e5ce-4ce7-98c4-b5af3c8f4c6a tempest-CinderUnicodeTest-577573497 None] Flow 'volume_create_manager' (ede83736-67e6-45e0-b393-4d1654dab9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:23:25 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-794f2bff-e5ce-4ce7-98c4-b5af3c8f4c6a tempest-CinderUnicodeTest-577573497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea6a2fee-19c0-4fc9-8264-69a7152dfb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:25 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-794f2bff-e5ce-4ce7-98c4-b5af3c8f4c6a tempest-CinderUnicodeTest-577573497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea6a2fee-19c0-4fc9-8264-69a7152dfb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=138a613f-02b1-4f9a-a4df-39a6f219a967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f5a052765214170ad76d7ee410ef753',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:23:26Z,use_quota=True,user_id='23dc6bbe9894453ab662e039b1d17d07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:25 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-794f2bff-e5ce-4ce7-98c4-b5af3c8f4c6a tempest-CinderUnicodeTest-577573497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9e99d6c-702f-4ab8-819c-ef8c118cb7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:25 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-794f2bff-e5ce-4ce7-98c4-b5af3c8f4c6a tempest-CinderUnicodeTest-577573497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9e99d6c-702f-4ab8-819c-ef8c118cb7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:25 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-794f2bff-e5ce-4ce7-98c4-b5af3c8f4c6a tempest-CinderUnicodeTest-577573497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe723f83-8d27-4a9b-b830-3442751bbd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:25 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-794f2bff-e5ce-4ce7-98c4-b5af3c8f4c6a tempest-CinderUnicodeTest-577573497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe723f83-8d27-4a9b-b830-3442751bbd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '138a613f-02b1-4f9a-a4df-39a6f219a967', 'volume_name': 'volume-138a613f-02b1-4f9a-a4df-39a6f219a967', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:25 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-794f2bff-e5ce-4ce7-98c4-b5af3c8f4c6a tempest-CinderUnicodeTest-577573497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4339d0ec-3bb2-49bb-bfbe-e2bc43129630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:25 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-794f2bff-e5ce-4ce7-98c4-b5af3c8f4c6a tempest-CinderUnicodeTest-577573497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4339d0ec-3bb2-49bb-bfbe-e2bc43129630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:25 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-794f2bff-e5ce-4ce7-98c4-b5af3c8f4c6a tempest-CinderUnicodeTest-577573497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (364f32ec-23f9-44bc-bf68-75334911e745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:25 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-794f2bff-e5ce-4ce7-98c4-b5af3c8f4c6a tempest-CinderUnicodeTest-577573497 None] Volume 138a613f-02b1-4f9a-a4df-39a6f219a967: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-138a613f-02b1-4f9a-a4df-39a6f219a967', 'volume_size': 1}
Nov 06 17:23:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-794f2bff-e5ce-4ce7-98c4-b5af3c8f4c6a tempest-CinderUnicodeTest-577573497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-794f2bff-e5ce-4ce7-98c4-b5af3c8f4c6a tempest-CinderUnicodeTest-577573497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:25 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-794f2bff-e5ce-4ce7-98c4-b5af3c8f4c6a tempest-CinderUnicodeTest-577573497 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=138a613f-02b1-4f9a-a4df-39a6f219a967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f5a052765214170ad76d7ee410ef753',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:23:26Z,use_quota=True,user_id='23dc6bbe9894453ab662e039b1d17d07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:23:25 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-794f2bff-e5ce-4ce7-98c4-b5af3c8f4c6a tempest-CinderUnicodeTest-577573497 None] Creating volume 138a613f-02b1-4f9a-a4df-39a6f219a967 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:23:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-794f2bff-e5ce-4ce7-98c4-b5af3c8f4c6a tempest-CinderUnicodeTest-577573497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-794f2bff-e5ce-4ce7-98c4-b5af3c8f4c6a tempest-CinderUnicodeTest-577573497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:25 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-794f2bff-e5ce-4ce7-98c4-b5af3c8f4c6a tempest-CinderUnicodeTest-577573497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:23:25 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-794f2bff-e5ce-4ce7-98c4-b5af3c8f4c6a tempest-CinderUnicodeTest-577573497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:23:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-794f2bff-e5ce-4ce7-98c4-b5af3c8f4c6a tempest-CinderUnicodeTest-577573497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:25 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-794f2bff-e5ce-4ce7-98c4-b5af3c8f4c6a tempest-CinderUnicodeTest-577573497 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:23:25 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-794f2bff-e5ce-4ce7-98c4-b5af3c8f4c6a tempest-CinderUnicodeTest-577573497 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:23:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-794f2bff-e5ce-4ce7-98c4-b5af3c8f4c6a tempest-CinderUnicodeTest-577573497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-138a613f-02b1-4f9a-a4df-39a6f219a967 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:25 devstack sudo[105322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-138a613f-02b1-4f9a-a4df-39a6f219a967 1073741824
Nov 06 17:23:25 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:25 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ebb62b1-3ea8-486c-9ce2-08033c1afe58 tempest-ProjectReaderTests-1259557497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:23:25 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6ebb62b1-3ea8-486c-9ce2-08033c1afe58 tempest-ProjectReaderTests-1259557497 None] Flow 'volume_create_manager' (6d85de21-a09c-4b7b-aa76-f70dcebe9088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:23:25 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6ebb62b1-3ea8-486c-9ce2-08033c1afe58 tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a6f8e6-6565-46a1-8b7e-3f5a76148af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6ebb62b1-3ea8-486c-9ce2-08033c1afe58 tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a6f8e6-6565-46a1-8b7e-3f5a76148af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1831218395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68a4286b-1405-4b3c-b54d-fad508b9229d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b143ddd07a13462282cdb1f6553fba15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:23:26Z,use_quota=True,user_id='d808cf170c5847029339b1a0bae5b3e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6ebb62b1-3ea8-486c-9ce2-08033c1afe58 tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (718c22b1-face-4174-b586-0e550e0c5bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6ebb62b1-3ea8-486c-9ce2-08033c1afe58 tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (718c22b1-face-4174-b586-0e550e0c5bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:26 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6ebb62b1-3ea8-486c-9ce2-08033c1afe58 tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (827b57f6-8471-44a2-be31-5b903beb8170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6ebb62b1-3ea8-486c-9ce2-08033c1afe58 tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (827b57f6-8471-44a2-be31-5b903beb8170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68a4286b-1405-4b3c-b54d-fad508b9229d', 'volume_name': 'volume-68a4286b-1405-4b3c-b54d-fad508b9229d', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6ebb62b1-3ea8-486c-9ce2-08033c1afe58 tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4cec880-9168-4d12-a7ad-405a21ab4504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6ebb62b1-3ea8-486c-9ce2-08033c1afe58 tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4cec880-9168-4d12-a7ad-405a21ab4504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6ebb62b1-3ea8-486c-9ce2-08033c1afe58 tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a28429-89ad-4863-9fab-be1aa1963fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:26 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-6ebb62b1-3ea8-486c-9ce2-08033c1afe58 tempest-ProjectReaderTests-1259557497 None] Volume 68a4286b-1405-4b3c-b54d-fad508b9229d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68a4286b-1405-4b3c-b54d-fad508b9229d', 'volume_size': 1}
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6ebb62b1-3ea8-486c-9ce2-08033c1afe58 tempest-ProjectReaderTests-1259557497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7b65d2a6-82bc-4b6d-a3e6-a4040be81893 tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476.ae48e846-9eff-4f6a-b7a6-1eeff6c9572b" returned: 0 in 0.492s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7b65d2a6-82bc-4b6d-a3e6-a4040be81893 tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476.ae48e846-9eff-4f6a-b7a6-1eeff6c9572b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:26 devstack sudo[105325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476.ae48e846-9eff-4f6a-b7a6-1eeff6c9572b
Nov 06 17:23:26 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:26 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7b65d2a6-82bc-4b6d-a3e6-a4040be81893 tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476.ae48e846-9eff-4f6a-b7a6-1eeff6c9572b" returned: 0 in 0.289s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:26 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-794f2bff-e5ce-4ce7-98c4-b5af3c8f4c6a tempest-CinderUnicodeTest-577573497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-138a613f-02b1-4f9a-a4df-39a6f219a967 1073741824" returned: 0 in 0.512s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7b65d2a6-82bc-4b6d-a3e6-a4040be81893 tempest-ProjectReaderTests-1615857228 None] Lock "cinder-quobyte-ae48e846-9eff-4f6a-b7a6-1eeff6c9572b" released by "_delete_snapshot" :: held 2.074s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7b65d2a6-82bc-4b6d-a3e6-a4040be81893 tempest-ProjectReaderTests-1615857228 None] Lock "cinder-quobyte-586070d2-1c63-4f48-a60f-37a5135c2476" released by "delete_snapshot" :: held 2.113s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-794f2bff-e5ce-4ce7-98c4-b5af3c8f4c6a tempest-CinderUnicodeTest-577573497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-138a613f-02b1-4f9a-a4df-39a6f219a967 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:26 devstack sudo[105332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-138a613f-02b1-4f9a-a4df-39a6f219a967
Nov 06 17:23:26 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-7b65d2a6-82bc-4b6d-a3e6-a4040be81893 tempest-ProjectReaderTests-1615857228 None] Created reservations ['d585145b-b4ee-4736-9e4a-90a76bf28f48', '599919f3-1fdf-48ae-9709-f396f0a634e8', 'ada244ae-16c7-48b5-99c2-0c1ccf9733d6', '3d0d4e8d-a628-46b4-9de2-4e4d64992c78'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:23:26 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-7b65d2a6-82bc-4b6d-a3e6-a4040be81893 tempest-ProjectReaderTests-1615857228 None] Delete snapshot completed successfully.
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7b65d2a6-82bc-4b6d-a3e6-a4040be81893 tempest-ProjectReaderTests-1615857228 None] Lock "cinder-ae48e846-9eff-4f6a-b7a6-1eeff6c9572b-delete_snapshot" released by "delete_snapshot" :: held 2.371s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:26 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-794f2bff-e5ce-4ce7-98c4-b5af3c8f4c6a tempest-CinderUnicodeTest-577573497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-138a613f-02b1-4f9a-a4df-39a6f219a967" returned: 0 in 0.280s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-794f2bff-e5ce-4ce7-98c4-b5af3c8f4c6a tempest-CinderUnicodeTest-577573497 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-794f2bff-e5ce-4ce7-98c4-b5af3c8f4c6a tempest-CinderUnicodeTest-577573497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6ebb62b1-3ea8-486c-9ce2-08033c1afe58 tempest-ProjectReaderTests-1259557497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.684s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-6ebb62b1-3ea8-486c-9ce2-08033c1afe58 tempest-ProjectReaderTests-1259557497 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1831218395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68a4286b-1405-4b3c-b54d-fad508b9229d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b143ddd07a13462282cdb1f6553fba15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:23:26Z,use_quota=True,user_id='d808cf170c5847029339b1a0bae5b3e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-6ebb62b1-3ea8-486c-9ce2-08033c1afe58 tempest-ProjectReaderTests-1259557497 None] Creating volume 68a4286b-1405-4b3c-b54d-fad508b9229d {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6ebb62b1-3ea8-486c-9ce2-08033c1afe58 tempest-ProjectReaderTests-1259557497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6ebb62b1-3ea8-486c-9ce2-08033c1afe58 tempest-ProjectReaderTests-1259557497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-6ebb62b1-3ea8-486c-9ce2-08033c1afe58 tempest-ProjectReaderTests-1259557497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-6ebb62b1-3ea8-486c-9ce2-08033c1afe58 tempest-ProjectReaderTests-1259557497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6ebb62b1-3ea8-486c-9ce2-08033c1afe58 tempest-ProjectReaderTests-1259557497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-6ebb62b1-3ea8-486c-9ce2-08033c1afe58 tempest-ProjectReaderTests-1259557497 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:23:26 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-6ebb62b1-3ea8-486c-9ce2-08033c1afe58 tempest-ProjectReaderTests-1259557497 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6ebb62b1-3ea8-486c-9ce2-08033c1afe58 tempest-ProjectReaderTests-1259557497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-68a4286b-1405-4b3c-b54d-fad508b9229d 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:26 devstack sudo[105335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-68a4286b-1405-4b3c-b54d-fad508b9229d 1073741824
Nov 06 17:23:26 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-794f2bff-e5ce-4ce7-98c4-b5af3c8f4c6a tempest-CinderUnicodeTest-577573497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (364f32ec-23f9-44bc-bf68-75334911e745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-138a613f-02b1-4f9a-a4df-39a6f219a967', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-794f2bff-e5ce-4ce7-98c4-b5af3c8f4c6a tempest-CinderUnicodeTest-577573497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d428e1c-b10c-425c-af37-5c9b380764ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:26 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-794f2bff-e5ce-4ce7-98c4-b5af3c8f4c6a tempest-CinderUnicodeTest-577573497 None] Volume volume-138a613f-02b1-4f9a-a4df-39a6f219a967 (138a613f-02b1-4f9a-a4df-39a6f219a967): created successfully
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-794f2bff-e5ce-4ce7-98c4-b5af3c8f4c6a tempest-CinderUnicodeTest-577573497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d428e1c-b10c-425c-af37-5c9b380764ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-794f2bff-e5ce-4ce7-98c4-b5af3c8f4c6a tempest-CinderUnicodeTest-577573497 None] Flow 'volume_create_manager' (ede83736-67e6-45e0-b393-4d1654dab9cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:23:26 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-794f2bff-e5ce-4ce7-98c4-b5af3c8f4c6a tempest-CinderUnicodeTest-577573497 None] Created volume successfully.
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad96d115-5b3c-4daa-bbf7-9e92f7b40080 tempest-SnapshotDependencyTests-346299755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ad96d115-5b3c-4daa-bbf7-9e92f7b40080 tempest-SnapshotDependencyTests-346299755 None] Flow 'volume_create_manager' (034cd853-2239-45d3-846e-bd60003102fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ad96d115-5b3c-4daa-bbf7-9e92f7b40080 tempest-SnapshotDependencyTests-346299755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10343770-7f0c-401d-9e87-d0af6505c61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ad96d115-5b3c-4daa-bbf7-9e92f7b40080 tempest-SnapshotDependencyTests-346299755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10343770-7f0c-401d-9e87-d0af6505c61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-166754420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0776511e-bbf8-45c2-b57c-d4ff2b62307a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa260c0068ab4e719873d827ad0c3e3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:23:27Z,use_quota=True,user_id='9134a5ef9c714d2787115d6d7430f2f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ad96d115-5b3c-4daa-bbf7-9e92f7b40080 tempest-SnapshotDependencyTests-346299755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03ff3de8-9936-4fc0-95ab-fd5964fdd569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ad96d115-5b3c-4daa-bbf7-9e92f7b40080 tempest-SnapshotDependencyTests-346299755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03ff3de8-9936-4fc0-95ab-fd5964fdd569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ad96d115-5b3c-4daa-bbf7-9e92f7b40080 tempest-SnapshotDependencyTests-346299755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a8dd787-7909-4024-a81b-2f48611cf1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ad96d115-5b3c-4daa-bbf7-9e92f7b40080 tempest-SnapshotDependencyTests-346299755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a8dd787-7909-4024-a81b-2f48611cf1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0776511e-bbf8-45c2-b57c-d4ff2b62307a', 'volume_name': 'volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ad96d115-5b3c-4daa-bbf7-9e92f7b40080 tempest-SnapshotDependencyTests-346299755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8342baf-b57e-4dc6-8e3e-36bbcc493e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ad96d115-5b3c-4daa-bbf7-9e92f7b40080 tempest-SnapshotDependencyTests-346299755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8342baf-b57e-4dc6-8e3e-36bbcc493e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ad96d115-5b3c-4daa-bbf7-9e92f7b40080 tempest-SnapshotDependencyTests-346299755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e5b78df-1758-4ad5-8831-61eb665e4270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:26 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-ad96d115-5b3c-4daa-bbf7-9e92f7b40080 tempest-SnapshotDependencyTests-346299755 None] Volume 0776511e-bbf8-45c2-b57c-d4ff2b62307a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a', 'volume_size': 1}
Nov 06 17:23:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ad96d115-5b3c-4daa-bbf7-9e92f7b40080 tempest-SnapshotDependencyTests-346299755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:27 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6ebb62b1-3ea8-486c-9ce2-08033c1afe58 tempest-ProjectReaderTests-1259557497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-68a4286b-1405-4b3c-b54d-fad508b9229d 1073741824" returned: 0 in 0.441s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6ebb62b1-3ea8-486c-9ce2-08033c1afe58 tempest-ProjectReaderTests-1259557497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-68a4286b-1405-4b3c-b54d-fad508b9229d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:27 devstack sudo[105343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-68a4286b-1405-4b3c-b54d-fad508b9229d
Nov 06 17:23:27 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:27 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6ebb62b1-3ea8-486c-9ce2-08033c1afe58 tempest-ProjectReaderTests-1259557497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-68a4286b-1405-4b3c-b54d-fad508b9229d" returned: 0 in 0.259s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:27 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-6ebb62b1-3ea8-486c-9ce2-08033c1afe58 tempest-ProjectReaderTests-1259557497 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:23:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6ebb62b1-3ea8-486c-9ce2-08033c1afe58 tempest-ProjectReaderTests-1259557497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ad96d115-5b3c-4daa-bbf7-9e92f7b40080 tempest-SnapshotDependencyTests-346299755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.489s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:27 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ad96d115-5b3c-4daa-bbf7-9e92f7b40080 tempest-SnapshotDependencyTests-346299755 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-166754420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0776511e-bbf8-45c2-b57c-d4ff2b62307a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa260c0068ab4e719873d827ad0c3e3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:23:27Z,use_quota=True,user_id='9134a5ef9c714d2787115d6d7430f2f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:23:27 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-ad96d115-5b3c-4daa-bbf7-9e92f7b40080 tempest-SnapshotDependencyTests-346299755 None] Creating volume 0776511e-bbf8-45c2-b57c-d4ff2b62307a {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:23:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ad96d115-5b3c-4daa-bbf7-9e92f7b40080 tempest-SnapshotDependencyTests-346299755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ad96d115-5b3c-4daa-bbf7-9e92f7b40080 tempest-SnapshotDependencyTests-346299755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:27 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ad96d115-5b3c-4daa-bbf7-9e92f7b40080 tempest-SnapshotDependencyTests-346299755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:23:27 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ad96d115-5b3c-4daa-bbf7-9e92f7b40080 tempest-SnapshotDependencyTests-346299755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:23:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ad96d115-5b3c-4daa-bbf7-9e92f7b40080 tempest-SnapshotDependencyTests-346299755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:27 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ad96d115-5b3c-4daa-bbf7-9e92f7b40080 tempest-SnapshotDependencyTests-346299755 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:23:27 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-ad96d115-5b3c-4daa-bbf7-9e92f7b40080 tempest-SnapshotDependencyTests-346299755 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:23:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ad96d115-5b3c-4daa-bbf7-9e92f7b40080 tempest-SnapshotDependencyTests-346299755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6ebb62b1-3ea8-486c-9ce2-08033c1afe58 tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a28429-89ad-4863-9fab-be1aa1963fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68a4286b-1405-4b3c-b54d-fad508b9229d', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:27 devstack sudo[105346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a 1073741824
Nov 06 17:23:27 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6ebb62b1-3ea8-486c-9ce2-08033c1afe58 tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (618b2407-9425-4ec9-ae5c-5657bd2082c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:27 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-fa69937a-eed4-4237-b779-dd33d52fca7b tempest-ProjectReaderTests-1615857228 None] Acquiring lock "cinder-586070d2-1c63-4f48-a60f-37a5135c2476-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:27 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-6ebb62b1-3ea8-486c-9ce2-08033c1afe58 tempest-ProjectReaderTests-1259557497 None] Volume volume-68a4286b-1405-4b3c-b54d-fad508b9229d (68a4286b-1405-4b3c-b54d-fad508b9229d): created successfully
Nov 06 17:23:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6ebb62b1-3ea8-486c-9ce2-08033c1afe58 tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (618b2407-9425-4ec9-ae5c-5657bd2082c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:27 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-6ebb62b1-3ea8-486c-9ce2-08033c1afe58 tempest-ProjectReaderTests-1259557497 None] Flow 'volume_create_manager' (6d85de21-a09c-4b7b-aa76-f70dcebe9088) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:23:27 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-fa69937a-eed4-4237-b779-dd33d52fca7b tempest-ProjectReaderTests-1615857228 None] Lock "cinder-586070d2-1c63-4f48-a60f-37a5135c2476-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:27 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-6ebb62b1-3ea8-486c-9ce2-08033c1afe58 tempest-ProjectReaderTests-1259557497 None] Created volume successfully.
Nov 06 17:23:27 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-fa69937a-eed4-4237-b779-dd33d52fca7b tempest-ProjectReaderTests-1615857228 None] Acquiring lock "cinder-quobyte-586070d2-1c63-4f48-a60f-37a5135c2476" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:27 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-fa69937a-eed4-4237-b779-dd33d52fca7b tempest-ProjectReaderTests-1615857228 None] Lock "cinder-quobyte-586070d2-1c63-4f48-a60f-37a5135c2476" acquired by "delete_volume" :: waited 0.019s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:27 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaaf8db1-99ec-444b-864b-5a6a817b61e6]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:23:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fa69937a-eed4-4237-b779-dd33d52fca7b tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:27 devstack sudo[105348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476
Nov 06 17:23:27 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-dd6a3a49-d0c5-4c82-bb27-f3f5eff5b774 tempest-ProjectReaderTests-1259557497 None] Acquiring lock "cinder-68a4286b-1405-4b3c-b54d-fad508b9229d-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-dd6a3a49-d0c5-4c82-bb27-f3f5eff5b774 tempest-ProjectReaderTests-1259557497 None] Lock "cinder-68a4286b-1405-4b3c-b54d-fad508b9229d-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:28 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ad96d115-5b3c-4daa-bbf7-9e92f7b40080 tempest-SnapshotDependencyTests-346299755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a 1073741824" returned: 0 in 0.691s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-dd6a3a49-d0c5-4c82-bb27-f3f5eff5b774 tempest-ProjectReaderTests-1259557497 None] Acquiring lock "cinder-quobyte-68a4286b-1405-4b3c-b54d-fad508b9229d" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-dd6a3a49-d0c5-4c82-bb27-f3f5eff5b774 tempest-ProjectReaderTests-1259557497 None] Lock "cinder-quobyte-68a4286b-1405-4b3c-b54d-fad508b9229d" acquired by "delete_volume" :: waited 0.026s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ad96d115-5b3c-4daa-bbf7-9e92f7b40080 tempest-SnapshotDependencyTests-346299755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:28 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[198a6636-3b3b-4cd3-a829-6324c0c59d45]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-dd6a3a49-d0c5-4c82-bb27-f3f5eff5b774 tempest-ProjectReaderTests-1259557497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-68a4286b-1405-4b3c-b54d-fad508b9229d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:28 devstack sudo[105357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a
Nov 06 17:23:28 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fa69937a-eed4-4237-b779-dd33d52fca7b tempest-ProjectReaderTests-1615857228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476" returned: 0 in 0.578s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fa69937a-eed4-4237-b779-dd33d52fca7b tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:28 devstack sudo[105360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476
Nov 06 17:23:28 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-f107150a-e005-4484-85d4-460896107fbb tempest-CinderUnicodeTest-577573497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f107150a-e005-4484-85d4-460896107fbb tempest-CinderUnicodeTest-577573497 None] Flow 'volume_create_manager' (c3523a05-7a18-46f7-a64a-88dbba04eceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f107150a-e005-4484-85d4-460896107fbb tempest-CinderUnicodeTest-577573497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f691082f-0e9d-45ca-a304-2582ea713f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f107150a-e005-4484-85d4-460896107fbb tempest-CinderUnicodeTest-577573497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f691082f-0e9d-45ca-a304-2582ea713f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:23:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-622420121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f6af15c-237c-4fc2-9aa8-d49d4997681f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f5a052765214170ad76d7ee410ef753',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:23:28Z,use_quota=True,user_id='23dc6bbe9894453ab662e039b1d17d07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f107150a-e005-4484-85d4-460896107fbb tempest-CinderUnicodeTest-577573497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bff724c-0baa-40f3-bf55-d48f9f2f960c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f107150a-e005-4484-85d4-460896107fbb tempest-CinderUnicodeTest-577573497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bff724c-0baa-40f3-bf55-d48f9f2f960c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:28 devstack sudo[105358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-68a4286b-1405-4b3c-b54d-fad508b9229d
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f107150a-e005-4484-85d4-460896107fbb tempest-CinderUnicodeTest-577573497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab78a8b7-bc44-4e61-894a-db444cc59696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:28 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f107150a-e005-4484-85d4-460896107fbb tempest-CinderUnicodeTest-577573497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab78a8b7-bc44-4e61-894a-db444cc59696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f6af15c-237c-4fc2-9aa8-d49d4997681f', 'volume_name': 'volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f107150a-e005-4484-85d4-460896107fbb tempest-CinderUnicodeTest-577573497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27bc5f32-25ef-4c4b-94fc-7fe8caa47bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f107150a-e005-4484-85d4-460896107fbb tempest-CinderUnicodeTest-577573497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27bc5f32-25ef-4c4b-94fc-7fe8caa47bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f107150a-e005-4484-85d4-460896107fbb tempest-CinderUnicodeTest-577573497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea8e545b-1c1d-4498-8d42-c6651125bb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:28 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-f107150a-e005-4484-85d4-460896107fbb tempest-CinderUnicodeTest-577573497 None] Volume 3f6af15c-237c-4fc2-9aa8-d49d4997681f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f', 'volume_size': 1}
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f107150a-e005-4484-85d4-460896107fbb tempest-CinderUnicodeTest-577573497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:28 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ad96d115-5b3c-4daa-bbf7-9e92f7b40080 tempest-SnapshotDependencyTests-346299755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a" returned: 0 in 0.258s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-ad96d115-5b3c-4daa-bbf7-9e92f7b40080 tempest-SnapshotDependencyTests-346299755 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ad96d115-5b3c-4daa-bbf7-9e92f7b40080 tempest-SnapshotDependencyTests-346299755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f107150a-e005-4484-85d4-460896107fbb tempest-CinderUnicodeTest-577573497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.085s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-f107150a-e005-4484-85d4-460896107fbb tempest-CinderUnicodeTest-577573497 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:23:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-622420121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f6af15c-237c-4fc2-9aa8-d49d4997681f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f5a052765214170ad76d7ee410ef753',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:23:28Z,use_quota=True,user_id='23dc6bbe9894453ab662e039b1d17d07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-f107150a-e005-4484-85d4-460896107fbb tempest-CinderUnicodeTest-577573497 None] Creating volume 3f6af15c-237c-4fc2-9aa8-d49d4997681f {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f107150a-e005-4484-85d4-460896107fbb tempest-CinderUnicodeTest-577573497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f107150a-e005-4484-85d4-460896107fbb tempest-CinderUnicodeTest-577573497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-f107150a-e005-4484-85d4-460896107fbb tempest-CinderUnicodeTest-577573497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-f107150a-e005-4484-85d4-460896107fbb tempest-CinderUnicodeTest-577573497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f107150a-e005-4484-85d4-460896107fbb tempest-CinderUnicodeTest-577573497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-f107150a-e005-4484-85d4-460896107fbb tempest-CinderUnicodeTest-577573497 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:23:28 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-f107150a-e005-4484-85d4-460896107fbb tempest-CinderUnicodeTest-577573497 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f107150a-e005-4484-85d4-460896107fbb tempest-CinderUnicodeTest-577573497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:28 devstack sudo[105365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f 1073741824
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ad96d115-5b3c-4daa-bbf7-9e92f7b40080 tempest-SnapshotDependencyTests-346299755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e5b78df-1758-4ad5-8831-61eb665e4270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:28 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:28 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ad96d115-5b3c-4daa-bbf7-9e92f7b40080 tempest-SnapshotDependencyTests-346299755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (417b2a04-ce4c-41c6-a4cc-ccc3ae8dbde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fa69937a-eed4-4237-b779-dd33d52fca7b tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-586070d2-1c63-4f48-a60f-37a5135c2476" returned: 0 in 0.285s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:28 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-ad96d115-5b3c-4daa-bbf7-9e92f7b40080 tempest-SnapshotDependencyTests-346299755 None] Volume volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a (0776511e-bbf8-45c2-b57c-d4ff2b62307a): created successfully
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ad96d115-5b3c-4daa-bbf7-9e92f7b40080 tempest-SnapshotDependencyTests-346299755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (417b2a04-ce4c-41c6-a4cc-ccc3ae8dbde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-ad96d115-5b3c-4daa-bbf7-9e92f7b40080 tempest-SnapshotDependencyTests-346299755 None] Flow 'volume_create_manager' (034cd853-2239-45d3-846e-bd60003102fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-fa69937a-eed4-4237-b779-dd33d52fca7b tempest-ProjectReaderTests-1615857228 None] Lock "cinder-quobyte-586070d2-1c63-4f48-a60f-37a5135c2476" released by "delete_volume" :: held 0.969s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:28 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-ad96d115-5b3c-4daa-bbf7-9e92f7b40080 tempest-SnapshotDependencyTests-346299755 None] Created volume successfully.
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-fa69937a-eed4-4237-b779-dd33d52fca7b tempest-ProjectReaderTests-1615857228 None] Created reservations ['48ea6449-f0a3-41c1-ae7a-8f3913eb742a', '7c9374ea-2819-46cc-9840-a393cfc80d60', '56174942-cc46-4647-80a6-7718bea64320', 'ec0c44e0-adb2-47d1-be03-96cf2c969355'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:23:28 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-dd6a3a49-d0c5-4c82-bb27-f3f5eff5b774 tempest-ProjectReaderTests-1259557497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-68a4286b-1405-4b3c-b54d-fad508b9229d" returned: 0 in 0.456s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-dd6a3a49-d0c5-4c82-bb27-f3f5eff5b774 tempest-ProjectReaderTests-1259557497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-68a4286b-1405-4b3c-b54d-fad508b9229d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:28 devstack sudo[105370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-68a4286b-1405-4b3c-b54d-fad508b9229d
Nov 06 17:23:28 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-fa69937a-eed4-4237-b779-dd33d52fca7b tempest-ProjectReaderTests-1615857228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-fa69937a-eed4-4237-b779-dd33d52fca7b tempest-ProjectReaderTests-1615857228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-fa69937a-eed4-4237-b779-dd33d52fca7b tempest-ProjectReaderTests-1615857228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-fa69937a-eed4-4237-b779-dd33d52fca7b tempest-ProjectReaderTests-1615857228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-fa69937a-eed4-4237-b779-dd33d52fca7b tempest-ProjectReaderTests-1615857228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fa69937a-eed4-4237-b779-dd33d52fca7b tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:28 devstack sudo[105375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:23:28 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:29 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f107150a-e005-4484-85d4-460896107fbb tempest-CinderUnicodeTest-577573497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f 1073741824" returned: 0 in 0.496s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:29 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-dd6a3a49-d0c5-4c82-bb27-f3f5eff5b774 tempest-ProjectReaderTests-1259557497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-68a4286b-1405-4b3c-b54d-fad508b9229d" returned: 0 in 0.304s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:29 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-dd6a3a49-d0c5-4c82-bb27-f3f5eff5b774 tempest-ProjectReaderTests-1259557497 None] Lock "cinder-quobyte-68a4286b-1405-4b3c-b54d-fad508b9229d" released by "delete_volume" :: held 0.829s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:29 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fa69937a-eed4-4237-b779-dd33d52fca7b tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.280s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:29 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-fa69937a-eed4-4237-b779-dd33d52fca7b tempest-ProjectReaderTests-1615857228 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:23:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f107150a-e005-4484-85d4-460896107fbb tempest-CinderUnicodeTest-577573497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:29 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-fa69937a-eed4-4237-b779-dd33d52fca7b tempest-ProjectReaderTests-1615857228 None] Deleted volume successfully.
Nov 06 17:23:29 devstack sudo[105380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f
Nov 06 17:23:29 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:29 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-fa69937a-eed4-4237-b779-dd33d52fca7b tempest-ProjectReaderTests-1615857228 None] Lock "cinder-586070d2-1c63-4f48-a60f-37a5135c2476-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:29 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-dd6a3a49-d0c5-4c82-bb27-f3f5eff5b774 tempest-ProjectReaderTests-1259557497 None] Created reservations ['1c09c131-5ed9-4f84-afcc-19694c0ea4e5', 'cf3e226a-4fd0-4350-8381-7abe4cd1887d', 'eff54b75-fa67-4168-839f-0fbc4bf3d453', '13f02d47-80cd-49f0-943b-6807cab05102'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:23:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-dd6a3a49-d0c5-4c82-bb27-f3f5eff5b774 tempest-ProjectReaderTests-1259557497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-dd6a3a49-d0c5-4c82-bb27-f3f5eff5b774 tempest-ProjectReaderTests-1259557497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:29 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-dd6a3a49-d0c5-4c82-bb27-f3f5eff5b774 tempest-ProjectReaderTests-1259557497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:23:29 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-dd6a3a49-d0c5-4c82-bb27-f3f5eff5b774 tempest-ProjectReaderTests-1259557497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:23:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-dd6a3a49-d0c5-4c82-bb27-f3f5eff5b774 tempest-ProjectReaderTests-1259557497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-dd6a3a49-d0c5-4c82-bb27-f3f5eff5b774 tempest-ProjectReaderTests-1259557497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:29 devstack sudo[105382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:23:29 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:29 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f107150a-e005-4484-85d4-460896107fbb tempest-CinderUnicodeTest-577573497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f" returned: 0 in 0.299s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:29 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-f107150a-e005-4484-85d4-460896107fbb tempest-CinderUnicodeTest-577573497 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:23:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f107150a-e005-4484-85d4-460896107fbb tempest-CinderUnicodeTest-577573497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f107150a-e005-4484-85d4-460896107fbb tempest-CinderUnicodeTest-577573497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea8e545b-1c1d-4498-8d42-c6651125bb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f107150a-e005-4484-85d4-460896107fbb tempest-CinderUnicodeTest-577573497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6767b38-1aec-4af0-98de-308727b03965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:29 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-f107150a-e005-4484-85d4-460896107fbb tempest-CinderUnicodeTest-577573497 None] Volume volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f (3f6af15c-237c-4fc2-9aa8-d49d4997681f): created successfully
Nov 06 17:23:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f107150a-e005-4484-85d4-460896107fbb tempest-CinderUnicodeTest-577573497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6767b38-1aec-4af0-98de-308727b03965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-f107150a-e005-4484-85d4-460896107fbb tempest-CinderUnicodeTest-577573497 None] Flow 'volume_create_manager' (c3523a05-7a18-46f7-a64a-88dbba04eceb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:23:29 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-f107150a-e005-4484-85d4-460896107fbb tempest-CinderUnicodeTest-577573497 None] Created volume successfully.
Nov 06 17:23:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-14fe98eb-ebd5-434d-9aa9-e0d4ebf38ff1 tempest-SnapshotDependencyTests-346299755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-14fe98eb-ebd5-434d-9aa9-e0d4ebf38ff1 tempest-SnapshotDependencyTests-346299755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:29 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-14fe98eb-ebd5-434d-9aa9-e0d4ebf38ff1 tempest-SnapshotDependencyTests-346299755 None] Creating offline snapshot eb7cfedf-3933-42f2-9c62-2bcf76017f0a of volume 0776511e-bbf8-45c2-b57c-d4ff2b62307a {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:23:29 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-dd6a3a49-d0c5-4c82-bb27-f3f5eff5b774 tempest-ProjectReaderTests-1259557497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.279s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:29 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-dd6a3a49-d0c5-4c82-bb27-f3f5eff5b774 tempest-ProjectReaderTests-1259557497 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:23:29 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-dd6a3a49-d0c5-4c82-bb27-f3f5eff5b774 tempest-ProjectReaderTests-1259557497 None] Deleted volume successfully.
Nov 06 17:23:29 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[32277058-72c7-4d83-b2db-65289da9a828]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:23:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-14fe98eb-ebd5-434d-9aa9-e0d4ebf38ff1 tempest-SnapshotDependencyTests-346299755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:29 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-dd6a3a49-d0c5-4c82-bb27-f3f5eff5b774 tempest-ProjectReaderTests-1259557497 None] Lock "cinder-68a4286b-1405-4b3c-b54d-fad508b9229d-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:29 devstack sudo[105386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a
Nov 06 17:23:29 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:29 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-14fe98eb-ebd5-434d-9aa9-e0d4ebf38ff1 tempest-SnapshotDependencyTests-346299755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a" returned: 0 in 0.375s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-14fe98eb-ebd5-434d-9aa9-e0d4ebf38ff1 tempest-SnapshotDependencyTests-346299755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a.eb7cfedf-3933-42f2-9c62-2bcf76017f0a 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:29 devstack sudo[105393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a.eb7cfedf-3933-42f2-9c62-2bcf76017f0a 1G
Nov 06 17:23:29 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:30 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9246c5c-a600-4d2a-8344-1793e46d9b21 tempest-ProjectReaderTests-1615857228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:23:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a9246c5c-a600-4d2a-8344-1793e46d9b21 tempest-ProjectReaderTests-1615857228 None] Flow 'volume_create_manager' (841b409a-13f6-471c-9531-9ca70b61e5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:23:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a9246c5c-a600-4d2a-8344-1793e46d9b21 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b63cb1a-d867-4863-97b5-76ebea05e446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a9246c5c-a600-4d2a-8344-1793e46d9b21 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b63cb1a-d867-4863-97b5-76ebea05e446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:23:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2126479011',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae7f8e6d-3c53-4636-9c79-5359f12e099a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e765fbd33c2345449278669b7fd8c195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:23:30Z,use_quota=True,user_id='b7b89c3c77ff44f4adddd9248571825a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a9246c5c-a600-4d2a-8344-1793e46d9b21 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b1221c-90a4-4cf1-94e0-be8747367da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a9246c5c-a600-4d2a-8344-1793e46d9b21 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b1221c-90a4-4cf1-94e0-be8747367da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a9246c5c-a600-4d2a-8344-1793e46d9b21 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9969b0aa-caf6-47f5-9972-a402859b4cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a9246c5c-a600-4d2a-8344-1793e46d9b21 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9969b0aa-caf6-47f5-9972-a402859b4cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae7f8e6d-3c53-4636-9c79-5359f12e099a', 'volume_name': 'volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a9246c5c-a600-4d2a-8344-1793e46d9b21 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e04a0ed0-7705-4594-91f1-a5211cc5ef36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a9246c5c-a600-4d2a-8344-1793e46d9b21 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e04a0ed0-7705-4594-91f1-a5211cc5ef36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a9246c5c-a600-4d2a-8344-1793e46d9b21 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2ecbdee-3123-40eb-8697-98d4e35c0a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:30 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-a9246c5c-a600-4d2a-8344-1793e46d9b21 tempest-ProjectReaderTests-1615857228 None] Volume ae7f8e6d-3c53-4636-9c79-5359f12e099a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a', 'volume_size': 1}
Nov 06 17:23:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a9246c5c-a600-4d2a-8344-1793e46d9b21 tempest-ProjectReaderTests-1615857228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:30 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-14fe98eb-ebd5-434d-9aa9-e0d4ebf38ff1 tempest-SnapshotDependencyTests-346299755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a.eb7cfedf-3933-42f2-9c62-2bcf76017f0a 1G" returned: 0 in 0.481s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-14fe98eb-ebd5-434d-9aa9-e0d4ebf38ff1 tempest-SnapshotDependencyTests-346299755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a.eb7cfedf-3933-42f2-9c62-2bcf76017f0a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:30 devstack sudo[105400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a.eb7cfedf-3933-42f2-9c62-2bcf76017f0a
Nov 06 17:23:30 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:30 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-14fe98eb-ebd5-434d-9aa9-e0d4ebf38ff1 tempest-SnapshotDependencyTests-346299755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a.eb7cfedf-3933-42f2-9c62-2bcf76017f0a" returned: 0 in 0.362s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:30 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-14fe98eb-ebd5-434d-9aa9-e0d4ebf38ff1 tempest-SnapshotDependencyTests-346299755 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a.eb7cfedf-3933-42f2-9c62-2bcf76017f0a is being set with open permissions: ugo+rw
Nov 06 17:23:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-14fe98eb-ebd5-434d-9aa9-e0d4ebf38ff1 tempest-SnapshotDependencyTests-346299755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a.eb7cfedf-3933-42f2-9c62-2bcf76017f0a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:30 devstack sudo[105405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a.eb7cfedf-3933-42f2-9c62-2bcf76017f0a
Nov 06 17:23:30 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2569b9f4-30bd-451b-8a95-357462ab6d76 tempest-CinderUnicodeTest-577573497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:30 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b3a33c8-601b-4cb6-8f0d-e750b06d9423 tempest-ProjectReaderTests-1259557497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:23:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-2b3a33c8-601b-4cb6-8f0d-e750b06d9423 tempest-ProjectReaderTests-1259557497 None] Flow 'volume_create_manager' (fe077ea6-0813-4559-9c44-ff38fc359f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:23:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-2b3a33c8-601b-4cb6-8f0d-e750b06d9423 tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7254fda7-92a5-483e-8d1c-cba644523cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-2b3a33c8-601b-4cb6-8f0d-e750b06d9423 tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7254fda7-92a5-483e-8d1c-cba644523cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-209598435',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9865262f-3258-438d-977b-8858365d3390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b143ddd07a13462282cdb1f6553fba15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:23:31Z,use_quota=True,user_id='d808cf170c5847029339b1a0bae5b3e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-2b3a33c8-601b-4cb6-8f0d-e750b06d9423 tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c793413e-9e62-459f-8f88-1d715c6979c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-2b3a33c8-601b-4cb6-8f0d-e750b06d9423 tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c793413e-9e62-459f-8f88-1d715c6979c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-2b3a33c8-601b-4cb6-8f0d-e750b06d9423 tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (881c366d-12af-4fa3-8816-a33ea6d14476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:31 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-2b3a33c8-601b-4cb6-8f0d-e750b06d9423 tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (881c366d-12af-4fa3-8816-a33ea6d14476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9865262f-3258-438d-977b-8858365d3390', 'volume_name': 'volume-9865262f-3258-438d-977b-8858365d3390', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-2b3a33c8-601b-4cb6-8f0d-e750b06d9423 tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f6ed02-d81d-474c-b5b0-4b15e2d40b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-2b3a33c8-601b-4cb6-8f0d-e750b06d9423 tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f6ed02-d81d-474c-b5b0-4b15e2d40b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:31 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-2b3a33c8-601b-4cb6-8f0d-e750b06d9423 tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48d4cb25-822a-421c-a752-866a8f3807d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:31 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-2b3a33c8-601b-4cb6-8f0d-e750b06d9423 tempest-ProjectReaderTests-1259557497 None] Volume 9865262f-3258-438d-977b-8858365d3390: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9865262f-3258-438d-977b-8858365d3390', 'volume_size': 1}
Nov 06 17:23:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2b3a33c8-601b-4cb6-8f0d-e750b06d9423 tempest-ProjectReaderTests-1259557497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-14fe98eb-ebd5-434d-9aa9-e0d4ebf38ff1 tempest-SnapshotDependencyTests-346299755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a.eb7cfedf-3933-42f2-9c62-2bcf76017f0a" returned: 0 in 0.267s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-14fe98eb-ebd5-434d-9aa9-e0d4ebf38ff1 tempest-SnapshotDependencyTests-346299755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:31 devstack sudo[105408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a.info
Nov 06 17:23:31 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:31 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-14fe98eb-ebd5-434d-9aa9-e0d4ebf38ff1 tempest-SnapshotDependencyTests-346299755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a.info" returned: 0 in 0.246s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:31 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-14fe98eb-ebd5-434d-9aa9-e0d4ebf38ff1 tempest-SnapshotDependencyTests-346299755 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a.info is being set with open permissions: ugo+rw
Nov 06 17:23:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-14fe98eb-ebd5-434d-9aa9-e0d4ebf38ff1 tempest-SnapshotDependencyTests-346299755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:31 devstack sudo[105411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a.info
Nov 06 17:23:31 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:31 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-14fe98eb-ebd5-434d-9aa9-e0d4ebf38ff1 tempest-SnapshotDependencyTests-346299755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a.info" returned: 0 in 0.246s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-14fe98eb-ebd5-434d-9aa9-e0d4ebf38ff1 tempest-SnapshotDependencyTests-346299755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.065s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a9246c5c-a600-4d2a-8344-1793e46d9b21 tempest-ProjectReaderTests-1615857228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.186s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:31 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a9246c5c-a600-4d2a-8344-1793e46d9b21 tempest-ProjectReaderTests-1615857228 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:23:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2126479011',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae7f8e6d-3c53-4636-9c79-5359f12e099a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e765fbd33c2345449278669b7fd8c195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:23:30Z,use_quota=True,user_id='b7b89c3c77ff44f4adddd9248571825a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:23:31 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-a9246c5c-a600-4d2a-8344-1793e46d9b21 tempest-ProjectReaderTests-1615857228 None] Creating volume ae7f8e6d-3c53-4636-9c79-5359f12e099a {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:23:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a9246c5c-a600-4d2a-8344-1793e46d9b21 tempest-ProjectReaderTests-1615857228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a9246c5c-a600-4d2a-8344-1793e46d9b21 tempest-ProjectReaderTests-1615857228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:31 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a9246c5c-a600-4d2a-8344-1793e46d9b21 tempest-ProjectReaderTests-1615857228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:23:31 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a9246c5c-a600-4d2a-8344-1793e46d9b21 tempest-ProjectReaderTests-1615857228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:23:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a9246c5c-a600-4d2a-8344-1793e46d9b21 tempest-ProjectReaderTests-1615857228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:31 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a9246c5c-a600-4d2a-8344-1793e46d9b21 tempest-ProjectReaderTests-1615857228 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:23:31 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-a9246c5c-a600-4d2a-8344-1793e46d9b21 tempest-ProjectReaderTests-1615857228 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:23:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a9246c5c-a600-4d2a-8344-1793e46d9b21 tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:31 devstack sudo[105414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a 1073741824
Nov 06 17:23:31 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:31 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-14fe98eb-ebd5-434d-9aa9-e0d4ebf38ff1 tempest-SnapshotDependencyTests-346299755 None] Create snapshot completed successfully
Nov 06 17:23:32 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a9246c5c-a600-4d2a-8344-1793e46d9b21 tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a 1073741824" returned: 0 in 0.439s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a9246c5c-a600-4d2a-8344-1793e46d9b21 tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:32 devstack sudo[105421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a
Nov 06 17:23:32 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:32 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a9246c5c-a600-4d2a-8344-1793e46d9b21 tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a" returned: 0 in 0.269s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:32 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a9246c5c-a600-4d2a-8344-1793e46d9b21 tempest-ProjectReaderTests-1615857228 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:23:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a9246c5c-a600-4d2a-8344-1793e46d9b21 tempest-ProjectReaderTests-1615857228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2569b9f4-30bd-451b-8a95-357462ab6d76 tempest-CinderUnicodeTest-577573497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.396s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a9246c5c-a600-4d2a-8344-1793e46d9b21 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2ecbdee-3123-40eb-8697-98d4e35c0a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a9246c5c-a600-4d2a-8344-1793e46d9b21 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f8f34c4-5dd3-4f68-9345-768e6824639b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:32 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-2569b9f4-30bd-451b-8a95-357462ab6d76 tempest-CinderUnicodeTest-577573497 None] Creating offline snapshot 0f924886-cd73-490c-915a-9a4e9a7f633d of volume 3f6af15c-237c-4fc2-9aa8-d49d4997681f {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:23:32 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-a9246c5c-a600-4d2a-8344-1793e46d9b21 tempest-ProjectReaderTests-1615857228 None] Volume volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a (ae7f8e6d-3c53-4636-9c79-5359f12e099a): created successfully
Nov 06 17:23:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a9246c5c-a600-4d2a-8344-1793e46d9b21 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f8f34c4-5dd3-4f68-9345-768e6824639b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-a9246c5c-a600-4d2a-8344-1793e46d9b21 tempest-ProjectReaderTests-1615857228 None] Flow 'volume_create_manager' (841b409a-13f6-471c-9531-9ca70b61e5a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:23:32 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ee3bec-f019-435f-a022-a5f6ba4cbf2e]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:23:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2569b9f4-30bd-451b-8a95-357462ab6d76 tempest-CinderUnicodeTest-577573497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:32 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:23:32 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-a9246c5c-a600-4d2a-8344-1793e46d9b21 tempest-ProjectReaderTests-1615857228 None] Created volume successfully.
Nov 06 17:23:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Flow 'volume_create_manager' (9e9abb08-b2fd-447f-b83a-63bdd00400fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:23:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bafc8ecb-2ffd-4bc9-876c-8c91d7b4ca77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bafc8ecb-2ffd-4bc9-876c-8c91d7b4ca77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b28dc557-ec91-47e1-bcf6-10f802ecb21b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa260c0068ab4e719873d827ad0c3e3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=eb7cfedf-3933-42f2-9c62-2bcf76017f0a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:23:32Z,use_quota=True,user_id='9134a5ef9c714d2787115d6d7430f2f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82850cdf-8fd8-4ddc-8188-f112bcbe83c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82850cdf-8fd8-4ddc-8188-f112bcbe83c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee1144f7-9d07-4559-8cca-32233bbac42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee1144f7-9d07-4559-8cca-32233bbac42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b28dc557-ec91-47e1-bcf6-10f802ecb21b', 'volume_name': 'volume-b28dc557-ec91-47e1-bcf6-10f802ecb21b', 'volume_size': 1, 'snapshot_id': 'eb7cfedf-3933-42f2-9c62-2bcf76017f0a'}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea37aaba-ee8f-4be6-8de0-bcc6fe156f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea37aaba-ee8f-4be6-8de0-bcc6fe156f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:32 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d948f47a-fbab-4ba3-abee-b807f74cd1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:32 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Volume b28dc557-ec91-47e1-bcf6-10f802ecb21b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b28dc557-ec91-47e1-bcf6-10f802ecb21b', 'volume_size': 1, 'snapshot_id': 'eb7cfedf-3933-42f2-9c62-2bcf76017f0a'}
Nov 06 17:23:32 devstack sudo[105424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f
Nov 06 17:23:32 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:32 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2569b9f4-30bd-451b-8a95-357462ab6d76 tempest-CinderUnicodeTest-577573497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f" returned: 0 in 0.377s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2569b9f4-30bd-451b-8a95-357462ab6d76 tempest-CinderUnicodeTest-577573497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f.0f924886-cd73-490c-915a-9a4e9a7f633d 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:32 devstack sudo[105429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f.0f924886-cd73-490c-915a-9a4e9a7f633d 1G
Nov 06 17:23:32 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:33 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2569b9f4-30bd-451b-8a95-357462ab6d76 tempest-CinderUnicodeTest-577573497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f.0f924886-cd73-490c-915a-9a4e9a7f633d 1G" returned: 0 in 0.399s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2569b9f4-30bd-451b-8a95-357462ab6d76 tempest-CinderUnicodeTest-577573497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f.0f924886-cd73-490c-915a-9a4e9a7f633d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:33 devstack sudo[105435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f.0f924886-cd73-490c-915a-9a4e9a7f633d
Nov 06 17:23:33 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:33 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2569b9f4-30bd-451b-8a95-357462ab6d76 tempest-CinderUnicodeTest-577573497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f.0f924886-cd73-490c-915a-9a4e9a7f633d" returned: 0 in 0.308s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:33 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-2569b9f4-30bd-451b-8a95-357462ab6d76 tempest-CinderUnicodeTest-577573497 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f.0f924886-cd73-490c-915a-9a4e9a7f633d is being set with open permissions: ugo+rw
Nov 06 17:23:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2569b9f4-30bd-451b-8a95-357462ab6d76 tempest-CinderUnicodeTest-577573497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f.0f924886-cd73-490c-915a-9a4e9a7f633d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:33 devstack sudo[105440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f.0f924886-cd73-490c-915a-9a4e9a7f633d
Nov 06 17:23:33 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6244e923-1210-440e-9ce9-3c65c0aa27df tempest-ProjectReaderTests-1615857228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:33 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2569b9f4-30bd-451b-8a95-357462ab6d76 tempest-CinderUnicodeTest-577573497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f.0f924886-cd73-490c-915a-9a4e9a7f633d" returned: 0 in 0.255s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2569b9f4-30bd-451b-8a95-357462ab6d76 tempest-CinderUnicodeTest-577573497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:33 devstack sudo[105443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f.info
Nov 06 17:23:33 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:34 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2569b9f4-30bd-451b-8a95-357462ab6d76 tempest-CinderUnicodeTest-577573497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f.info" returned: 0 in 0.254s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:34 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-2569b9f4-30bd-451b-8a95-357462ab6d76 tempest-CinderUnicodeTest-577573497 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f.info is being set with open permissions: ugo+rw
Nov 06 17:23:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2569b9f4-30bd-451b-8a95-357462ab6d76 tempest-CinderUnicodeTest-577573497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:34 devstack sudo[105446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f.info
Nov 06 17:23:34 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:34 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2569b9f4-30bd-451b-8a95-357462ab6d76 tempest-CinderUnicodeTest-577573497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f.info" returned: 0 in 0.244s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2569b9f4-30bd-451b-8a95-357462ab6d76 tempest-CinderUnicodeTest-577573497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.974s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2b3a33c8-601b-4cb6-8f0d-e750b06d9423 tempest-ProjectReaderTests-1259557497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.276s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-2b3a33c8-601b-4cb6-8f0d-e750b06d9423 tempest-ProjectReaderTests-1259557497 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-209598435',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9865262f-3258-438d-977b-8858365d3390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b143ddd07a13462282cdb1f6553fba15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:23:31Z,use_quota=True,user_id='d808cf170c5847029339b1a0bae5b3e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:23:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-2b3a33c8-601b-4cb6-8f0d-e750b06d9423 tempest-ProjectReaderTests-1259557497 None] Creating volume 9865262f-3258-438d-977b-8858365d3390 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:23:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2b3a33c8-601b-4cb6-8f0d-e750b06d9423 tempest-ProjectReaderTests-1259557497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2b3a33c8-601b-4cb6-8f0d-e750b06d9423 tempest-ProjectReaderTests-1259557497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-2b3a33c8-601b-4cb6-8f0d-e750b06d9423 tempest-ProjectReaderTests-1259557497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:23:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-2b3a33c8-601b-4cb6-8f0d-e750b06d9423 tempest-ProjectReaderTests-1259557497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:23:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2b3a33c8-601b-4cb6-8f0d-e750b06d9423 tempest-ProjectReaderTests-1259557497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-2b3a33c8-601b-4cb6-8f0d-e750b06d9423 tempest-ProjectReaderTests-1259557497 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:23:34 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-2b3a33c8-601b-4cb6-8f0d-e750b06d9423 tempest-ProjectReaderTests-1259557497 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:23:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2b3a33c8-601b-4cb6-8f0d-e750b06d9423 tempest-ProjectReaderTests-1259557497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9865262f-3258-438d-977b-8858365d3390 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:34 devstack sudo[105449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9865262f-3258-438d-977b-8858365d3390 1073741824
Nov 06 17:23:34 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:34 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-2569b9f4-30bd-451b-8a95-357462ab6d76 tempest-CinderUnicodeTest-577573497 None] Create snapshot completed successfully
Nov 06 17:23:34 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2b3a33c8-601b-4cb6-8f0d-e750b06d9423 tempest-ProjectReaderTests-1259557497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9865262f-3258-438d-977b-8858365d3390 1073741824" returned: 0 in 0.419s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2b3a33c8-601b-4cb6-8f0d-e750b06d9423 tempest-ProjectReaderTests-1259557497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9865262f-3258-438d-977b-8858365d3390 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:34 devstack sudo[105455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9865262f-3258-438d-977b-8858365d3390
Nov 06 17:23:34 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:34 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-32a95efd-3c4e-4236-9b7f-c3cfa337a9dd tempest-CinderUnicodeTest-577573497 None] Acquiring lock "cinder-0f924886-cd73-490c-915a-9a4e9a7f633d-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:34 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-32a95efd-3c4e-4236-9b7f-c3cfa337a9dd tempest-CinderUnicodeTest-577573497 None] Lock "cinder-0f924886-cd73-490c-915a-9a4e9a7f633d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:34 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-32a95efd-3c4e-4236-9b7f-c3cfa337a9dd tempest-CinderUnicodeTest-577573497 None] Acquiring lock "cinder-quobyte-3f6af15c-237c-4fc2-9aa8-d49d4997681f" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:34 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-32a95efd-3c4e-4236-9b7f-c3cfa337a9dd tempest-CinderUnicodeTest-577573497 None] Lock "cinder-quobyte-3f6af15c-237c-4fc2-9aa8-d49d4997681f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:34 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-32a95efd-3c4e-4236-9b7f-c3cfa337a9dd tempest-CinderUnicodeTest-577573497 None] Acquiring lock "cinder-quobyte-0f924886-cd73-490c-915a-9a4e9a7f633d" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:34 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-32a95efd-3c4e-4236-9b7f-c3cfa337a9dd tempest-CinderUnicodeTest-577573497 None] Lock "cinder-quobyte-0f924886-cd73-490c-915a-9a4e9a7f633d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:34 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-32a95efd-3c4e-4236-9b7f-c3cfa337a9dd tempest-CinderUnicodeTest-577573497 None] Deleting offline snapshot 0f924886-cd73-490c-915a-9a4e9a7f633d of volume 3f6af15c-237c-4fc2-9aa8-d49d4997681f {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-32a95efd-3c4e-4236-9b7f-c3cfa337a9dd tempest-CinderUnicodeTest-577573497 None] snapshot_file for this snap is: volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f.0f924886-cd73-490c-915a-9a4e9a7f633d {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd111bca-e4fd-46ca-bd47-d4cce7bcd56a]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-32a95efd-3c4e-4236-9b7f-c3cfa337a9dd tempest-CinderUnicodeTest-577573497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f.0f924886-cd73-490c-915a-9a4e9a7f633d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:35 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2b3a33c8-601b-4cb6-8f0d-e750b06d9423 tempest-ProjectReaderTests-1259557497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9865262f-3258-438d-977b-8858365d3390" returned: 0 in 0.252s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-2b3a33c8-601b-4cb6-8f0d-e750b06d9423 tempest-ProjectReaderTests-1259557497 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2b3a33c8-601b-4cb6-8f0d-e750b06d9423 tempest-ProjectReaderTests-1259557497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.493s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Acquiring lock "cinder-quobyte-eb7cfedf-3933-42f2-9c62-2bcf76017f0a-b28dc557-ec91-47e1-bcf6-10f802ecb21b" by "_create_volume_from_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-2b3a33c8-601b-4cb6-8f0d-e750b06d9423 tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48d4cb25-822a-421c-a752-866a8f3807d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9865262f-3258-438d-977b-8858365d3390', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-2b3a33c8-601b-4cb6-8f0d-e750b06d9423 tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8339b79d-384e-40e3-a444-0137041f69a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Lock "cinder-quobyte-eb7cfedf-3933-42f2-9c62-2bcf76017f0a-b28dc557-ec91-47e1-bcf6-10f802ecb21b" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Creating volume b28dc557-ec91-47e1-bcf6-10f802ecb21b from snapshot eb7cfedf-3933-42f2-9c62-2bcf76017f0a {{(pid=86856) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Acquiring lock "cinder-quobyte-b28dc557-ec91-47e1-bcf6-10f802ecb21b" by "_copy_volume_from_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:35 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-2b3a33c8-601b-4cb6-8f0d-e750b06d9423 tempest-ProjectReaderTests-1259557497 None] Volume volume-9865262f-3258-438d-977b-8858365d3390 (9865262f-3258-438d-977b-8858365d3390): created successfully
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-2b3a33c8-601b-4cb6-8f0d-e750b06d9423 tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8339b79d-384e-40e3-a444-0137041f69a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-2b3a33c8-601b-4cb6-8f0d-e750b06d9423 tempest-ProjectReaderTests-1259557497 None] Flow 'volume_create_manager' (fe077ea6-0813-4559-9c44-ff38fc359f92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Lock "cinder-quobyte-b28dc557-ec91-47e1-bcf6-10f802ecb21b" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] snapshot: eb7cfedf-3933-42f2-9c62-2bcf76017f0a, volume: b28dc557-ec91-47e1-bcf6-10f802ecb21b,  {{(pid=86856) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 06 17:23:35 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-2b3a33c8-601b-4cb6-8f0d-e750b06d9423 tempest-ProjectReaderTests-1259557497 None] Created volume successfully.
Nov 06 17:23:35 devstack sudo[105458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f.0f924886-cd73-490c-915a-9a4e9a7f633d
Nov 06 17:23:35 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc21a114-056d-4b46-b93c-daccfed80f6c]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a.eb7cfedf-3933-42f2-9c62-2bcf76017f0a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:35 devstack sudo[105460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a.eb7cfedf-3933-42f2-9c62-2bcf76017f0a
Nov 06 17:23:35 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:35 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-32a95efd-3c4e-4236-9b7f-c3cfa337a9dd tempest-CinderUnicodeTest-577573497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f.0f924886-cd73-490c-915a-9a4e9a7f633d" returned: 0 in 0.365s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-32a95efd-3c4e-4236-9b7f-c3cfa337a9dd tempest-CinderUnicodeTest-577573497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e049929-064f-4e61-a028-9a9907c86b0a]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-32a95efd-3c4e-4236-9b7f-c3cfa337a9dd tempest-CinderUnicodeTest-577573497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:35 devstack sudo[105465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f
Nov 06 17:23:35 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:35 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a.eb7cfedf-3933-42f2-9c62-2bcf76017f0a" returned: 0 in 0.368s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[befd9a25-e7f7-4938-9961-f4434d50f701]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:35 devstack sudo[105470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a
Nov 06 17:23:35 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:35 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-32a95efd-3c4e-4236-9b7f-c3cfa337a9dd tempest-CinderUnicodeTest-577573497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f" returned: 0 in 0.371s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-32a95efd-3c4e-4236-9b7f-c3cfa337a9dd tempest-CinderUnicodeTest-577573497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f.0f924886-cd73-490c-915a-9a4e9a7f633d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:35 devstack sudo[105475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f.0f924886-cd73-490c-915a-9a4e9a7f633d
Nov 06 17:23:35 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:35 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a" returned: 0 in 0.380s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a {{(pid=86856) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Creating direct copy from snapshot {{(pid=86856) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG cinder.utils [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Path /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b28dc557-ec91-47e1-bcf6-10f802ecb21b not found in is_blk_device check {{(pid=86856) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 06 17:23:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b28dc557-ec91-47e1-bcf6-10f802ecb21b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:36 devstack sudo[105480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b28dc557-ec91-47e1-bcf6-10f802ecb21b
Nov 06 17:23:36 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:36 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-32a95efd-3c4e-4236-9b7f-c3cfa337a9dd tempest-CinderUnicodeTest-577573497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f.0f924886-cd73-490c-915a-9a4e9a7f633d" returned: 0 in 0.347s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-32a95efd-3c4e-4236-9b7f-c3cfa337a9dd tempest-CinderUnicodeTest-577573497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f.0f924886-cd73-490c-915a-9a4e9a7f633d {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:36 devstack sudo[105486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f.0f924886-cd73-490c-915a-9a4e9a7f633d
Nov 06 17:23:36 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:36 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bab0788f-345c-48fa-ba39-2f9be9b954b4 tempest-ProjectReaderTests-1259557497 None] Acquiring lock "cinder-9865262f-3258-438d-977b-8858365d3390-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:36 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bab0788f-345c-48fa-ba39-2f9be9b954b4 tempest-ProjectReaderTests-1259557497 None] Lock "cinder-9865262f-3258-438d-977b-8858365d3390-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:36 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bab0788f-345c-48fa-ba39-2f9be9b954b4 tempest-ProjectReaderTests-1259557497 None] Acquiring lock "cinder-quobyte-9865262f-3258-438d-977b-8858365d3390" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:36 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bab0788f-345c-48fa-ba39-2f9be9b954b4 tempest-ProjectReaderTests-1259557497 None] Lock "cinder-quobyte-9865262f-3258-438d-977b-8858365d3390" acquired by "delete_volume" :: waited 0.018s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:36 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcacf816-5010-409f-b5cd-b9387ee80b6f]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:23:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bab0788f-345c-48fa-ba39-2f9be9b954b4 tempest-ProjectReaderTests-1259557497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9865262f-3258-438d-977b-8858365d3390 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:36 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-32a95efd-3c4e-4236-9b7f-c3cfa337a9dd tempest-CinderUnicodeTest-577573497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f.0f924886-cd73-490c-915a-9a4e9a7f633d" returned: 0 in 0.301s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:36 devstack sudo[105491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9865262f-3258-438d-977b-8858365d3390
Nov 06 17:23:36 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:36 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-32a95efd-3c4e-4236-9b7f-c3cfa337a9dd tempest-CinderUnicodeTest-577573497 None] Lock "cinder-quobyte-0f924886-cd73-490c-915a-9a4e9a7f633d" released by "_delete_snapshot" :: held 1.532s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:36 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-32a95efd-3c4e-4236-9b7f-c3cfa337a9dd tempest-CinderUnicodeTest-577573497 None] Lock "cinder-quobyte-3f6af15c-237c-4fc2-9aa8-d49d4997681f" released by "delete_snapshot" :: held 1.568s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:36 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-32a95efd-3c4e-4236-9b7f-c3cfa337a9dd tempest-CinderUnicodeTest-577573497 None] Created reservations ['3a0428fc-4a23-496c-aa33-92fcb4ba8da3', 'd38b8c70-d95e-409b-979b-0490cad69baa', 'ce913d2b-d502-49b0-b25c-70b39e5bf0ae', 'c0cf6c80-0bd2-42bb-b155-50ef33b2bb8d'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:23:36 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-32a95efd-3c4e-4236-9b7f-c3cfa337a9dd tempest-CinderUnicodeTest-577573497 None] Delete snapshot completed successfully.
Nov 06 17:23:36 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-32a95efd-3c4e-4236-9b7f-c3cfa337a9dd tempest-CinderUnicodeTest-577573497 None] Lock "cinder-0f924886-cd73-490c-915a-9a4e9a7f633d-delete_snapshot" released by "delete_snapshot" :: held 1.887s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:36 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bab0788f-345c-48fa-ba39-2f9be9b954b4 tempest-ProjectReaderTests-1259557497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9865262f-3258-438d-977b-8858365d3390" returned: 0 in 0.665s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bab0788f-345c-48fa-ba39-2f9be9b954b4 tempest-ProjectReaderTests-1259557497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9865262f-3258-438d-977b-8858365d3390 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:37 devstack sudo[105505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9865262f-3258-438d-977b-8858365d3390
Nov 06 17:23:37 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c8e8e660-dc13-4719-908c-b02cd1ee6777 tempest-CinderUnicodeTest-577573497 None] Acquiring lock "cinder-3f6af15c-237c-4fc2-9aa8-d49d4997681f-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c8e8e660-dc13-4719-908c-b02cd1ee6777 tempest-CinderUnicodeTest-577573497 None] Lock "cinder-3f6af15c-237c-4fc2-9aa8-d49d4997681f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c8e8e660-dc13-4719-908c-b02cd1ee6777 tempest-CinderUnicodeTest-577573497 None] Acquiring lock "cinder-quobyte-3f6af15c-237c-4fc2-9aa8-d49d4997681f" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c8e8e660-dc13-4719-908c-b02cd1ee6777 tempest-CinderUnicodeTest-577573497 None] Lock "cinder-quobyte-3f6af15c-237c-4fc2-9aa8-d49d4997681f" acquired by "delete_volume" :: waited 0.032s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:37 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bab0788f-345c-48fa-ba39-2f9be9b954b4 tempest-ProjectReaderTests-1259557497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-9865262f-3258-438d-977b-8858365d3390" returned: 0 in 0.452s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:37 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bab0788f-345c-48fa-ba39-2f9be9b954b4 tempest-ProjectReaderTests-1259557497 None] Lock "cinder-quobyte-9865262f-3258-438d-977b-8858365d3390" released by "delete_volume" :: held 1.168s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:37 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6960ac-c894-4f37-a3f8-c3b786c4a9f1]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:23:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c8e8e660-dc13-4719-908c-b02cd1ee6777 tempest-CinderUnicodeTest-577573497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:37 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-bab0788f-345c-48fa-ba39-2f9be9b954b4 tempest-ProjectReaderTests-1259557497 None] Created reservations ['5df946a8-fe1f-4c3e-adfc-deffaa86aafe', '8db5889e-ca74-419f-b435-d674d5ec3acb', 'a94faeab-28b4-4c9c-a952-cfe2bc25d457', 'a35c8604-850d-4723-a7e2-d8a35ab23174'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:23:37 devstack sudo[105508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f
Nov 06 17:23:37 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bab0788f-345c-48fa-ba39-2f9be9b954b4 tempest-ProjectReaderTests-1259557497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bab0788f-345c-48fa-ba39-2f9be9b954b4 tempest-ProjectReaderTests-1259557497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:37 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bab0788f-345c-48fa-ba39-2f9be9b954b4 tempest-ProjectReaderTests-1259557497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:23:37 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-bab0788f-345c-48fa-ba39-2f9be9b954b4 tempest-ProjectReaderTests-1259557497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:23:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-bab0788f-345c-48fa-ba39-2f9be9b954b4 tempest-ProjectReaderTests-1259557497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bab0788f-345c-48fa-ba39-2f9be9b954b4 tempest-ProjectReaderTests-1259557497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:37 devstack sudo[105510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:23:37 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:38 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-bab0788f-345c-48fa-ba39-2f9be9b954b4 tempest-ProjectReaderTests-1259557497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.447s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:38 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-bab0788f-345c-48fa-ba39-2f9be9b954b4 tempest-ProjectReaderTests-1259557497 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:23:38 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-bab0788f-345c-48fa-ba39-2f9be9b954b4 tempest-ProjectReaderTests-1259557497 None] Deleted volume successfully.
Nov 06 17:23:38 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-bab0788f-345c-48fa-ba39-2f9be9b954b4 tempest-ProjectReaderTests-1259557497 None] Lock "cinder-9865262f-3258-438d-977b-8858365d3390-delete_volume" released by "delete_volume" :: held 2.081s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:38 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c8e8e660-dc13-4719-908c-b02cd1ee6777 tempest-CinderUnicodeTest-577573497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f" returned: 0 in 0.905s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c8e8e660-dc13-4719-908c-b02cd1ee6777 tempest-CinderUnicodeTest-577573497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:38 devstack sudo[105516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f
Nov 06 17:23:38 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:39 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c8e8e660-dc13-4719-908c-b02cd1ee6777 tempest-CinderUnicodeTest-577573497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-3f6af15c-237c-4fc2-9aa8-d49d4997681f" returned: 0 in 0.638s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c8e8e660-dc13-4719-908c-b02cd1ee6777 tempest-CinderUnicodeTest-577573497 None] Lock "cinder-quobyte-3f6af15c-237c-4fc2-9aa8-d49d4997681f" released by "delete_volume" :: held 1.709s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:39 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-c8e8e660-dc13-4719-908c-b02cd1ee6777 tempest-CinderUnicodeTest-577573497 None] Created reservations ['8277f9d6-9f74-41cd-a7a5-49cb6d5350d0', 'cb398e96-9a99-49d4-b71d-04f8d954a85f', '8eeefcb3-d909-4bd9-a311-85590ca1b870', '4171219e-830e-4a7c-ab96-4a22ab8af8c4'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:23:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c8e8e660-dc13-4719-908c-b02cd1ee6777 tempest-CinderUnicodeTest-577573497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c8e8e660-dc13-4719-908c-b02cd1ee6777 tempest-CinderUnicodeTest-577573497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:39 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c8e8e660-dc13-4719-908c-b02cd1ee6777 tempest-CinderUnicodeTest-577573497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:23:39 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c8e8e660-dc13-4719-908c-b02cd1ee6777 tempest-CinderUnicodeTest-577573497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:23:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c8e8e660-dc13-4719-908c-b02cd1ee6777 tempest-CinderUnicodeTest-577573497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c8e8e660-dc13-4719-908c-b02cd1ee6777 tempest-CinderUnicodeTest-577573497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:39 devstack sudo[105519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:23:39 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:39 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-5da602b6-f380-4c8d-b6db-5af9e83494bc tempest-ProjectReaderTests-1259557497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:23:39 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5da602b6-f380-4c8d-b6db-5af9e83494bc tempest-ProjectReaderTests-1259557497 None] Flow 'volume_create_manager' (fae0efe4-ab8f-43f8-8ebe-8c621a26c57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:23:39 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5da602b6-f380-4c8d-b6db-5af9e83494bc tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b5d0cc4-5dd6-4518-9110-2109431aacec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:39 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5da602b6-f380-4c8d-b6db-5af9e83494bc tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b5d0cc4-5dd6-4518-9110-2109431aacec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1691093669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ac0062-e40a-499f-9572-1dbfaff75044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b143ddd07a13462282cdb1f6553fba15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:23:39Z,use_quota=True,user_id='d808cf170c5847029339b1a0bae5b3e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:39 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5da602b6-f380-4c8d-b6db-5af9e83494bc tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98f8f8ac-a8a9-4eff-8f79-3fbbe3ae3a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:39 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5da602b6-f380-4c8d-b6db-5af9e83494bc tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98f8f8ac-a8a9-4eff-8f79-3fbbe3ae3a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:39 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5da602b6-f380-4c8d-b6db-5af9e83494bc tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1afadf62-57b8-4f5b-8542-d95f39e950ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:39 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5da602b6-f380-4c8d-b6db-5af9e83494bc tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1afadf62-57b8-4f5b-8542-d95f39e950ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97ac0062-e40a-499f-9572-1dbfaff75044', 'volume_name': 'volume-97ac0062-e40a-499f-9572-1dbfaff75044', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:39 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5da602b6-f380-4c8d-b6db-5af9e83494bc tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1687c0e4-8330-4f1f-9f67-c8a4c9b79a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:39 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5da602b6-f380-4c8d-b6db-5af9e83494bc tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1687c0e4-8330-4f1f-9f67-c8a4c9b79a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:39 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5da602b6-f380-4c8d-b6db-5af9e83494bc tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83334778-18d7-426b-9122-84ac28c8a4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:39 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-5da602b6-f380-4c8d-b6db-5af9e83494bc tempest-ProjectReaderTests-1259557497 None] Volume 97ac0062-e40a-499f-9572-1dbfaff75044: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97ac0062-e40a-499f-9572-1dbfaff75044', 'volume_size': 1}
Nov 06 17:23:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5da602b6-f380-4c8d-b6db-5af9e83494bc tempest-ProjectReaderTests-1259557497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1550f7d6-95d1-4cd9-9617-bff7463a32ea tempest-CinderUnicodeTest-577573497 None] Acquiring lock "cinder-138a613f-02b1-4f9a-a4df-39a6f219a967-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1550f7d6-95d1-4cd9-9617-bff7463a32ea tempest-CinderUnicodeTest-577573497 None] Lock "cinder-138a613f-02b1-4f9a-a4df-39a6f219a967-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:39 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c8e8e660-dc13-4719-908c-b02cd1ee6777 tempest-CinderUnicodeTest-577573497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.456s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:39 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-c8e8e660-dc13-4719-908c-b02cd1ee6777 tempest-CinderUnicodeTest-577573497 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:23:39 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-c8e8e660-dc13-4719-908c-b02cd1ee6777 tempest-CinderUnicodeTest-577573497 None] Deleted volume successfully.
Nov 06 17:23:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1550f7d6-95d1-4cd9-9617-bff7463a32ea tempest-CinderUnicodeTest-577573497 None] Acquiring lock "cinder-quobyte-138a613f-02b1-4f9a-a4df-39a6f219a967" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c8e8e660-dc13-4719-908c-b02cd1ee6777 tempest-CinderUnicodeTest-577573497 None] Lock "cinder-3f6af15c-237c-4fc2-9aa8-d49d4997681f-delete_volume" released by "delete_volume" :: held 2.645s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1550f7d6-95d1-4cd9-9617-bff7463a32ea tempest-CinderUnicodeTest-577573497 None] Lock "cinder-quobyte-138a613f-02b1-4f9a-a4df-39a6f219a967" acquired by "delete_volume" :: waited 0.023s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:39 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[950cddea-ce04-405d-9966-8cc349f9ba9b]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:23:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1550f7d6-95d1-4cd9-9617-bff7463a32ea tempest-CinderUnicodeTest-577573497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-138a613f-02b1-4f9a-a4df-39a6f219a967 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:40 devstack sudo[105523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-138a613f-02b1-4f9a-a4df-39a6f219a967
Nov 06 17:23:40 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:40 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1550f7d6-95d1-4cd9-9617-bff7463a32ea tempest-CinderUnicodeTest-577573497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-138a613f-02b1-4f9a-a4df-39a6f219a967" returned: 0 in 0.718s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1550f7d6-95d1-4cd9-9617-bff7463a32ea tempest-CinderUnicodeTest-577573497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-138a613f-02b1-4f9a-a4df-39a6f219a967 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:40 devstack sudo[105528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-138a613f-02b1-4f9a-a4df-39a6f219a967
Nov 06 17:23:40 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:41 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1550f7d6-95d1-4cd9-9617-bff7463a32ea tempest-CinderUnicodeTest-577573497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-138a613f-02b1-4f9a-a4df-39a6f219a967" returned: 0 in 0.487s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:41 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1550f7d6-95d1-4cd9-9617-bff7463a32ea tempest-CinderUnicodeTest-577573497 None] Lock "cinder-quobyte-138a613f-02b1-4f9a-a4df-39a6f219a967" released by "delete_volume" :: held 1.308s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:41 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-1550f7d6-95d1-4cd9-9617-bff7463a32ea tempest-CinderUnicodeTest-577573497 None] Created reservations ['4916c751-fcd4-44a8-8b2b-bd8998afd416', '22a9b43c-fe06-4a4b-8c26-1826e0c35863', 'b623bdfc-7b80-4d9e-b13a-4b883ccdfdd2', '3c4c9e25-d110-4bc1-88a9-ed62e656dcd5'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:23:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1550f7d6-95d1-4cd9-9617-bff7463a32ea tempest-CinderUnicodeTest-577573497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1550f7d6-95d1-4cd9-9617-bff7463a32ea tempest-CinderUnicodeTest-577573497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:41 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1550f7d6-95d1-4cd9-9617-bff7463a32ea tempest-CinderUnicodeTest-577573497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:23:41 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1550f7d6-95d1-4cd9-9617-bff7463a32ea tempest-CinderUnicodeTest-577573497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:23:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1550f7d6-95d1-4cd9-9617-bff7463a32ea tempest-CinderUnicodeTest-577573497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1550f7d6-95d1-4cd9-9617-bff7463a32ea tempest-CinderUnicodeTest-577573497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:41 devstack sudo[105531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:23:41 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:41 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1550f7d6-95d1-4cd9-9617-bff7463a32ea tempest-CinderUnicodeTest-577573497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.497s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:41 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-1550f7d6-95d1-4cd9-9617-bff7463a32ea tempest-CinderUnicodeTest-577573497 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:23:41 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-1550f7d6-95d1-4cd9-9617-bff7463a32ea tempest-CinderUnicodeTest-577573497 None] Deleted volume successfully.
Nov 06 17:23:42 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1550f7d6-95d1-4cd9-9617-bff7463a32ea tempest-CinderUnicodeTest-577573497 None] Lock "cinder-138a613f-02b1-4f9a-a4df-39a6f219a967-delete_volume" released by "delete_volume" :: held 2.205s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:42 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:23:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:23:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:23:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:42 devstack sudo[105535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:23:42 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:43 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.595s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:43 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:23:43 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager._thread_info {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:23:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread count: 28 {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 17:23:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread info: [<_MainThread(MainThread, started 125183137599616)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125183027608256)>, <Thread(Thread-3 (stat_writer), started daemon 125183025243776)>, <Thread(Rabbit-heartbeat, started daemon 125183023512896)>, <Thread(Thread-5 (_runner), started daemon 125183023357120)>, <Thread(Thread-7 (_runner), started daemon 125183021306496)>, <Thread(fd_logger, started daemon 125183018711616)>, <Thread(privsep_reader, started daemon 125183017484224)>, <Thread(tpool_thread_0, started daemon 125183013742272)>, <Thread(tpool_thread_1, started daemon 125183005349568)>, <Thread(tpool_thread_2, started daemon 125182996956864)>, <Thread(tpool_thread_3, started daemon 125182988564160)>, <Thread(tpool_thread_4, started daemon 125182980171456)>, <Thread(tpool_thread_5, started daemon 125182971778752)>, <Thread(tpool_thread_6, started daemon 125182963386048)>, <Thread(tpool_thread_7, started daemon 125182954993344)>, <Thread(tpool_thread_8, started daemon 125182946600640)>, <Thread(tpool_thread_9, started daemon 125182938207936)>, <Thread(tpool_thread_10, started daemon 125182929815232)>, <Thread(tpool_thread_11, started daemon 125182921422528)>, <Thread(tpool_thread_12, started daemon 125182913013440)>, <Thread(tpool_thread_13, started daemon 125182904604352)>, <Thread(tpool_thread_14, started daemon 125182896195264)>, <Thread(tpool_thread_15, started daemon 125182887786176)>, <Thread(tpool_thread_16, started daemon 125182879377088)>, <Thread(tpool_thread_17, started daemon 125182870968000)>, <Thread(tpool_thread_18, started daemon 125182862558912)>, <Thread(tpool_thread_19, started daemon 125182854149824)>] {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 17:23:43 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b28dc557-ec91-47e1-bcf6-10f802ecb21b" returned: 0 in 7.550s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:43 devstack cinder-volume[86856]: DEBUG cinder.image.image_utils [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Image conversion details: src /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a, size 1024.00 MB, duration 7.55 sec, destination /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b28dc557-ec91-47e1-bcf6-10f802ecb21b {{(pid=86856) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 17:23:43 devstack cinder-volume[86856]: INFO cinder.image.image_utils [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Converted 1024.00 MB image at 135.61 MB/s
Nov 06 17:23:43 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b28dc557-ec91-47e1-bcf6-10f802ecb21b is being set with open permissions: ugo+rw
Nov 06 17:23:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b28dc557-ec91-47e1-bcf6-10f802ecb21b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:43 devstack sudo[105538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b28dc557-ec91-47e1-bcf6-10f802ecb21b
Nov 06 17:23:43 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:43 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b28dc557-ec91-47e1-bcf6-10f802ecb21b" returned: 0 in 0.260s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Lock "cinder-quobyte-b28dc557-ec91-47e1-bcf6-10f802ecb21b" released by "_copy_volume_from_snapshot" :: held 8.664s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Lock "cinder-quobyte-eb7cfedf-3933-42f2-9c62-2bcf76017f0a-b28dc557-ec91-47e1-bcf6-10f802ecb21b" released by "_create_volume_from_snapshot" :: held 8.748s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.783s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6244e923-1210-440e-9ce9-3c65c0aa27df tempest-ProjectReaderTests-1615857228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.253s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:43 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-6244e923-1210-440e-9ce9-3c65c0aa27df tempest-ProjectReaderTests-1615857228 None] Creating offline snapshot b75e0d70-044e-4647-8c4a-e260edfafb69 of volume ae7f8e6d-3c53-4636-9c79-5359f12e099a {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:23:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d948f47a-fbab-4ba3-abee-b807f74cd1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b28dc557-ec91-47e1-bcf6-10f802ecb21b', 'volume_size': 1, 'snapshot_id': 'eb7cfedf-3933-42f2-9c62-2bcf76017f0a'}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1709d234-2d6c-4b04-b102-ac6dc9dd689c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:43 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9b3f2b-651c-45ed-8d3b-262c6ca144fb]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:23:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6244e923-1210-440e-9ce9-3c65c0aa27df tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:43 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Volume volume-b28dc557-ec91-47e1-bcf6-10f802ecb21b (b28dc557-ec91-47e1-bcf6-10f802ecb21b): created successfully
Nov 06 17:23:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1709d234-2d6c-4b04-b102-ac6dc9dd689c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Flow 'volume_create_manager' (9e9abb08-b2fd-447f-b83a-63bdd00400fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:23:43 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-3cae98d2-bd7f-4eaa-86f3-755ecc2952e2 tempest-SnapshotDependencyTests-346299755 None] Created volume successfully.
Nov 06 17:23:44 devstack sudo[105542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a
Nov 06 17:23:44 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:44 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6244e923-1210-440e-9ce9-3c65c0aa27df tempest-ProjectReaderTests-1615857228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a" returned: 0 in 0.405s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6244e923-1210-440e-9ce9-3c65c0aa27df tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a.b75e0d70-044e-4647-8c4a-e260edfafb69 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:44 devstack sudo[105547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a.b75e0d70-044e-4647-8c4a-e260edfafb69 1G
Nov 06 17:23:44 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:44 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-45670a7f-08a4-44dd-af9a-3aad7da690e7 tempest-SnapshotDependencyTests-346299755 None] Acquiring lock "cinder-eb7cfedf-3933-42f2-9c62-2bcf76017f0a-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:44 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-45670a7f-08a4-44dd-af9a-3aad7da690e7 tempest-SnapshotDependencyTests-346299755 None] Lock "cinder-eb7cfedf-3933-42f2-9c62-2bcf76017f0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:44 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-45670a7f-08a4-44dd-af9a-3aad7da690e7 tempest-SnapshotDependencyTests-346299755 None] Acquiring lock "cinder-quobyte-0776511e-bbf8-45c2-b57c-d4ff2b62307a" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:44 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-45670a7f-08a4-44dd-af9a-3aad7da690e7 tempest-SnapshotDependencyTests-346299755 None] Lock "cinder-quobyte-0776511e-bbf8-45c2-b57c-d4ff2b62307a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:44 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-45670a7f-08a4-44dd-af9a-3aad7da690e7 tempest-SnapshotDependencyTests-346299755 None] Acquiring lock "cinder-quobyte-eb7cfedf-3933-42f2-9c62-2bcf76017f0a" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:44 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-45670a7f-08a4-44dd-af9a-3aad7da690e7 tempest-SnapshotDependencyTests-346299755 None] Lock "cinder-quobyte-eb7cfedf-3933-42f2-9c62-2bcf76017f0a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:44 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-45670a7f-08a4-44dd-af9a-3aad7da690e7 tempest-SnapshotDependencyTests-346299755 None] Deleting offline snapshot eb7cfedf-3933-42f2-9c62-2bcf76017f0a of volume 0776511e-bbf8-45c2-b57c-d4ff2b62307a {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:23:44 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-45670a7f-08a4-44dd-af9a-3aad7da690e7 tempest-SnapshotDependencyTests-346299755 None] snapshot_file for this snap is: volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a.eb7cfedf-3933-42f2-9c62-2bcf76017f0a {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:23:44 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[db188fa9-0bd9-428f-85b4-ad6d2ab70bcb]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:23:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-45670a7f-08a4-44dd-af9a-3aad7da690e7 tempest-SnapshotDependencyTests-346299755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a.eb7cfedf-3933-42f2-9c62-2bcf76017f0a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:44 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6244e923-1210-440e-9ce9-3c65c0aa27df tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a.b75e0d70-044e-4647-8c4a-e260edfafb69 1G" returned: 0 in 0.471s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6244e923-1210-440e-9ce9-3c65c0aa27df tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a.b75e0d70-044e-4647-8c4a-e260edfafb69 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:44 devstack sudo[105552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a.eb7cfedf-3933-42f2-9c62-2bcf76017f0a
Nov 06 17:23:44 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:44 devstack sudo[105553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a.b75e0d70-044e-4647-8c4a-e260edfafb69
Nov 06 17:23:44 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:45 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-45670a7f-08a4-44dd-af9a-3aad7da690e7 tempest-SnapshotDependencyTests-346299755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a.eb7cfedf-3933-42f2-9c62-2bcf76017f0a" returned: 0 in 0.399s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:45 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-45670a7f-08a4-44dd-af9a-3aad7da690e7 tempest-SnapshotDependencyTests-346299755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:23:45 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6244e923-1210-440e-9ce9-3c65c0aa27df tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a.b75e0d70-044e-4647-8c4a-e260edfafb69" returned: 0 in 0.315s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:45 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-6244e923-1210-440e-9ce9-3c65c0aa27df tempest-ProjectReaderTests-1615857228 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a.b75e0d70-044e-4647-8c4a-e260edfafb69 is being set with open permissions: ugo+rw
Nov 06 17:23:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6244e923-1210-440e-9ce9-3c65c0aa27df tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a.b75e0d70-044e-4647-8c4a-e260edfafb69 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:45 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[962345f3-2cb6-42ec-b578-438a9566d0ec]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:23:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-45670a7f-08a4-44dd-af9a-3aad7da690e7 tempest-SnapshotDependencyTests-346299755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:45 devstack sudo[105562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a.b75e0d70-044e-4647-8c4a-e260edfafb69
Nov 06 17:23:45 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:45 devstack sudo[105563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a
Nov 06 17:23:45 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:45 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6244e923-1210-440e-9ce9-3c65c0aa27df tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a.b75e0d70-044e-4647-8c4a-e260edfafb69" returned: 0 in 0.258s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6244e923-1210-440e-9ce9-3c65c0aa27df tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:45 devstack sudo[105567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a.info
Nov 06 17:23:45 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:45 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6244e923-1210-440e-9ce9-3c65c0aa27df tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a.info" returned: 0 in 0.278s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:45 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-6244e923-1210-440e-9ce9-3c65c0aa27df tempest-ProjectReaderTests-1615857228 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a.info is being set with open permissions: ugo+rw
Nov 06 17:23:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6244e923-1210-440e-9ce9-3c65c0aa27df tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:45 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-45670a7f-08a4-44dd-af9a-3aad7da690e7 tempest-SnapshotDependencyTests-346299755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a" returned: 0 in 0.576s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-45670a7f-08a4-44dd-af9a-3aad7da690e7 tempest-SnapshotDependencyTests-346299755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a.eb7cfedf-3933-42f2-9c62-2bcf76017f0a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:45 devstack sudo[105573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a.info
Nov 06 17:23:45 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:45 devstack sudo[105574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a.eb7cfedf-3933-42f2-9c62-2bcf76017f0a
Nov 06 17:23:45 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:45 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-75aa14c4-2c80-4b45-b463-43bed2ce4722 tempest-ProjectAdminTests-623419123 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7657089233398, 'free_capacity_gb': 1773.7657089233398, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86856) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 06 17:23:45 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-6244e923-1210-440e-9ce9-3c65c0aa27df tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a.info" returned: 0 in 0.264s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-6244e923-1210-440e-9ce9-3c65c0aa27df tempest-ProjectReaderTests-1615857228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.110s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5da602b6-f380-4c8d-b6db-5af9e83494bc tempest-ProjectReaderTests-1259557497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.188s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:45 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5da602b6-f380-4c8d-b6db-5af9e83494bc tempest-ProjectReaderTests-1259557497 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1691093669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ac0062-e40a-499f-9572-1dbfaff75044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b143ddd07a13462282cdb1f6553fba15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:23:39Z,use_quota=True,user_id='d808cf170c5847029339b1a0bae5b3e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:23:45 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-5da602b6-f380-4c8d-b6db-5af9e83494bc tempest-ProjectReaderTests-1259557497 None] Creating volume 97ac0062-e40a-499f-9572-1dbfaff75044 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:23:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5da602b6-f380-4c8d-b6db-5af9e83494bc tempest-ProjectReaderTests-1259557497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5da602b6-f380-4c8d-b6db-5af9e83494bc tempest-ProjectReaderTests-1259557497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:45 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5da602b6-f380-4c8d-b6db-5af9e83494bc tempest-ProjectReaderTests-1259557497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:23:45 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5da602b6-f380-4c8d-b6db-5af9e83494bc tempest-ProjectReaderTests-1259557497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:23:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5da602b6-f380-4c8d-b6db-5af9e83494bc tempest-ProjectReaderTests-1259557497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:45 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5da602b6-f380-4c8d-b6db-5af9e83494bc tempest-ProjectReaderTests-1259557497 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:23:45 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-5da602b6-f380-4c8d-b6db-5af9e83494bc tempest-ProjectReaderTests-1259557497 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:23:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5da602b6-f380-4c8d-b6db-5af9e83494bc tempest-ProjectReaderTests-1259557497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-97ac0062-e40a-499f-9572-1dbfaff75044 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:45 devstack sudo[105587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-97ac0062-e40a-499f-9572-1dbfaff75044 1073741824
Nov 06 17:23:45 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:46 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-6244e923-1210-440e-9ce9-3c65c0aa27df tempest-ProjectReaderTests-1615857228 None] Create snapshot completed successfully
Nov 06 17:23:46 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-45670a7f-08a4-44dd-af9a-3aad7da690e7 tempest-SnapshotDependencyTests-346299755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a.eb7cfedf-3933-42f2-9c62-2bcf76017f0a" returned: 0 in 0.405s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-45670a7f-08a4-44dd-af9a-3aad7da690e7 tempest-SnapshotDependencyTests-346299755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a.eb7cfedf-3933-42f2-9c62-2bcf76017f0a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:46 devstack sudo[105589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a.eb7cfedf-3933-42f2-9c62-2bcf76017f0a
Nov 06 17:23:46 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:46 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-45670a7f-08a4-44dd-af9a-3aad7da690e7 tempest-SnapshotDependencyTests-346299755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a.eb7cfedf-3933-42f2-9c62-2bcf76017f0a" returned: 0 in 0.288s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:46 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-45670a7f-08a4-44dd-af9a-3aad7da690e7 tempest-SnapshotDependencyTests-346299755 None] Lock "cinder-quobyte-eb7cfedf-3933-42f2-9c62-2bcf76017f0a" released by "_delete_snapshot" :: held 1.821s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:46 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-15178f26-45f1-40ad-a07a-8d92c930f216 tempest-ProjectReaderTests-1615857228 None] Acquiring lock "cinder-b75e0d70-044e-4647-8c4a-e260edfafb69-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:46 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-45670a7f-08a4-44dd-af9a-3aad7da690e7 tempest-SnapshotDependencyTests-346299755 None] Lock "cinder-quobyte-0776511e-bbf8-45c2-b57c-d4ff2b62307a" released by "delete_snapshot" :: held 1.863s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:46 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-15178f26-45f1-40ad-a07a-8d92c930f216 tempest-ProjectReaderTests-1615857228 None] Lock "cinder-b75e0d70-044e-4647-8c4a-e260edfafb69-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:46 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-15178f26-45f1-40ad-a07a-8d92c930f216 tempest-ProjectReaderTests-1615857228 None] Acquiring lock "cinder-quobyte-ae7f8e6d-3c53-4636-9c79-5359f12e099a" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:46 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-15178f26-45f1-40ad-a07a-8d92c930f216 tempest-ProjectReaderTests-1615857228 None] Lock "cinder-quobyte-ae7f8e6d-3c53-4636-9c79-5359f12e099a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:46 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-15178f26-45f1-40ad-a07a-8d92c930f216 tempest-ProjectReaderTests-1615857228 None] Acquiring lock "cinder-quobyte-b75e0d70-044e-4647-8c4a-e260edfafb69" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:46 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5da602b6-f380-4c8d-b6db-5af9e83494bc tempest-ProjectReaderTests-1259557497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-97ac0062-e40a-499f-9572-1dbfaff75044 1073741824" returned: 0 in 0.558s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:46 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-15178f26-45f1-40ad-a07a-8d92c930f216 tempest-ProjectReaderTests-1615857228 None] Lock "cinder-quobyte-b75e0d70-044e-4647-8c4a-e260edfafb69" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:46 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-15178f26-45f1-40ad-a07a-8d92c930f216 tempest-ProjectReaderTests-1615857228 None] Deleting offline snapshot b75e0d70-044e-4647-8c4a-e260edfafb69 of volume ae7f8e6d-3c53-4636-9c79-5359f12e099a {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:23:46 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-15178f26-45f1-40ad-a07a-8d92c930f216 tempest-ProjectReaderTests-1615857228 None] snapshot_file for this snap is: volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a.b75e0d70-044e-4647-8c4a-e260edfafb69 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:23:46 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[735028ae-ae1e-473d-8924-9f50a80b34d5]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:23:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-15178f26-45f1-40ad-a07a-8d92c930f216 tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a.b75e0d70-044e-4647-8c4a-e260edfafb69 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:46 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-45670a7f-08a4-44dd-af9a-3aad7da690e7 tempest-SnapshotDependencyTests-346299755 None] Created reservations ['5b808a45-c523-49ee-b833-cfd8bd04c285', 'efdc9d81-6cde-49ab-96f7-684b0756765d', '68426b09-5e0f-476e-b73d-796132ee4444', '827e1801-514b-4d52-a40a-9b27eaaa79ed'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:23:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5da602b6-f380-4c8d-b6db-5af9e83494bc tempest-ProjectReaderTests-1259557497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-97ac0062-e40a-499f-9572-1dbfaff75044 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:46 devstack sudo[105597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-97ac0062-e40a-499f-9572-1dbfaff75044
Nov 06 17:23:46 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:46 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-45670a7f-08a4-44dd-af9a-3aad7da690e7 tempest-SnapshotDependencyTests-346299755 None] Delete snapshot completed successfully.
Nov 06 17:23:46 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-45670a7f-08a4-44dd-af9a-3aad7da690e7 tempest-SnapshotDependencyTests-346299755 None] Lock "cinder-eb7cfedf-3933-42f2-9c62-2bcf76017f0a-delete_snapshot" released by "delete_snapshot" :: held 2.144s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:46 devstack sudo[105596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a.b75e0d70-044e-4647-8c4a-e260edfafb69
Nov 06 17:23:46 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:46 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-0bc191c6-5096-407a-9282-c7d0323813c4 tempest-SnapshotDependencyTests-346299755 None] Acquiring lock "cinder-0776511e-bbf8-45c2-b57c-d4ff2b62307a-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:46 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-0bc191c6-5096-407a-9282-c7d0323813c4 tempest-SnapshotDependencyTests-346299755 None] Lock "cinder-0776511e-bbf8-45c2-b57c-d4ff2b62307a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:46 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-0bc191c6-5096-407a-9282-c7d0323813c4 tempest-SnapshotDependencyTests-346299755 None] Acquiring lock "cinder-quobyte-0776511e-bbf8-45c2-b57c-d4ff2b62307a" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:46 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-0bc191c6-5096-407a-9282-c7d0323813c4 tempest-SnapshotDependencyTests-346299755 None] Lock "cinder-quobyte-0776511e-bbf8-45c2-b57c-d4ff2b62307a" acquired by "delete_volume" :: waited 0.015s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:46 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[8685ebe3-eb0e-41d6-92df-9b32a948216f]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:23:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0bc191c6-5096-407a-9282-c7d0323813c4 tempest-SnapshotDependencyTests-346299755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:46 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5da602b6-f380-4c8d-b6db-5af9e83494bc tempest-ProjectReaderTests-1259557497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-97ac0062-e40a-499f-9572-1dbfaff75044" returned: 0 in 0.361s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:46 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5da602b6-f380-4c8d-b6db-5af9e83494bc tempest-ProjectReaderTests-1259557497 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:23:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5da602b6-f380-4c8d-b6db-5af9e83494bc tempest-ProjectReaderTests-1259557497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:46 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5da602b6-f380-4c8d-b6db-5af9e83494bc tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83334778-18d7-426b-9122-84ac28c8a4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97ac0062-e40a-499f-9572-1dbfaff75044', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5da602b6-f380-4c8d-b6db-5af9e83494bc tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c19c616f-4e67-4432-adbf-0652972f6b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:47 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-5da602b6-f380-4c8d-b6db-5af9e83494bc tempest-ProjectReaderTests-1259557497 None] Volume volume-97ac0062-e40a-499f-9572-1dbfaff75044 (97ac0062-e40a-499f-9572-1dbfaff75044): created successfully
Nov 06 17:23:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5da602b6-f380-4c8d-b6db-5af9e83494bc tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c19c616f-4e67-4432-adbf-0652972f6b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:47 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5da602b6-f380-4c8d-b6db-5af9e83494bc tempest-ProjectReaderTests-1259557497 None] Flow 'volume_create_manager' (fae0efe4-ab8f-43f8-8ebe-8c621a26c57d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:23:47 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-5da602b6-f380-4c8d-b6db-5af9e83494bc tempest-ProjectReaderTests-1259557497 None] Created volume successfully.
Nov 06 17:23:47 devstack sudo[105601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a
Nov 06 17:23:47 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:47 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-15178f26-45f1-40ad-a07a-8d92c930f216 tempest-ProjectReaderTests-1615857228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a.b75e0d70-044e-4647-8c4a-e260edfafb69" returned: 0 in 0.536s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-15178f26-45f1-40ad-a07a-8d92c930f216 tempest-ProjectReaderTests-1615857228 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:23:47 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b60a75-c01e-4997-bd4c-7856d0575079]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:23:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-15178f26-45f1-40ad-a07a-8d92c930f216 tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:47 devstack sudo[105606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a
Nov 06 17:23:47 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:47 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0bc191c6-5096-407a-9282-c7d0323813c4 tempest-SnapshotDependencyTests-346299755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a" returned: 0 in 0.470s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0bc191c6-5096-407a-9282-c7d0323813c4 tempest-SnapshotDependencyTests-346299755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:47 devstack sudo[105611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a
Nov 06 17:23:47 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:47 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-15178f26-45f1-40ad-a07a-8d92c930f216 tempest-ProjectReaderTests-1615857228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a" returned: 0 in 0.420s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-15178f26-45f1-40ad-a07a-8d92c930f216 tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a.b75e0d70-044e-4647-8c4a-e260edfafb69 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:47 devstack sudo[105616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a.b75e0d70-044e-4647-8c4a-e260edfafb69
Nov 06 17:23:47 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:47 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0bc191c6-5096-407a-9282-c7d0323813c4 tempest-SnapshotDependencyTests-346299755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-0776511e-bbf8-45c2-b57c-d4ff2b62307a" returned: 0 in 0.337s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:47 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-0bc191c6-5096-407a-9282-c7d0323813c4 tempest-SnapshotDependencyTests-346299755 None] Lock "cinder-quobyte-0776511e-bbf8-45c2-b57c-d4ff2b62307a" released by "delete_volume" :: held 0.903s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:47 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-0bc191c6-5096-407a-9282-c7d0323813c4 tempest-SnapshotDependencyTests-346299755 None] Created reservations ['6f6b1e1c-0ed3-476e-92b3-5ed16e4b4684', '4b17bc04-280b-42e2-95ad-1b242c410c78', 'bf08911e-7bae-460a-adc7-ed3e7af22a0c', 'ef9908da-95de-4e8b-a785-0b2573c4e1c9'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:23:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0bc191c6-5096-407a-9282-c7d0323813c4 tempest-SnapshotDependencyTests-346299755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0bc191c6-5096-407a-9282-c7d0323813c4 tempest-SnapshotDependencyTests-346299755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0bc191c6-5096-407a-9282-c7d0323813c4 tempest-SnapshotDependencyTests-346299755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:23:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0bc191c6-5096-407a-9282-c7d0323813c4 tempest-SnapshotDependencyTests-346299755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:23:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0bc191c6-5096-407a-9282-c7d0323813c4 tempest-SnapshotDependencyTests-346299755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0bc191c6-5096-407a-9282-c7d0323813c4 tempest-SnapshotDependencyTests-346299755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:47 devstack sudo[105622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:23:47 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:47 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f88dd382-8b1d-4a32-ba14-976806f53fd2 tempest-SnapshotDependencyTests-346299755 None] Acquiring lock "cinder-b28dc557-ec91-47e1-bcf6-10f802ecb21b-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:48 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-15178f26-45f1-40ad-a07a-8d92c930f216 tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a.b75e0d70-044e-4647-8c4a-e260edfafb69" returned: 0 in 0.439s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-15178f26-45f1-40ad-a07a-8d92c930f216 tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a.b75e0d70-044e-4647-8c4a-e260edfafb69 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:48 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f88dd382-8b1d-4a32-ba14-976806f53fd2 tempest-SnapshotDependencyTests-346299755 None] Lock "cinder-b28dc557-ec91-47e1-bcf6-10f802ecb21b-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:48 devstack sudo[105624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a.b75e0d70-044e-4647-8c4a-e260edfafb69
Nov 06 17:23:48 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:48 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f88dd382-8b1d-4a32-ba14-976806f53fd2 tempest-SnapshotDependencyTests-346299755 None] Acquiring lock "cinder-quobyte-b28dc557-ec91-47e1-bcf6-10f802ecb21b" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:48 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f88dd382-8b1d-4a32-ba14-976806f53fd2 tempest-SnapshotDependencyTests-346299755 None] Lock "cinder-quobyte-b28dc557-ec91-47e1-bcf6-10f802ecb21b" acquired by "delete_volume" :: waited 0.015s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:48 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[510410c8-4961-467b-a279-652c195a6e29]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:23:48 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f88dd382-8b1d-4a32-ba14-976806f53fd2 tempest-SnapshotDependencyTests-346299755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b28dc557-ec91-47e1-bcf6-10f802ecb21b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0bc191c6-5096-407a-9282-c7d0323813c4 tempest-SnapshotDependencyTests-346299755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.343s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:48 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-0bc191c6-5096-407a-9282-c7d0323813c4 tempest-SnapshotDependencyTests-346299755 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:23:48 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-0bc191c6-5096-407a-9282-c7d0323813c4 tempest-SnapshotDependencyTests-346299755 None] Deleted volume successfully.
Nov 06 17:23:48 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-0bc191c6-5096-407a-9282-c7d0323813c4 tempest-SnapshotDependencyTests-346299755 None] Lock "cinder-0776511e-bbf8-45c2-b57c-d4ff2b62307a-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:48 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-cb8c5908-a4f9-4c29-9d8c-d39db848eeed tempest-ProjectReaderTests-1259557497 None] Acquiring lock "cinder-97ac0062-e40a-499f-9572-1dbfaff75044-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:48 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-cb8c5908-a4f9-4c29-9d8c-d39db848eeed tempest-ProjectReaderTests-1259557497 None] Lock "cinder-97ac0062-e40a-499f-9572-1dbfaff75044-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:48 devstack sudo[105627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b28dc557-ec91-47e1-bcf6-10f802ecb21b
Nov 06 17:23:48 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:48 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-cb8c5908-a4f9-4c29-9d8c-d39db848eeed tempest-ProjectReaderTests-1259557497 None] Acquiring lock "cinder-quobyte-97ac0062-e40a-499f-9572-1dbfaff75044" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:48 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-cb8c5908-a4f9-4c29-9d8c-d39db848eeed tempest-ProjectReaderTests-1259557497 None] Lock "cinder-quobyte-97ac0062-e40a-499f-9572-1dbfaff75044" acquired by "delete_volume" :: waited 0.026s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:48 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-15178f26-45f1-40ad-a07a-8d92c930f216 tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a.b75e0d70-044e-4647-8c4a-e260edfafb69" returned: 0 in 0.424s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:48 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[9570235a-ca56-4bcb-aae4-c61f79deeea6]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:23:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cb8c5908-a4f9-4c29-9d8c-d39db848eeed tempest-ProjectReaderTests-1259557497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-97ac0062-e40a-499f-9572-1dbfaff75044 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:48 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-15178f26-45f1-40ad-a07a-8d92c930f216 tempest-ProjectReaderTests-1615857228 None] Lock "cinder-quobyte-b75e0d70-044e-4647-8c4a-e260edfafb69" released by "_delete_snapshot" :: held 1.966s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:48 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-15178f26-45f1-40ad-a07a-8d92c930f216 tempest-ProjectReaderTests-1615857228 None] Lock "cinder-quobyte-ae7f8e6d-3c53-4636-9c79-5359f12e099a" released by "delete_snapshot" :: held 2.000s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:48 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-15178f26-45f1-40ad-a07a-8d92c930f216 tempest-ProjectReaderTests-1615857228 None] Created reservations ['d689fd6c-e2e0-42fd-bfe2-028747e42c40', '708aaf0b-70df-4798-8c5a-815e63fb20cc', '7ddd20ba-efb4-418e-89da-3c320d494940', '7a58479d-7970-40c1-8f6c-70cfe19066f2'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:23:48 devstack sudo[105630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-97ac0062-e40a-499f-9572-1dbfaff75044
Nov 06 17:23:48 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:48 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-15178f26-45f1-40ad-a07a-8d92c930f216 tempest-ProjectReaderTests-1615857228 None] Delete snapshot completed successfully.
Nov 06 17:23:48 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:48 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-15178f26-45f1-40ad-a07a-8d92c930f216 tempest-ProjectReaderTests-1615857228 None] Lock "cinder-b75e0d70-044e-4647-8c4a-e260edfafb69-delete_snapshot" released by "delete_snapshot" :: held 2.238s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f88dd382-8b1d-4a32-ba14-976806f53fd2 tempest-SnapshotDependencyTests-346299755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b28dc557-ec91-47e1-bcf6-10f802ecb21b" returned: 0 in 0.529s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f88dd382-8b1d-4a32-ba14-976806f53fd2 tempest-SnapshotDependencyTests-346299755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b28dc557-ec91-47e1-bcf6-10f802ecb21b {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:48 devstack sudo[105635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b28dc557-ec91-47e1-bcf6-10f802ecb21b
Nov 06 17:23:48 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:48 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cb8c5908-a4f9-4c29-9d8c-d39db848eeed tempest-ProjectReaderTests-1259557497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-97ac0062-e40a-499f-9572-1dbfaff75044" returned: 0 in 0.470s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cb8c5908-a4f9-4c29-9d8c-d39db848eeed tempest-ProjectReaderTests-1259557497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-97ac0062-e40a-499f-9572-1dbfaff75044 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:48 devstack sudo[105641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-97ac0062-e40a-499f-9572-1dbfaff75044
Nov 06 17:23:48 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:48 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f88dd382-8b1d-4a32-ba14-976806f53fd2 tempest-SnapshotDependencyTests-346299755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-b28dc557-ec91-47e1-bcf6-10f802ecb21b" returned: 0 in 0.262s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:49 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f88dd382-8b1d-4a32-ba14-976806f53fd2 tempest-SnapshotDependencyTests-346299755 None] Lock "cinder-quobyte-b28dc557-ec91-47e1-bcf6-10f802ecb21b" released by "delete_volume" :: held 0.868s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:49 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-f88dd382-8b1d-4a32-ba14-976806f53fd2 tempest-SnapshotDependencyTests-346299755 None] Created reservations ['d8ccfcce-08af-4fe2-8028-ec36d3a4d5eb', '13c52256-b388-4376-85b1-cf17a1936501', '59cd7e1c-8d5a-4e46-9f93-9a7f7b0fcb7f', '939181a7-fa16-4943-b3cf-c81f133aa092'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:23:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f88dd382-8b1d-4a32-ba14-976806f53fd2 tempest-SnapshotDependencyTests-346299755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f88dd382-8b1d-4a32-ba14-976806f53fd2 tempest-SnapshotDependencyTests-346299755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:49 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-f88dd382-8b1d-4a32-ba14-976806f53fd2 tempest-SnapshotDependencyTests-346299755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:23:49 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-f88dd382-8b1d-4a32-ba14-976806f53fd2 tempest-SnapshotDependencyTests-346299755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:23:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-f88dd382-8b1d-4a32-ba14-976806f53fd2 tempest-SnapshotDependencyTests-346299755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f88dd382-8b1d-4a32-ba14-976806f53fd2 tempest-SnapshotDependencyTests-346299755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:49 devstack sudo[105643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:23:49 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:49 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cb8c5908-a4f9-4c29-9d8c-d39db848eeed tempest-ProjectReaderTests-1259557497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-97ac0062-e40a-499f-9572-1dbfaff75044" returned: 0 in 0.308s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:49 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-cb8c5908-a4f9-4c29-9d8c-d39db848eeed tempest-ProjectReaderTests-1259557497 None] Lock "cinder-quobyte-97ac0062-e40a-499f-9572-1dbfaff75044" released by "delete_volume" :: held 0.868s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:49 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-cb8c5908-a4f9-4c29-9d8c-d39db848eeed tempest-ProjectReaderTests-1259557497 None] Created reservations ['b1306538-8db3-4cdf-bb0c-fc50c491119c', 'ae5f3365-5559-4ae9-8a27-5430a20dab3a', 'b875a78c-a44b-40c9-97ff-8726292d66c4', '6a53b7d1-a103-40bb-99f9-8e221abda9ba'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:23:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-cb8c5908-a4f9-4c29-9d8c-d39db848eeed tempest-ProjectReaderTests-1259557497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-cb8c5908-a4f9-4c29-9d8c-d39db848eeed tempest-ProjectReaderTests-1259557497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:49 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-cb8c5908-a4f9-4c29-9d8c-d39db848eeed tempest-ProjectReaderTests-1259557497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:23:49 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-cb8c5908-a4f9-4c29-9d8c-d39db848eeed tempest-ProjectReaderTests-1259557497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:23:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-cb8c5908-a4f9-4c29-9d8c-d39db848eeed tempest-ProjectReaderTests-1259557497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cb8c5908-a4f9-4c29-9d8c-d39db848eeed tempest-ProjectReaderTests-1259557497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:49 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-f88dd382-8b1d-4a32-ba14-976806f53fd2 tempest-SnapshotDependencyTests-346299755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.347s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:49 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-f88dd382-8b1d-4a32-ba14-976806f53fd2 tempest-SnapshotDependencyTests-346299755 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:23:49 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-f88dd382-8b1d-4a32-ba14-976806f53fd2 tempest-SnapshotDependencyTests-346299755 None] Deleted volume successfully.
Nov 06 17:23:49 devstack sudo[105647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:23:49 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:49 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-f88dd382-8b1d-4a32-ba14-976806f53fd2 tempest-SnapshotDependencyTests-346299755 None] Lock "cinder-b28dc557-ec91-47e1-bcf6-10f802ecb21b-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:49 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-76e93f0c-dafa-495b-a4aa-731562cdd9a9 tempest-ProjectReaderTests-1615857228 None] Acquiring lock "cinder-ae7f8e6d-3c53-4636-9c79-5359f12e099a-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:49 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-76e93f0c-dafa-495b-a4aa-731562cdd9a9 tempest-ProjectReaderTests-1615857228 None] Lock "cinder-ae7f8e6d-3c53-4636-9c79-5359f12e099a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:49 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-76e93f0c-dafa-495b-a4aa-731562cdd9a9 tempest-ProjectReaderTests-1615857228 None] Acquiring lock "cinder-quobyte-ae7f8e6d-3c53-4636-9c79-5359f12e099a" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:49 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cb8c5908-a4f9-4c29-9d8c-d39db848eeed tempest-ProjectReaderTests-1259557497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.469s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:49 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-cb8c5908-a4f9-4c29-9d8c-d39db848eeed tempest-ProjectReaderTests-1259557497 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:23:49 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-cb8c5908-a4f9-4c29-9d8c-d39db848eeed tempest-ProjectReaderTests-1259557497 None] Deleted volume successfully.
Nov 06 17:23:49 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-76e93f0c-dafa-495b-a4aa-731562cdd9a9 tempest-ProjectReaderTests-1615857228 None] Lock "cinder-quobyte-ae7f8e6d-3c53-4636-9c79-5359f12e099a" acquired by "delete_volume" :: waited 0.040s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:50 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-cb8c5908-a4f9-4c29-9d8c-d39db848eeed tempest-ProjectReaderTests-1259557497 None] Lock "cinder-97ac0062-e40a-499f-9572-1dbfaff75044-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:50 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbda5895-cbf0-41e5-81be-20936320d589]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:23:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-76e93f0c-dafa-495b-a4aa-731562cdd9a9 tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:50 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-4919dea1-87ba-4424-ab1a-af9df534c65f tempest-ProjectReaderTests-1259557497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:23:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4919dea1-87ba-4424-ab1a-af9df534c65f tempest-ProjectReaderTests-1259557497 None] Flow 'volume_create_manager' (c2d059af-5233-4ec1-9ab0-e0b3985e3411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:23:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4919dea1-87ba-4424-ab1a-af9df534c65f tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f8f4616-62b8-4dbb-a75c-83da8c804a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:50 devstack sudo[105650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a
Nov 06 17:23:50 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4919dea1-87ba-4424-ab1a-af9df534c65f tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f8f4616-62b8-4dbb-a75c-83da8c804a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1610530976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ae43ccb-f766-4d07-b1cb-d807b8eb3ea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b143ddd07a13462282cdb1f6553fba15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:23:50Z,use_quota=True,user_id='d808cf170c5847029339b1a0bae5b3e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4919dea1-87ba-4424-ab1a-af9df534c65f tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe02f76-c990-4c6c-ba5d-5ca75c9284fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4919dea1-87ba-4424-ab1a-af9df534c65f tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe02f76-c990-4c6c-ba5d-5ca75c9284fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4919dea1-87ba-4424-ab1a-af9df534c65f tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d7a13fd-4411-4f16-a317-420cb0cbdfed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4919dea1-87ba-4424-ab1a-af9df534c65f tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d7a13fd-4411-4f16-a317-420cb0cbdfed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ae43ccb-f766-4d07-b1cb-d807b8eb3ea3', 'volume_name': 'volume-7ae43ccb-f766-4d07-b1cb-d807b8eb3ea3', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4919dea1-87ba-4424-ab1a-af9df534c65f tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c65780-493c-4ce6-95aa-af2af8c4305f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4919dea1-87ba-4424-ab1a-af9df534c65f tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c65780-493c-4ce6-95aa-af2af8c4305f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4919dea1-87ba-4424-ab1a-af9df534c65f tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed7d234-a16b-4a78-8204-398a17bec32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:50 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-4919dea1-87ba-4424-ab1a-af9df534c65f tempest-ProjectReaderTests-1259557497 None] Volume 7ae43ccb-f766-4d07-b1cb-d807b8eb3ea3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ae43ccb-f766-4d07-b1cb-d807b8eb3ea3', 'volume_size': 1}
Nov 06 17:23:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4919dea1-87ba-4424-ab1a-af9df534c65f tempest-ProjectReaderTests-1259557497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4919dea1-87ba-4424-ab1a-af9df534c65f tempest-ProjectReaderTests-1259557497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4919dea1-87ba-4424-ab1a-af9df534c65f tempest-ProjectReaderTests-1259557497 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1610530976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ae43ccb-f766-4d07-b1cb-d807b8eb3ea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b143ddd07a13462282cdb1f6553fba15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:23:50Z,use_quota=True,user_id='d808cf170c5847029339b1a0bae5b3e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:23:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-4919dea1-87ba-4424-ab1a-af9df534c65f tempest-ProjectReaderTests-1259557497 None] Creating volume 7ae43ccb-f766-4d07-b1cb-d807b8eb3ea3 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:23:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4919dea1-87ba-4424-ab1a-af9df534c65f tempest-ProjectReaderTests-1259557497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4919dea1-87ba-4424-ab1a-af9df534c65f tempest-ProjectReaderTests-1259557497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4919dea1-87ba-4424-ab1a-af9df534c65f tempest-ProjectReaderTests-1259557497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:23:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4919dea1-87ba-4424-ab1a-af9df534c65f tempest-ProjectReaderTests-1259557497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:23:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4919dea1-87ba-4424-ab1a-af9df534c65f tempest-ProjectReaderTests-1259557497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4919dea1-87ba-4424-ab1a-af9df534c65f tempest-ProjectReaderTests-1259557497 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:23:50 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-4919dea1-87ba-4424-ab1a-af9df534c65f tempest-ProjectReaderTests-1259557497 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:23:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4919dea1-87ba-4424-ab1a-af9df534c65f tempest-ProjectReaderTests-1259557497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7ae43ccb-f766-4d07-b1cb-d807b8eb3ea3 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:50 devstack sudo[105652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7ae43ccb-f766-4d07-b1cb-d807b8eb3ea3 1073741824
Nov 06 17:23:50 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:50 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-76e93f0c-dafa-495b-a4aa-731562cdd9a9 tempest-ProjectReaderTests-1615857228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a" returned: 0 in 0.494s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-76e93f0c-dafa-495b-a4aa-731562cdd9a9 tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:50 devstack sudo[105659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a
Nov 06 17:23:50 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:50 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-76e93f0c-dafa-495b-a4aa-731562cdd9a9 tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-ae7f8e6d-3c53-4636-9c79-5359f12e099a" returned: 0 in 0.284s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:50 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:50 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-76e93f0c-dafa-495b-a4aa-731562cdd9a9 tempest-ProjectReaderTests-1615857228 None] Lock "cinder-quobyte-ae7f8e6d-3c53-4636-9c79-5359f12e099a" released by "delete_volume" :: held 0.878s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4919dea1-87ba-4424-ab1a-af9df534c65f tempest-ProjectReaderTests-1259557497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7ae43ccb-f766-4d07-b1cb-d807b8eb3ea3 1073741824" returned: 0 in 0.582s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4919dea1-87ba-4424-ab1a-af9df534c65f tempest-ProjectReaderTests-1259557497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7ae43ccb-f766-4d07-b1cb-d807b8eb3ea3 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:50 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-76e93f0c-dafa-495b-a4aa-731562cdd9a9 tempest-ProjectReaderTests-1615857228 None] Created reservations ['8a07608b-eba6-449a-927a-31ac95e9abb0', 'df1ce796-7d11-4344-957c-325c8e59af30', '50f5c283-4de4-49dd-9a15-5b5213684f13', 'dda299e9-1630-43fb-a881-e6b83110f49b'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:23:50 devstack sudo[105664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7ae43ccb-f766-4d07-b1cb-d807b8eb3ea3
Nov 06 17:23:50 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-76e93f0c-dafa-495b-a4aa-731562cdd9a9 tempest-ProjectReaderTests-1615857228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-76e93f0c-dafa-495b-a4aa-731562cdd9a9 tempest-ProjectReaderTests-1615857228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:51 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-76e93f0c-dafa-495b-a4aa-731562cdd9a9 tempest-ProjectReaderTests-1615857228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:23:51 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-76e93f0c-dafa-495b-a4aa-731562cdd9a9 tempest-ProjectReaderTests-1615857228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:23:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-76e93f0c-dafa-495b-a4aa-731562cdd9a9 tempest-ProjectReaderTests-1615857228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-76e93f0c-dafa-495b-a4aa-731562cdd9a9 tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:51 devstack sudo[105666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:23:51 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:51 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4919dea1-87ba-4424-ab1a-af9df534c65f tempest-ProjectReaderTests-1259557497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7ae43ccb-f766-4d07-b1cb-d807b8eb3ea3" returned: 0 in 0.429s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:51 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4919dea1-87ba-4424-ab1a-af9df534c65f tempest-ProjectReaderTests-1259557497 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:23:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4919dea1-87ba-4424-ab1a-af9df534c65f tempest-ProjectReaderTests-1259557497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4919dea1-87ba-4424-ab1a-af9df534c65f tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed7d234-a16b-4a78-8204-398a17bec32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ae43ccb-f766-4d07-b1cb-d807b8eb3ea3', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4919dea1-87ba-4424-ab1a-af9df534c65f tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d51153e-11aa-49ac-ba51-8090b20d98a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:51 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-4919dea1-87ba-4424-ab1a-af9df534c65f tempest-ProjectReaderTests-1259557497 None] Volume volume-7ae43ccb-f766-4d07-b1cb-d807b8eb3ea3 (7ae43ccb-f766-4d07-b1cb-d807b8eb3ea3): created successfully
Nov 06 17:23:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4919dea1-87ba-4424-ab1a-af9df534c65f tempest-ProjectReaderTests-1259557497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d51153e-11aa-49ac-ba51-8090b20d98a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4919dea1-87ba-4424-ab1a-af9df534c65f tempest-ProjectReaderTests-1259557497 None] Flow 'volume_create_manager' (c2d059af-5233-4ec1-9ab0-e0b3985e3411) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:23:51 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-4919dea1-87ba-4424-ab1a-af9df534c65f tempest-ProjectReaderTests-1259557497 None] Created volume successfully.
Nov 06 17:23:51 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-76e93f0c-dafa-495b-a4aa-731562cdd9a9 tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.399s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:51 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-76e93f0c-dafa-495b-a4aa-731562cdd9a9 tempest-ProjectReaderTests-1615857228 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:23:51 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-76e93f0c-dafa-495b-a4aa-731562cdd9a9 tempest-ProjectReaderTests-1615857228 None] Deleted volume successfully.
Nov 06 17:23:51 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-76e93f0c-dafa-495b-a4aa-731562cdd9a9 tempest-ProjectReaderTests-1615857228 None] Lock "cinder-ae7f8e6d-3c53-4636-9c79-5359f12e099a-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:52 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-948c4ed6-32f3-4838-9dd2-6799a984a835 tempest-ProjectReaderTests-1259557497 None] Acquiring lock "cinder-7ae43ccb-f766-4d07-b1cb-d807b8eb3ea3-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:52 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-948c4ed6-32f3-4838-9dd2-6799a984a835 tempest-ProjectReaderTests-1259557497 None] Lock "cinder-7ae43ccb-f766-4d07-b1cb-d807b8eb3ea3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:52 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-948c4ed6-32f3-4838-9dd2-6799a984a835 tempest-ProjectReaderTests-1259557497 None] Acquiring lock "cinder-quobyte-7ae43ccb-f766-4d07-b1cb-d807b8eb3ea3" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:52 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-948c4ed6-32f3-4838-9dd2-6799a984a835 tempest-ProjectReaderTests-1259557497 None] Lock "cinder-quobyte-7ae43ccb-f766-4d07-b1cb-d807b8eb3ea3" acquired by "delete_volume" :: waited 0.025s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:52 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d67714-1b9b-42c5-a4e3-882729a37c6f]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:23:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-948c4ed6-32f3-4838-9dd2-6799a984a835 tempest-ProjectReaderTests-1259557497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7ae43ccb-f766-4d07-b1cb-d807b8eb3ea3 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:52 devstack sudo[105708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7ae43ccb-f766-4d07-b1cb-d807b8eb3ea3
Nov 06 17:23:52 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:52 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-b83461b9-999e-463e-8909-c05747ec468c tempest-ProjectReaderTests-1615857228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:23:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b83461b9-999e-463e-8909-c05747ec468c tempest-ProjectReaderTests-1615857228 None] Flow 'volume_create_manager' (8dd68303-9212-4f15-b07c-685d433df28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:23:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b83461b9-999e-463e-8909-c05747ec468c tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63436d46-073b-4efd-a558-9175406d4c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b83461b9-999e-463e-8909-c05747ec468c tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63436d46-073b-4efd-a558-9175406d4c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-441342337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f65ec983-481b-47d8-9629-eefd3528d225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e765fbd33c2345449278669b7fd8c195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:23:53Z,use_quota=True,user_id='b7b89c3c77ff44f4adddd9248571825a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b83461b9-999e-463e-8909-c05747ec468c tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a000d86-2cf5-4097-8dbe-376e428a0c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b83461b9-999e-463e-8909-c05747ec468c tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a000d86-2cf5-4097-8dbe-376e428a0c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b83461b9-999e-463e-8909-c05747ec468c tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (458e12fc-b491-43e6-8ee2-6194bc79826d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b83461b9-999e-463e-8909-c05747ec468c tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (458e12fc-b491-43e6-8ee2-6194bc79826d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f65ec983-481b-47d8-9629-eefd3528d225', 'volume_name': 'volume-f65ec983-481b-47d8-9629-eefd3528d225', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b83461b9-999e-463e-8909-c05747ec468c tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dfe0bd7-64a1-4d8f-bbc9-4596ec412b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b83461b9-999e-463e-8909-c05747ec468c tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dfe0bd7-64a1-4d8f-bbc9-4596ec412b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:52 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b83461b9-999e-463e-8909-c05747ec468c tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb6cd16-14f9-438b-9cc3-58fbc846989f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:52 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-b83461b9-999e-463e-8909-c05747ec468c tempest-ProjectReaderTests-1615857228 None] Volume f65ec983-481b-47d8-9629-eefd3528d225: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f65ec983-481b-47d8-9629-eefd3528d225', 'volume_size': 1}
Nov 06 17:23:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b83461b9-999e-463e-8909-c05747ec468c tempest-ProjectReaderTests-1615857228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b83461b9-999e-463e-8909-c05747ec468c tempest-ProjectReaderTests-1615857228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:52 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-b83461b9-999e-463e-8909-c05747ec468c tempest-ProjectReaderTests-1615857228 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-441342337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f65ec983-481b-47d8-9629-eefd3528d225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e765fbd33c2345449278669b7fd8c195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:23:53Z,use_quota=True,user_id='b7b89c3c77ff44f4adddd9248571825a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:23:52 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-b83461b9-999e-463e-8909-c05747ec468c tempest-ProjectReaderTests-1615857228 None] Creating volume f65ec983-481b-47d8-9629-eefd3528d225 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:23:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b83461b9-999e-463e-8909-c05747ec468c tempest-ProjectReaderTests-1615857228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b83461b9-999e-463e-8909-c05747ec468c tempest-ProjectReaderTests-1615857228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:52 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-b83461b9-999e-463e-8909-c05747ec468c tempest-ProjectReaderTests-1615857228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:23:52 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-b83461b9-999e-463e-8909-c05747ec468c tempest-ProjectReaderTests-1615857228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:23:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b83461b9-999e-463e-8909-c05747ec468c tempest-ProjectReaderTests-1615857228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:52 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-b83461b9-999e-463e-8909-c05747ec468c tempest-ProjectReaderTests-1615857228 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:23:52 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-b83461b9-999e-463e-8909-c05747ec468c tempest-ProjectReaderTests-1615857228 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:23:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b83461b9-999e-463e-8909-c05747ec468c tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:52 devstack sudo[105713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225 1073741824
Nov 06 17:23:52 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:52 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-948c4ed6-32f3-4838-9dd2-6799a984a835 tempest-ProjectReaderTests-1259557497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7ae43ccb-f766-4d07-b1cb-d807b8eb3ea3" returned: 0 in 0.537s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-948c4ed6-32f3-4838-9dd2-6799a984a835 tempest-ProjectReaderTests-1259557497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7ae43ccb-f766-4d07-b1cb-d807b8eb3ea3 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:52 devstack sudo[105715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7ae43ccb-f766-4d07-b1cb-d807b8eb3ea3
Nov 06 17:23:52 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:53 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-948c4ed6-32f3-4838-9dd2-6799a984a835 tempest-ProjectReaderTests-1259557497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7ae43ccb-f766-4d07-b1cb-d807b8eb3ea3" returned: 0 in 0.289s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:53 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-948c4ed6-32f3-4838-9dd2-6799a984a835 tempest-ProjectReaderTests-1259557497 None] Lock "cinder-quobyte-7ae43ccb-f766-4d07-b1cb-d807b8eb3ea3" released by "delete_volume" :: held 0.879s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:53 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-948c4ed6-32f3-4838-9dd2-6799a984a835 tempest-ProjectReaderTests-1259557497 None] Created reservations ['d67619bf-811d-4547-974b-f3d3da2b59a0', '60709280-733b-4f74-8f38-06d7843090d2', '745dafbf-11a9-445f-bd2e-dc2174be6ac7', '771681c7-6d6a-4977-8b1c-b5f96eccf74c'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:23:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-948c4ed6-32f3-4838-9dd2-6799a984a835 tempest-ProjectReaderTests-1259557497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-948c4ed6-32f3-4838-9dd2-6799a984a835 tempest-ProjectReaderTests-1259557497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:53 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-948c4ed6-32f3-4838-9dd2-6799a984a835 tempest-ProjectReaderTests-1259557497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:23:53 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-948c4ed6-32f3-4838-9dd2-6799a984a835 tempest-ProjectReaderTests-1259557497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:23:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-948c4ed6-32f3-4838-9dd2-6799a984a835 tempest-ProjectReaderTests-1259557497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-948c4ed6-32f3-4838-9dd2-6799a984a835 tempest-ProjectReaderTests-1259557497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:53 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b83461b9-999e-463e-8909-c05747ec468c tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225 1073741824" returned: 0 in 0.605s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:53 devstack sudo[105722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:23:53 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b83461b9-999e-463e-8909-c05747ec468c tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:53 devstack sudo[105724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225
Nov 06 17:23:53 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:53 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-948c4ed6-32f3-4838-9dd2-6799a984a835 tempest-ProjectReaderTests-1259557497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.470s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:53 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-948c4ed6-32f3-4838-9dd2-6799a984a835 tempest-ProjectReaderTests-1259557497 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:23:53 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-948c4ed6-32f3-4838-9dd2-6799a984a835 tempest-ProjectReaderTests-1259557497 None] Deleted volume successfully.
Nov 06 17:23:53 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-948c4ed6-32f3-4838-9dd2-6799a984a835 tempest-ProjectReaderTests-1259557497 None] Lock "cinder-7ae43ccb-f766-4d07-b1cb-d807b8eb3ea3-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:23:53 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b83461b9-999e-463e-8909-c05747ec468c tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225" returned: 0 in 0.425s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:53 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-b83461b9-999e-463e-8909-c05747ec468c tempest-ProjectReaderTests-1615857228 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:23:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-b83461b9-999e-463e-8909-c05747ec468c tempest-ProjectReaderTests-1615857228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b83461b9-999e-463e-8909-c05747ec468c tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb6cd16-14f9-438b-9cc3-58fbc846989f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f65ec983-481b-47d8-9629-eefd3528d225', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:53 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b83461b9-999e-463e-8909-c05747ec468c tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4d60cce-cc45-4dd4-8757-33e835a395fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:54 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-b83461b9-999e-463e-8909-c05747ec468c tempest-ProjectReaderTests-1615857228 None] Volume volume-f65ec983-481b-47d8-9629-eefd3528d225 (f65ec983-481b-47d8-9629-eefd3528d225): created successfully
Nov 06 17:23:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b83461b9-999e-463e-8909-c05747ec468c tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4d60cce-cc45-4dd4-8757-33e835a395fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:54 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-b83461b9-999e-463e-8909-c05747ec468c tempest-ProjectReaderTests-1615857228 None] Flow 'volume_create_manager' (8dd68303-9212-4f15-b07c-685d433df28d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:23:54 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-b83461b9-999e-463e-8909-c05747ec468c tempest-ProjectReaderTests-1615857228 None] Created volume successfully.
Nov 06 17:23:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-55172252-c499-47e3-892c-30a35750f08d tempest-ProjectReaderTests-1615857228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-55172252-c499-47e3-892c-30a35750f08d tempest-ProjectReaderTests-1615857228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:55 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-55172252-c499-47e3-892c-30a35750f08d tempest-ProjectReaderTests-1615857228 None] Creating offline snapshot 94520e64-a67c-4d2d-a447-9ca8d8c2b202 of volume f65ec983-481b-47d8-9629-eefd3528d225 {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:23:55 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57a9ae8-aaf5-436a-bd31-185ecc9767c6]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:23:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-55172252-c499-47e3-892c-30a35750f08d tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:55 devstack sudo[105730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225
Nov 06 17:23:55 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:55 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-55172252-c499-47e3-892c-30a35750f08d tempest-ProjectReaderTests-1615857228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225" returned: 0 in 0.579s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-55172252-c499-47e3-892c-30a35750f08d tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225.94520e64-a67c-4d2d-a447-9ca8d8c2b202 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:55 devstack sudo[105735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225.94520e64-a67c-4d2d-a447-9ca8d8c2b202 1G
Nov 06 17:23:55 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:56 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-55172252-c499-47e3-892c-30a35750f08d tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225.94520e64-a67c-4d2d-a447-9ca8d8c2b202 1G" returned: 0 in 0.540s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-55172252-c499-47e3-892c-30a35750f08d tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f65ec983-481b-47d8-9629-eefd3528d225 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225.94520e64-a67c-4d2d-a447-9ca8d8c2b202 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:56 devstack sudo[105740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f65ec983-481b-47d8-9629-eefd3528d225 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225.94520e64-a67c-4d2d-a447-9ca8d8c2b202
Nov 06 17:23:56 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:56 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-55172252-c499-47e3-892c-30a35750f08d tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f65ec983-481b-47d8-9629-eefd3528d225 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225.94520e64-a67c-4d2d-a447-9ca8d8c2b202" returned: 0 in 0.365s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:56 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-55172252-c499-47e3-892c-30a35750f08d tempest-ProjectReaderTests-1615857228 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225.94520e64-a67c-4d2d-a447-9ca8d8c2b202 is being set with open permissions: ugo+rw
Nov 06 17:23:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-55172252-c499-47e3-892c-30a35750f08d tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225.94520e64-a67c-4d2d-a447-9ca8d8c2b202 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:56 devstack sudo[105746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225.94520e64-a67c-4d2d-a447-9ca8d8c2b202
Nov 06 17:23:56 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:56 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-55172252-c499-47e3-892c-30a35750f08d tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225.94520e64-a67c-4d2d-a447-9ca8d8c2b202" returned: 0 in 0.283s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-55172252-c499-47e3-892c-30a35750f08d tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:56 devstack sudo[105750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225.info
Nov 06 17:23:56 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:57 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-55172252-c499-47e3-892c-30a35750f08d tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225.info" returned: 0 in 0.298s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:57 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-55172252-c499-47e3-892c-30a35750f08d tempest-ProjectReaderTests-1615857228 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225.info is being set with open permissions: ugo+rw
Nov 06 17:23:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-55172252-c499-47e3-892c-30a35750f08d tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:57 devstack sudo[105753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225.info
Nov 06 17:23:57 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:57 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d875059-2fdc-486c-8633-e20a406cb9c3 tempest-ProjectMemberTests-1544704132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:23:57 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1d875059-2fdc-486c-8633-e20a406cb9c3 tempest-ProjectMemberTests-1544704132 None] Flow 'volume_create_manager' (8355d758-3d47-4322-a3ee-b9968a2e6cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:23:57 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1d875059-2fdc-486c-8633-e20a406cb9c3 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b03a1d6d-df17-4994-8801-3559c9b6970e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:57 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1d875059-2fdc-486c-8633-e20a406cb9c3 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b03a1d6d-df17-4994-8801-3559c9b6970e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-959135841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcbf7c21-b202-47a2-bcca-bae5b7cf1424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95db90b8146744d19b5f094536ef20c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:23:57Z,use_quota=True,user_id='b0a2c8c9eeea4d8e90c8a6fcb89970cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:57 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1d875059-2fdc-486c-8633-e20a406cb9c3 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ccf2983-218d-499a-afcb-06d6a452e076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:57 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1d875059-2fdc-486c-8633-e20a406cb9c3 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ccf2983-218d-499a-afcb-06d6a452e076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:57 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1d875059-2fdc-486c-8633-e20a406cb9c3 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11919366-70d7-4706-81a5-6b741e65eb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:57 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1d875059-2fdc-486c-8633-e20a406cb9c3 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11919366-70d7-4706-81a5-6b741e65eb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcbf7c21-b202-47a2-bcca-bae5b7cf1424', 'volume_name': 'volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:57 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1d875059-2fdc-486c-8633-e20a406cb9c3 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f4611f1-17c4-49a2-800a-327aa109af0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:57 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1d875059-2fdc-486c-8633-e20a406cb9c3 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f4611f1-17c4-49a2-800a-327aa109af0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:57 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1d875059-2fdc-486c-8633-e20a406cb9c3 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c71af68f-f979-493c-a46b-08f58a166dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:57 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-1d875059-2fdc-486c-8633-e20a406cb9c3 tempest-ProjectMemberTests-1544704132 None] Volume bcbf7c21-b202-47a2-bcca-bae5b7cf1424: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424', 'volume_size': 1}
Nov 06 17:23:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1d875059-2fdc-486c-8633-e20a406cb9c3 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:57 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-55172252-c499-47e3-892c-30a35750f08d tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225.info" returned: 0 in 0.261s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-55172252-c499-47e3-892c-30a35750f08d tempest-ProjectReaderTests-1615857228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.449s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1d875059-2fdc-486c-8633-e20a406cb9c3 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.122s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:57 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1d875059-2fdc-486c-8633-e20a406cb9c3 tempest-ProjectMemberTests-1544704132 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-959135841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcbf7c21-b202-47a2-bcca-bae5b7cf1424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95db90b8146744d19b5f094536ef20c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:23:57Z,use_quota=True,user_id='b0a2c8c9eeea4d8e90c8a6fcb89970cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:23:57 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-1d875059-2fdc-486c-8633-e20a406cb9c3 tempest-ProjectMemberTests-1544704132 None] Creating volume bcbf7c21-b202-47a2-bcca-bae5b7cf1424 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:23:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1d875059-2fdc-486c-8633-e20a406cb9c3 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1d875059-2fdc-486c-8633-e20a406cb9c3 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:57 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1d875059-2fdc-486c-8633-e20a406cb9c3 tempest-ProjectMemberTests-1544704132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:23:57 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1d875059-2fdc-486c-8633-e20a406cb9c3 tempest-ProjectMemberTests-1544704132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:23:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1d875059-2fdc-486c-8633-e20a406cb9c3 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:57 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1d875059-2fdc-486c-8633-e20a406cb9c3 tempest-ProjectMemberTests-1544704132 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:23:57 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-1d875059-2fdc-486c-8633-e20a406cb9c3 tempest-ProjectMemberTests-1544704132 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:23:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1d875059-2fdc-486c-8633-e20a406cb9c3 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:57 devstack sudo[105756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424 1073741824
Nov 06 17:23:57 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:57 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-55172252-c499-47e3-892c-30a35750f08d tempest-ProjectReaderTests-1615857228 None] Create snapshot completed successfully
Nov 06 17:23:58 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1d875059-2fdc-486c-8633-e20a406cb9c3 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424 1073741824" returned: 0 in 0.489s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1d875059-2fdc-486c-8633-e20a406cb9c3 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:58 devstack sudo[105762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424
Nov 06 17:23:58 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:58 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-90cd505a-6dbe-45ca-b16a-98c1111f16ad tempest-ProjectReaderTests-1615857228 None] Acquiring lock "cinder-94520e64-a67c-4d2d-a447-9ca8d8c2b202-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:58 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-90cd505a-6dbe-45ca-b16a-98c1111f16ad tempest-ProjectReaderTests-1615857228 None] Lock "cinder-94520e64-a67c-4d2d-a447-9ca8d8c2b202-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:58 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-90cd505a-6dbe-45ca-b16a-98c1111f16ad tempest-ProjectReaderTests-1615857228 None] Acquiring lock "cinder-quobyte-f65ec983-481b-47d8-9629-eefd3528d225" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:58 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-90cd505a-6dbe-45ca-b16a-98c1111f16ad tempest-ProjectReaderTests-1615857228 None] Lock "cinder-quobyte-f65ec983-481b-47d8-9629-eefd3528d225" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:58 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-90cd505a-6dbe-45ca-b16a-98c1111f16ad tempest-ProjectReaderTests-1615857228 None] Acquiring lock "cinder-quobyte-94520e64-a67c-4d2d-a447-9ca8d8c2b202" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:23:58 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1d875059-2fdc-486c-8633-e20a406cb9c3 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424" returned: 0 in 0.273s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:58 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-1d875059-2fdc-486c-8633-e20a406cb9c3 tempest-ProjectMemberTests-1544704132 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:23:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-1d875059-2fdc-486c-8633-e20a406cb9c3 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:23:58 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-90cd505a-6dbe-45ca-b16a-98c1111f16ad tempest-ProjectReaderTests-1615857228 None] Lock "cinder-quobyte-94520e64-a67c-4d2d-a447-9ca8d8c2b202" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:23:58 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-90cd505a-6dbe-45ca-b16a-98c1111f16ad tempest-ProjectReaderTests-1615857228 None] Deleting offline snapshot 94520e64-a67c-4d2d-a447-9ca8d8c2b202 of volume f65ec983-481b-47d8-9629-eefd3528d225 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:23:58 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-90cd505a-6dbe-45ca-b16a-98c1111f16ad tempest-ProjectReaderTests-1615857228 None] snapshot_file for this snap is: volume-f65ec983-481b-47d8-9629-eefd3528d225.94520e64-a67c-4d2d-a447-9ca8d8c2b202 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:23:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1d875059-2fdc-486c-8633-e20a406cb9c3 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c71af68f-f979-493c-a46b-08f58a166dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1d875059-2fdc-486c-8633-e20a406cb9c3 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25991d93-96cb-4199-b7a2-fdb0cd5d55ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:23:58 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f91ca07-5f19-4787-985d-b39a8d59e572]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:23:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-90cd505a-6dbe-45ca-b16a-98c1111f16ad tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225.94520e64-a67c-4d2d-a447-9ca8d8c2b202 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:58 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-1d875059-2fdc-486c-8633-e20a406cb9c3 tempest-ProjectMemberTests-1544704132 None] Volume volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424 (bcbf7c21-b202-47a2-bcca-bae5b7cf1424): created successfully
Nov 06 17:23:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1d875059-2fdc-486c-8633-e20a406cb9c3 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25991d93-96cb-4199-b7a2-fdb0cd5d55ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:23:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-1d875059-2fdc-486c-8633-e20a406cb9c3 tempest-ProjectMemberTests-1544704132 None] Flow 'volume_create_manager' (8355d758-3d47-4322-a3ee-b9968a2e6cac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:23:58 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-1d875059-2fdc-486c-8633-e20a406cb9c3 tempest-ProjectMemberTests-1544704132 None] Created volume successfully.
Nov 06 17:23:58 devstack sudo[105765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225.94520e64-a67c-4d2d-a447-9ca8d8c2b202
Nov 06 17:23:58 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:58 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-90cd505a-6dbe-45ca-b16a-98c1111f16ad tempest-ProjectReaderTests-1615857228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225.94520e64-a67c-4d2d-a447-9ca8d8c2b202" returned: 0 in 0.380s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:58 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-90cd505a-6dbe-45ca-b16a-98c1111f16ad tempest-ProjectReaderTests-1615857228 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f65ec983-481b-47d8-9629-eefd3528d225(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:23:58 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[edaadff7-6aaa-4ab1-ad21-87d03d239a5e]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:23:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-90cd505a-6dbe-45ca-b16a-98c1111f16ad tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:58 devstack sudo[105770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225
Nov 06 17:23:58 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:59 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-90cd505a-6dbe-45ca-b16a-98c1111f16ad tempest-ProjectReaderTests-1615857228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225" returned: 0 in 0.421s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-90cd505a-6dbe-45ca-b16a-98c1111f16ad tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225.94520e64-a67c-4d2d-a447-9ca8d8c2b202 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:59 devstack sudo[105775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225.94520e64-a67c-4d2d-a447-9ca8d8c2b202
Nov 06 17:23:59 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:59 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root
Nov 06 17:23:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-90cd505a-6dbe-45ca-b16a-98c1111f16ad tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225.94520e64-a67c-4d2d-a447-9ca8d8c2b202" returned: 0 in 0.455s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:23:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-90cd505a-6dbe-45ca-b16a-98c1111f16ad tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225.94520e64-a67c-4d2d-a447-9ca8d8c2b202 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:23:59 devstack sudo[105781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225.94520e64-a67c-4d2d-a447-9ca8d8c2b202
Nov 06 17:23:59 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:23:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ff33df6b-d214-4bee-b290-6eacec0acbae tempest-ProjectMemberTests-1544704132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:23:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ff33df6b-d214-4bee-b290-6eacec0acbae tempest-ProjectMemberTests-1544704132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:23:59 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-ff33df6b-d214-4bee-b290-6eacec0acbae tempest-ProjectMemberTests-1544704132 None] Creating offline snapshot 17d97f73-9c3d-4666-b7dd-6e5c02780f5e of volume bcbf7c21-b202-47a2-bcca-bae5b7cf1424 {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:23:59 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[86280092-6646-49fb-937c-8017b659e9bd]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:23:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ff33df6b-d214-4bee-b290-6eacec0acbae tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:00 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-90cd505a-6dbe-45ca-b16a-98c1111f16ad tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225.94520e64-a67c-4d2d-a447-9ca8d8c2b202" returned: 0 in 0.311s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:00 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-90cd505a-6dbe-45ca-b16a-98c1111f16ad tempest-ProjectReaderTests-1615857228 None] Lock "cinder-quobyte-94520e64-a67c-4d2d-a447-9ca8d8c2b202" released by "_delete_snapshot" :: held 1.690s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:00 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-90cd505a-6dbe-45ca-b16a-98c1111f16ad tempest-ProjectReaderTests-1615857228 None] Lock "cinder-quobyte-f65ec983-481b-47d8-9629-eefd3528d225" released by "delete_snapshot" :: held 1.721s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:00 devstack sudo[105785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424
Nov 06 17:24:00 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:00 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-90cd505a-6dbe-45ca-b16a-98c1111f16ad tempest-ProjectReaderTests-1615857228 None] Created reservations ['16aecf4f-4713-4dc1-b30c-6a41786278d4', 'cc3cfaa1-6fa1-4a6e-8c72-fe1c2a87179b', 'bd818088-4838-4617-af69-af4e618cb93c', 'e7c61981-cae0-4420-80bb-74a84c3378c6'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:24:00 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-90cd505a-6dbe-45ca-b16a-98c1111f16ad tempest-ProjectReaderTests-1615857228 None] Delete snapshot completed successfully.
Nov 06 17:24:00 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-90cd505a-6dbe-45ca-b16a-98c1111f16ad tempest-ProjectReaderTests-1615857228 None] Lock "cinder-94520e64-a67c-4d2d-a447-9ca8d8c2b202-delete_snapshot" released by "delete_snapshot" :: held 1.869s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:00 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ff33df6b-d214-4bee-b290-6eacec0acbae tempest-ProjectMemberTests-1544704132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424" returned: 0 in 0.409s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ff33df6b-d214-4bee-b290-6eacec0acbae tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424.17d97f73-9c3d-4666-b7dd-6e5c02780f5e 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:00 devstack sudo[105790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424.17d97f73-9c3d-4666-b7dd-6e5c02780f5e 1G
Nov 06 17:24:00 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:00 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9485a9fd-3c69-4ff9-a52e-cfa6b63692e3 tempest-ProjectReaderTests-1615857228 None] Acquiring lock "cinder-f65ec983-481b-47d8-9629-eefd3528d225-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:00 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9485a9fd-3c69-4ff9-a52e-cfa6b63692e3 tempest-ProjectReaderTests-1615857228 None] Lock "cinder-f65ec983-481b-47d8-9629-eefd3528d225-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:00 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9485a9fd-3c69-4ff9-a52e-cfa6b63692e3 tempest-ProjectReaderTests-1615857228 None] Acquiring lock "cinder-quobyte-f65ec983-481b-47d8-9629-eefd3528d225" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:00 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9485a9fd-3c69-4ff9-a52e-cfa6b63692e3 tempest-ProjectReaderTests-1615857228 None] Lock "cinder-quobyte-f65ec983-481b-47d8-9629-eefd3528d225" acquired by "delete_volume" :: waited 0.032s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:00 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3e59e3-8407-43c5-ac43-9a45d18b3657]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:24:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9485a9fd-3c69-4ff9-a52e-cfa6b63692e3 tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:00 devstack sudo[105794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225
Nov 06 17:24:00 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:00 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ff33df6b-d214-4bee-b290-6eacec0acbae tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424.17d97f73-9c3d-4666-b7dd-6e5c02780f5e 1G" returned: 0 in 0.542s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ff33df6b-d214-4bee-b290-6eacec0acbae tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424.17d97f73-9c3d-4666-b7dd-6e5c02780f5e {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:00 devstack sudo[105798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424.17d97f73-9c3d-4666-b7dd-6e5c02780f5e
Nov 06 17:24:00 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:01 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9485a9fd-3c69-4ff9-a52e-cfa6b63692e3 tempest-ProjectReaderTests-1615857228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225" returned: 0 in 0.473s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9485a9fd-3c69-4ff9-a52e-cfa6b63692e3 tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:01 devstack sudo[105803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225
Nov 06 17:24:01 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:01 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ff33df6b-d214-4bee-b290-6eacec0acbae tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424.17d97f73-9c3d-4666-b7dd-6e5c02780f5e" returned: 0 in 0.340s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:01 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-ff33df6b-d214-4bee-b290-6eacec0acbae tempest-ProjectMemberTests-1544704132 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424.17d97f73-9c3d-4666-b7dd-6e5c02780f5e is being set with open permissions: ugo+rw
Nov 06 17:24:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ff33df6b-d214-4bee-b290-6eacec0acbae tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424.17d97f73-9c3d-4666-b7dd-6e5c02780f5e {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:01 devstack sudo[105808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424.17d97f73-9c3d-4666-b7dd-6e5c02780f5e
Nov 06 17:24:01 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:01 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9485a9fd-3c69-4ff9-a52e-cfa6b63692e3 tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-f65ec983-481b-47d8-9629-eefd3528d225" returned: 0 in 0.292s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:01 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9485a9fd-3c69-4ff9-a52e-cfa6b63692e3 tempest-ProjectReaderTests-1615857228 None] Lock "cinder-quobyte-f65ec983-481b-47d8-9629-eefd3528d225" released by "delete_volume" :: held 0.839s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:01 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-9485a9fd-3c69-4ff9-a52e-cfa6b63692e3 tempest-ProjectReaderTests-1615857228 None] Created reservations ['89e7840a-e86b-4336-957c-6cb5a2e0012b', '7385ba7c-aee6-431b-b576-8f246be1d520', 'c44435d1-053a-43ec-bdc2-c8a9a5b6aa46', 'f18eb89b-c771-4168-9749-de041930ccf7'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:24:01 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ff33df6b-d214-4bee-b290-6eacec0acbae tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424.17d97f73-9c3d-4666-b7dd-6e5c02780f5e" returned: 0 in 0.280s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9485a9fd-3c69-4ff9-a52e-cfa6b63692e3 tempest-ProjectReaderTests-1615857228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:24:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9485a9fd-3c69-4ff9-a52e-cfa6b63692e3 tempest-ProjectReaderTests-1615857228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:24:01 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-9485a9fd-3c69-4ff9-a52e-cfa6b63692e3 tempest-ProjectReaderTests-1615857228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:24:01 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-9485a9fd-3c69-4ff9-a52e-cfa6b63692e3 tempest-ProjectReaderTests-1615857228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:24:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-9485a9fd-3c69-4ff9-a52e-cfa6b63692e3 tempest-ProjectReaderTests-1615857228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:24:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9485a9fd-3c69-4ff9-a52e-cfa6b63692e3 tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:01 devstack sudo[105812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:24:01 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ff33df6b-d214-4bee-b290-6eacec0acbae tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:01 devstack sudo[105814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424.info
Nov 06 17:24:01 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:01 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-9485a9fd-3c69-4ff9-a52e-cfa6b63692e3 tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.297s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:01 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-9485a9fd-3c69-4ff9-a52e-cfa6b63692e3 tempest-ProjectReaderTests-1615857228 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:24:01 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-9485a9fd-3c69-4ff9-a52e-cfa6b63692e3 tempest-ProjectReaderTests-1615857228 None] Deleted volume successfully.
Nov 06 17:24:01 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-9485a9fd-3c69-4ff9-a52e-cfa6b63692e3 tempest-ProjectReaderTests-1615857228 None] Lock "cinder-f65ec983-481b-47d8-9629-eefd3528d225-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:02 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ff33df6b-d214-4bee-b290-6eacec0acbae tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424.info" returned: 0 in 0.380s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:02 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-ff33df6b-d214-4bee-b290-6eacec0acbae tempest-ProjectMemberTests-1544704132 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424.info is being set with open permissions: ugo+rw
Nov 06 17:24:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ff33df6b-d214-4bee-b290-6eacec0acbae tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:02 devstack sudo[105819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424.info
Nov 06 17:24:02 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:02 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-d94adb24-196a-428c-a4b3-132e2f38aeb1 tempest-ProjectReaderTests-1615857228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:24:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d94adb24-196a-428c-a4b3-132e2f38aeb1 tempest-ProjectReaderTests-1615857228 None] Flow 'volume_create_manager' (ed2bea4a-56e1-4a0d-a35e-6e43d7f68006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:24:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d94adb24-196a-428c-a4b3-132e2f38aeb1 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (034cdb23-c4fd-4749-8a9f-e8d96f9f35db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d94adb24-196a-428c-a4b3-132e2f38aeb1 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (034cdb23-c4fd-4749-8a9f-e8d96f9f35db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1748438561',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f8d3170-62e8-4191-90ba-76a531af2dfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e765fbd33c2345449278669b7fd8c195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:24:02Z,use_quota=True,user_id='b7b89c3c77ff44f4adddd9248571825a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d94adb24-196a-428c-a4b3-132e2f38aeb1 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e08d040d-06e1-4336-ab74-f6dd0cdb486a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d94adb24-196a-428c-a4b3-132e2f38aeb1 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e08d040d-06e1-4336-ab74-f6dd0cdb486a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d94adb24-196a-428c-a4b3-132e2f38aeb1 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aa6179a-3036-48ef-835e-2ead16006cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d94adb24-196a-428c-a4b3-132e2f38aeb1 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aa6179a-3036-48ef-835e-2ead16006cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f8d3170-62e8-4191-90ba-76a531af2dfa', 'volume_name': 'volume-7f8d3170-62e8-4191-90ba-76a531af2dfa', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d94adb24-196a-428c-a4b3-132e2f38aeb1 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2645015b-508d-4ee9-b2cc-1b47ddc7df5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d94adb24-196a-428c-a4b3-132e2f38aeb1 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2645015b-508d-4ee9-b2cc-1b47ddc7df5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:02 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d94adb24-196a-428c-a4b3-132e2f38aeb1 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2890a78-21c0-478d-9b74-c59b611c899d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:02 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-d94adb24-196a-428c-a4b3-132e2f38aeb1 tempest-ProjectReaderTests-1615857228 None] Volume 7f8d3170-62e8-4191-90ba-76a531af2dfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f8d3170-62e8-4191-90ba-76a531af2dfa', 'volume_size': 1}
Nov 06 17:24:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d94adb24-196a-428c-a4b3-132e2f38aeb1 tempest-ProjectReaderTests-1615857228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:24:02 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ff33df6b-d214-4bee-b290-6eacec0acbae tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424.info" returned: 0 in 0.282s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ff33df6b-d214-4bee-b290-6eacec0acbae tempest-ProjectMemberTests-1544704132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.404s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:24:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d94adb24-196a-428c-a4b3-132e2f38aeb1 tempest-ProjectReaderTests-1615857228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.022s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:24:02 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d94adb24-196a-428c-a4b3-132e2f38aeb1 tempest-ProjectReaderTests-1615857228 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1748438561',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f8d3170-62e8-4191-90ba-76a531af2dfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e765fbd33c2345449278669b7fd8c195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:24:02Z,use_quota=True,user_id='b7b89c3c77ff44f4adddd9248571825a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:24:02 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-d94adb24-196a-428c-a4b3-132e2f38aeb1 tempest-ProjectReaderTests-1615857228 None] Creating volume 7f8d3170-62e8-4191-90ba-76a531af2dfa {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:24:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d94adb24-196a-428c-a4b3-132e2f38aeb1 tempest-ProjectReaderTests-1615857228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:24:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d94adb24-196a-428c-a4b3-132e2f38aeb1 tempest-ProjectReaderTests-1615857228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:24:02 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d94adb24-196a-428c-a4b3-132e2f38aeb1 tempest-ProjectReaderTests-1615857228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:24:02 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d94adb24-196a-428c-a4b3-132e2f38aeb1 tempest-ProjectReaderTests-1615857228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:24:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d94adb24-196a-428c-a4b3-132e2f38aeb1 tempest-ProjectReaderTests-1615857228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:24:02 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d94adb24-196a-428c-a4b3-132e2f38aeb1 tempest-ProjectReaderTests-1615857228 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:24:02 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-d94adb24-196a-428c-a4b3-132e2f38aeb1 tempest-ProjectReaderTests-1615857228 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:24:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d94adb24-196a-428c-a4b3-132e2f38aeb1 tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:02 devstack sudo[105822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa 1073741824
Nov 06 17:24:02 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:02 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-ff33df6b-d214-4bee-b290-6eacec0acbae tempest-ProjectMemberTests-1544704132 None] Create snapshot completed successfully
Nov 06 17:24:02 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d94adb24-196a-428c-a4b3-132e2f38aeb1 tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa 1073741824" returned: 0 in 0.416s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d94adb24-196a-428c-a4b3-132e2f38aeb1 tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:02 devstack sudo[105827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa
Nov 06 17:24:02 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:03 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-d94adb24-196a-428c-a4b3-132e2f38aeb1 tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa" returned: 0 in 0.243s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:03 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-d94adb24-196a-428c-a4b3-132e2f38aeb1 tempest-ProjectReaderTests-1615857228 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:24:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-d94adb24-196a-428c-a4b3-132e2f38aeb1 tempest-ProjectReaderTests-1615857228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:24:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d94adb24-196a-428c-a4b3-132e2f38aeb1 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2890a78-21c0-478d-9b74-c59b611c899d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f8d3170-62e8-4191-90ba-76a531af2dfa', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d94adb24-196a-428c-a4b3-132e2f38aeb1 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd799056-f5be-4f16-b064-9f40313cd25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:03 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-d94adb24-196a-428c-a4b3-132e2f38aeb1 tempest-ProjectReaderTests-1615857228 None] Volume volume-7f8d3170-62e8-4191-90ba-76a531af2dfa (7f8d3170-62e8-4191-90ba-76a531af2dfa): created successfully
Nov 06 17:24:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d94adb24-196a-428c-a4b3-132e2f38aeb1 tempest-ProjectReaderTests-1615857228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd799056-f5be-4f16-b064-9f40313cd25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:03 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-d94adb24-196a-428c-a4b3-132e2f38aeb1 tempest-ProjectReaderTests-1615857228 None] Flow 'volume_create_manager' (ed2bea4a-56e1-4a0d-a35e-6e43d7f68006) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:24:03 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ea26d8e1-2d3e-4c81-a15c-9c2ccc4760df tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-17d97f73-9c3d-4666-b7dd-6e5c02780f5e-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:03 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-d94adb24-196a-428c-a4b3-132e2f38aeb1 tempest-ProjectReaderTests-1615857228 None] Created volume successfully.
Nov 06 17:24:03 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ea26d8e1-2d3e-4c81-a15c-9c2ccc4760df tempest-ProjectMemberTests-1544704132 None] Lock "cinder-17d97f73-9c3d-4666-b7dd-6e5c02780f5e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:03 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ea26d8e1-2d3e-4c81-a15c-9c2ccc4760df tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-quobyte-bcbf7c21-b202-47a2-bcca-bae5b7cf1424" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:03 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ea26d8e1-2d3e-4c81-a15c-9c2ccc4760df tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-bcbf7c21-b202-47a2-bcca-bae5b7cf1424" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:03 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ea26d8e1-2d3e-4c81-a15c-9c2ccc4760df tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-quobyte-17d97f73-9c3d-4666-b7dd-6e5c02780f5e" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:03 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ea26d8e1-2d3e-4c81-a15c-9c2ccc4760df tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-17d97f73-9c3d-4666-b7dd-6e5c02780f5e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:03 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-ea26d8e1-2d3e-4c81-a15c-9c2ccc4760df tempest-ProjectMemberTests-1544704132 None] Deleting offline snapshot 17d97f73-9c3d-4666-b7dd-6e5c02780f5e of volume bcbf7c21-b202-47a2-bcca-bae5b7cf1424 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:24:03 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-ea26d8e1-2d3e-4c81-a15c-9c2ccc4760df tempest-ProjectMemberTests-1544704132 None] snapshot_file for this snap is: volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424.17d97f73-9c3d-4666-b7dd-6e5c02780f5e {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:24:03 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7611ea-4a00-4659-98ec-62b5c0a64c4e]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:24:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ea26d8e1-2d3e-4c81-a15c-9c2ccc4760df tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424.17d97f73-9c3d-4666-b7dd-6e5c02780f5e {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:03 devstack sudo[105830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424.17d97f73-9c3d-4666-b7dd-6e5c02780f5e
Nov 06 17:24:03 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-268039ea-c6d0-4898-8ed1-c7b487c9c699 tempest-ProjectReaderTests-1615857228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:24:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-268039ea-c6d0-4898-8ed1-c7b487c9c699 tempest-ProjectReaderTests-1615857228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:24:03 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-268039ea-c6d0-4898-8ed1-c7b487c9c699 tempest-ProjectReaderTests-1615857228 None] Creating offline snapshot 8fdeb66a-f39a-44a3-a348-2353af5bea0f of volume 7f8d3170-62e8-4191-90ba-76a531af2dfa {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:24:03 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bba7eee-9467-41f2-ae3e-b0aa3eb31052]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:24:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-268039ea-c6d0-4898-8ed1-c7b487c9c699 tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:03 devstack sudo[105832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa
Nov 06 17:24:03 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:03 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ea26d8e1-2d3e-4c81-a15c-9c2ccc4760df tempest-ProjectMemberTests-1544704132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424.17d97f73-9c3d-4666-b7dd-6e5c02780f5e" returned: 0 in 0.379s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:03 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-ea26d8e1-2d3e-4c81-a15c-9c2ccc4760df tempest-ProjectMemberTests-1544704132 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:24:03 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c8bc87-0990-42ba-9f48-2174d8c1c98c]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:24:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ea26d8e1-2d3e-4c81-a15c-9c2ccc4760df tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:03 devstack sudo[105837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424
Nov 06 17:24:03 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:03 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-268039ea-c6d0-4898-8ed1-c7b487c9c699 tempest-ProjectReaderTests-1615857228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa" returned: 0 in 0.374s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-268039ea-c6d0-4898-8ed1-c7b487c9c699 tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa.8fdeb66a-f39a-44a3-a348-2353af5bea0f 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:03 devstack sudo[105842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa.8fdeb66a-f39a-44a3-a348-2353af5bea0f 1G
Nov 06 17:24:03 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:03 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ea26d8e1-2d3e-4c81-a15c-9c2ccc4760df tempest-ProjectMemberTests-1544704132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424" returned: 0 in 0.388s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ea26d8e1-2d3e-4c81-a15c-9c2ccc4760df tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424.17d97f73-9c3d-4666-b7dd-6e5c02780f5e {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:04 devstack sudo[105847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424.17d97f73-9c3d-4666-b7dd-6e5c02780f5e
Nov 06 17:24:04 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:04 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-268039ea-c6d0-4898-8ed1-c7b487c9c699 tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa.8fdeb66a-f39a-44a3-a348-2353af5bea0f 1G" returned: 0 in 0.438s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-268039ea-c6d0-4898-8ed1-c7b487c9c699 tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f8d3170-62e8-4191-90ba-76a531af2dfa -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa.8fdeb66a-f39a-44a3-a348-2353af5bea0f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:04 devstack sudo[105856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f8d3170-62e8-4191-90ba-76a531af2dfa -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa.8fdeb66a-f39a-44a3-a348-2353af5bea0f
Nov 06 17:24:04 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:04 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ea26d8e1-2d3e-4c81-a15c-9c2ccc4760df tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424.17d97f73-9c3d-4666-b7dd-6e5c02780f5e" returned: 0 in 0.352s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ea26d8e1-2d3e-4c81-a15c-9c2ccc4760df tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424.17d97f73-9c3d-4666-b7dd-6e5c02780f5e {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:04 devstack sudo[105858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424.17d97f73-9c3d-4666-b7dd-6e5c02780f5e
Nov 06 17:24:04 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:04 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-268039ea-c6d0-4898-8ed1-c7b487c9c699 tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f8d3170-62e8-4191-90ba-76a531af2dfa -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa.8fdeb66a-f39a-44a3-a348-2353af5bea0f" returned: 0 in 0.293s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:04 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-268039ea-c6d0-4898-8ed1-c7b487c9c699 tempest-ProjectReaderTests-1615857228 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa.8fdeb66a-f39a-44a3-a348-2353af5bea0f is being set with open permissions: ugo+rw
Nov 06 17:24:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-268039ea-c6d0-4898-8ed1-c7b487c9c699 tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa.8fdeb66a-f39a-44a3-a348-2353af5bea0f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:04 devstack sudo[105864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa.8fdeb66a-f39a-44a3-a348-2353af5bea0f
Nov 06 17:24:04 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:04 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ea26d8e1-2d3e-4c81-a15c-9c2ccc4760df tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424.17d97f73-9c3d-4666-b7dd-6e5c02780f5e" returned: 0 in 0.264s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:04 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ea26d8e1-2d3e-4c81-a15c-9c2ccc4760df tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-17d97f73-9c3d-4666-b7dd-6e5c02780f5e" released by "_delete_snapshot" :: held 1.502s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:04 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ea26d8e1-2d3e-4c81-a15c-9c2ccc4760df tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-bcbf7c21-b202-47a2-bcca-bae5b7cf1424" released by "delete_snapshot" :: held 1.524s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:04 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-ea26d8e1-2d3e-4c81-a15c-9c2ccc4760df tempest-ProjectMemberTests-1544704132 None] Created reservations ['b4f2ad4f-e85f-4fb5-a813-730af38b9823', 'c724895e-dee4-4148-b9be-b1609fe187b2', 'e57ed1bd-745e-4ceb-8d1b-995202508967', '1b1d31a6-2ef9-488b-9b39-361ff768afc9'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:24:04 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-ea26d8e1-2d3e-4c81-a15c-9c2ccc4760df tempest-ProjectMemberTests-1544704132 None] Delete snapshot completed successfully.
Nov 06 17:24:04 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ea26d8e1-2d3e-4c81-a15c-9c2ccc4760df tempest-ProjectMemberTests-1544704132 None] Lock "cinder-17d97f73-9c3d-4666-b7dd-6e5c02780f5e-delete_snapshot" released by "delete_snapshot" :: held 1.653s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:04 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-268039ea-c6d0-4898-8ed1-c7b487c9c699 tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa.8fdeb66a-f39a-44a3-a348-2353af5bea0f" returned: 0 in 0.248s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-268039ea-c6d0-4898-8ed1-c7b487c9c699 tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:04 devstack sudo[105867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa.info
Nov 06 17:24:04 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:05 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-268039ea-c6d0-4898-8ed1-c7b487c9c699 tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa.info" returned: 0 in 0.254s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:05 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-268039ea-c6d0-4898-8ed1-c7b487c9c699 tempest-ProjectReaderTests-1615857228 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa.info is being set with open permissions: ugo+rw
Nov 06 17:24:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-268039ea-c6d0-4898-8ed1-c7b487c9c699 tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:05 devstack sudo[105870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa.info
Nov 06 17:24:05 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:05 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-360a42bf-97f7-4fbb-8303-a2d22eea63b2 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-bcbf7c21-b202-47a2-bcca-bae5b7cf1424-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:05 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-360a42bf-97f7-4fbb-8303-a2d22eea63b2 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-bcbf7c21-b202-47a2-bcca-bae5b7cf1424-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:05 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-360a42bf-97f7-4fbb-8303-a2d22eea63b2 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-quobyte-bcbf7c21-b202-47a2-bcca-bae5b7cf1424" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:05 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-268039ea-c6d0-4898-8ed1-c7b487c9c699 tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa.info" returned: 0 in 0.253s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-268039ea-c6d0-4898-8ed1-c7b487c9c699 tempest-ProjectReaderTests-1615857228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.941s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:24:05 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-360a42bf-97f7-4fbb-8303-a2d22eea63b2 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-bcbf7c21-b202-47a2-bcca-bae5b7cf1424" acquired by "delete_volume" :: waited 0.035s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:05 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f655d2b-5f90-4982-ae57-acfc0e2f4e60]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:24:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-360a42bf-97f7-4fbb-8303-a2d22eea63b2 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:05 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-268039ea-c6d0-4898-8ed1-c7b487c9c699 tempest-ProjectReaderTests-1615857228 None] Create snapshot completed successfully
Nov 06 17:24:05 devstack sudo[105873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424
Nov 06 17:24:05 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:05 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1c831d10-f494-449c-baed-25d46724b90d tempest-ProjectReaderTests-1615857228 None] Acquiring lock "cinder-8fdeb66a-f39a-44a3-a348-2353af5bea0f-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:05 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1c831d10-f494-449c-baed-25d46724b90d tempest-ProjectReaderTests-1615857228 None] Lock "cinder-8fdeb66a-f39a-44a3-a348-2353af5bea0f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:05 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1c831d10-f494-449c-baed-25d46724b90d tempest-ProjectReaderTests-1615857228 None] Acquiring lock "cinder-quobyte-7f8d3170-62e8-4191-90ba-76a531af2dfa" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:05 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1c831d10-f494-449c-baed-25d46724b90d tempest-ProjectReaderTests-1615857228 None] Lock "cinder-quobyte-7f8d3170-62e8-4191-90ba-76a531af2dfa" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:05 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1c831d10-f494-449c-baed-25d46724b90d tempest-ProjectReaderTests-1615857228 None] Acquiring lock "cinder-quobyte-8fdeb66a-f39a-44a3-a348-2353af5bea0f" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:05 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1c831d10-f494-449c-baed-25d46724b90d tempest-ProjectReaderTests-1615857228 None] Lock "cinder-quobyte-8fdeb66a-f39a-44a3-a348-2353af5bea0f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:05 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-1c831d10-f494-449c-baed-25d46724b90d tempest-ProjectReaderTests-1615857228 None] Deleting offline snapshot 8fdeb66a-f39a-44a3-a348-2353af5bea0f of volume 7f8d3170-62e8-4191-90ba-76a531af2dfa {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:24:05 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-1c831d10-f494-449c-baed-25d46724b90d tempest-ProjectReaderTests-1615857228 None] snapshot_file for this snap is: volume-7f8d3170-62e8-4191-90ba-76a531af2dfa.8fdeb66a-f39a-44a3-a348-2353af5bea0f {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:24:05 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd0209f-26f4-400b-afbf-aee200a79910]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:24:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1c831d10-f494-449c-baed-25d46724b90d tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa.8fdeb66a-f39a-44a3-a348-2353af5bea0f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:05 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-360a42bf-97f7-4fbb-8303-a2d22eea63b2 tempest-ProjectMemberTests-1544704132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424" returned: 0 in 0.395s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:05 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-360a42bf-97f7-4fbb-8303-a2d22eea63b2 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:05 devstack sudo[105875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa.8fdeb66a-f39a-44a3-a348-2353af5bea0f
Nov 06 17:24:05 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:05 devstack sudo[105879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424
Nov 06 17:24:05 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:06 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-360a42bf-97f7-4fbb-8303-a2d22eea63b2 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bcbf7c21-b202-47a2-bcca-bae5b7cf1424" returned: 0 in 0.243s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:06 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-360a42bf-97f7-4fbb-8303-a2d22eea63b2 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-bcbf7c21-b202-47a2-bcca-bae5b7cf1424" released by "delete_volume" :: held 0.708s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1c831d10-f494-449c-baed-25d46724b90d tempest-ProjectReaderTests-1615857228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa.8fdeb66a-f39a-44a3-a348-2353af5bea0f" returned: 0 in 0.372s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-1c831d10-f494-449c-baed-25d46724b90d tempest-ProjectReaderTests-1615857228 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f8d3170-62e8-4191-90ba-76a531af2dfa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[953a5a5e-0e52-4dc5-b400-96f510eced82]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1c831d10-f494-449c-baed-25d46724b90d tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-360a42bf-97f7-4fbb-8303-a2d22eea63b2 tempest-ProjectMemberTests-1544704132 None] Created reservations ['fceda314-1fd9-4739-8c78-26d5829ce067', 'f9279347-b103-4c90-accf-3d792cef69e7', 'b512b36e-d3c9-4792-9749-469ed48a89e1', '9f56a3ed-067a-452e-952a-6041d7e83a12'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-360a42bf-97f7-4fbb-8303-a2d22eea63b2 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-360a42bf-97f7-4fbb-8303-a2d22eea63b2 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-360a42bf-97f7-4fbb-8303-a2d22eea63b2 tempest-ProjectMemberTests-1544704132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:24:06 devstack sudo[105886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa
Nov 06 17:24:06 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-360a42bf-97f7-4fbb-8303-a2d22eea63b2 tempest-ProjectMemberTests-1544704132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-360a42bf-97f7-4fbb-8303-a2d22eea63b2 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-360a42bf-97f7-4fbb-8303-a2d22eea63b2 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:06 devstack sudo[105888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:24:06 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:06 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-360a42bf-97f7-4fbb-8303-a2d22eea63b2 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.270s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-360a42bf-97f7-4fbb-8303-a2d22eea63b2 tempest-ProjectMemberTests-1544704132 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:24:06 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1c831d10-f494-449c-baed-25d46724b90d tempest-ProjectReaderTests-1615857228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa" returned: 0 in 0.403s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1c831d10-f494-449c-baed-25d46724b90d tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa.8fdeb66a-f39a-44a3-a348-2353af5bea0f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:06 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-360a42bf-97f7-4fbb-8303-a2d22eea63b2 tempest-ProjectMemberTests-1544704132 None] Deleted volume successfully.
Nov 06 17:24:06 devstack sudo[105894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa.8fdeb66a-f39a-44a3-a348-2353af5bea0f
Nov 06 17:24:06 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-360a42bf-97f7-4fbb-8303-a2d22eea63b2 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-bcbf7c21-b202-47a2-bcca-bae5b7cf1424-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:06 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1c831d10-f494-449c-baed-25d46724b90d tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa.8fdeb66a-f39a-44a3-a348-2353af5bea0f" returned: 0 in 0.355s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1c831d10-f494-449c-baed-25d46724b90d tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa.8fdeb66a-f39a-44a3-a348-2353af5bea0f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:06 devstack sudo[105900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa.8fdeb66a-f39a-44a3-a348-2353af5bea0f
Nov 06 17:24:06 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-e43edc50-c380-480b-8862-e9c8b1a9d824 tempest-ProjectMemberTests-1544704132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e43edc50-c380-480b-8862-e9c8b1a9d824 tempest-ProjectMemberTests-1544704132 None] Flow 'volume_create_manager' (86392cdc-ebad-4cac-b800-15a7c6d3c763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e43edc50-c380-480b-8862-e9c8b1a9d824 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (746ebc0c-31dc-4c1b-a64e-0ef05721ccb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e43edc50-c380-480b-8862-e9c8b1a9d824 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (746ebc0c-31dc-4c1b-a64e-0ef05721ccb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-222987776',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c367c83a-5135-4693-86f6-2ea156275ebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95db90b8146744d19b5f094536ef20c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:24:07Z,use_quota=True,user_id='b0a2c8c9eeea4d8e90c8a6fcb89970cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e43edc50-c380-480b-8862-e9c8b1a9d824 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d13efb9f-a9b7-4b50-ab27-6251db278330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e43edc50-c380-480b-8862-e9c8b1a9d824 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d13efb9f-a9b7-4b50-ab27-6251db278330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e43edc50-c380-480b-8862-e9c8b1a9d824 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a11f8c25-9310-4100-8047-d1028a79f15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e43edc50-c380-480b-8862-e9c8b1a9d824 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a11f8c25-9310-4100-8047-d1028a79f15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c367c83a-5135-4693-86f6-2ea156275ebc', 'volume_name': 'volume-c367c83a-5135-4693-86f6-2ea156275ebc', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e43edc50-c380-480b-8862-e9c8b1a9d824 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba09812f-6bc9-4431-8ac3-ff994ebac6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e43edc50-c380-480b-8862-e9c8b1a9d824 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba09812f-6bc9-4431-8ac3-ff994ebac6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e43edc50-c380-480b-8862-e9c8b1a9d824 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (705cfd26-7b3e-4e58-a008-46503e24d49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:06 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-e43edc50-c380-480b-8862-e9c8b1a9d824 tempest-ProjectMemberTests-1544704132 None] Volume c367c83a-5135-4693-86f6-2ea156275ebc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c367c83a-5135-4693-86f6-2ea156275ebc', 'volume_size': 1}
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e43edc50-c380-480b-8862-e9c8b1a9d824 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e43edc50-c380-480b-8862-e9c8b1a9d824 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e43edc50-c380-480b-8862-e9c8b1a9d824 tempest-ProjectMemberTests-1544704132 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-222987776',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c367c83a-5135-4693-86f6-2ea156275ebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95db90b8146744d19b5f094536ef20c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:24:07Z,use_quota=True,user_id='b0a2c8c9eeea4d8e90c8a6fcb89970cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-e43edc50-c380-480b-8862-e9c8b1a9d824 tempest-ProjectMemberTests-1544704132 None] Creating volume c367c83a-5135-4693-86f6-2ea156275ebc {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e43edc50-c380-480b-8862-e9c8b1a9d824 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e43edc50-c380-480b-8862-e9c8b1a9d824 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e43edc50-c380-480b-8862-e9c8b1a9d824 tempest-ProjectMemberTests-1544704132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e43edc50-c380-480b-8862-e9c8b1a9d824 tempest-ProjectMemberTests-1544704132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e43edc50-c380-480b-8862-e9c8b1a9d824 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e43edc50-c380-480b-8862-e9c8b1a9d824 tempest-ProjectMemberTests-1544704132 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:24:06 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-e43edc50-c380-480b-8862-e9c8b1a9d824 tempest-ProjectMemberTests-1544704132 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:24:06 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e43edc50-c380-480b-8862-e9c8b1a9d824 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:07 devstack sudo[105902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc 1073741824
Nov 06 17:24:07 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:07 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-1c831d10-f494-449c-baed-25d46724b90d tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa.8fdeb66a-f39a-44a3-a348-2353af5bea0f" returned: 0 in 0.245s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:07 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1c831d10-f494-449c-baed-25d46724b90d tempest-ProjectReaderTests-1615857228 None] Lock "cinder-quobyte-8fdeb66a-f39a-44a3-a348-2353af5bea0f" released by "_delete_snapshot" :: held 1.489s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:07 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1c831d10-f494-449c-baed-25d46724b90d tempest-ProjectReaderTests-1615857228 None] Lock "cinder-quobyte-7f8d3170-62e8-4191-90ba-76a531af2dfa" released by "delete_snapshot" :: held 1.510s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:07 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-1c831d10-f494-449c-baed-25d46724b90d tempest-ProjectReaderTests-1615857228 None] Created reservations ['4d3c007d-9b78-406c-b779-86a9e9b8acb0', 'bfcd8e22-f351-4d48-8aba-8e8663a9be37', 'e4ed195c-7e3c-4f85-8a09-8966a56ff807', '547ed0e7-9d40-492b-8fbe-7d2451276585'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:24:07 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-1c831d10-f494-449c-baed-25d46724b90d tempest-ProjectReaderTests-1615857228 None] Delete snapshot completed successfully.
Nov 06 17:24:07 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-1c831d10-f494-449c-baed-25d46724b90d tempest-ProjectReaderTests-1615857228 None] Lock "cinder-8fdeb66a-f39a-44a3-a348-2353af5bea0f-delete_snapshot" released by "delete_snapshot" :: held 1.653s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:07 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e43edc50-c380-480b-8862-e9c8b1a9d824 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc 1073741824" returned: 0 in 0.421s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e43edc50-c380-480b-8862-e9c8b1a9d824 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:07 devstack sudo[105909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc
Nov 06 17:24:07 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:07 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e43edc50-c380-480b-8862-e9c8b1a9d824 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc" returned: 0 in 0.252s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:07 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e43edc50-c380-480b-8862-e9c8b1a9d824 tempest-ProjectMemberTests-1544704132 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:24:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e43edc50-c380-480b-8862-e9c8b1a9d824 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:24:07 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e43edc50-c380-480b-8862-e9c8b1a9d824 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (705cfd26-7b3e-4e58-a008-46503e24d49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c367c83a-5135-4693-86f6-2ea156275ebc', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:07 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e43edc50-c380-480b-8862-e9c8b1a9d824 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f834dc4-4500-48f9-b09d-d85f65ca856f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:07 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-e43edc50-c380-480b-8862-e9c8b1a9d824 tempest-ProjectMemberTests-1544704132 None] Volume volume-c367c83a-5135-4693-86f6-2ea156275ebc (c367c83a-5135-4693-86f6-2ea156275ebc): created successfully
Nov 06 17:24:07 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e43edc50-c380-480b-8862-e9c8b1a9d824 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f834dc4-4500-48f9-b09d-d85f65ca856f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:07 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-e43edc50-c380-480b-8862-e9c8b1a9d824 tempest-ProjectMemberTests-1544704132 None] Flow 'volume_create_manager' (86392cdc-ebad-4cac-b800-15a7c6d3c763) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:24:07 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e2db25ef-bae8-43a6-9e7d-4f4dbcb8b1c9 tempest-ProjectReaderTests-1615857228 None] Acquiring lock "cinder-7f8d3170-62e8-4191-90ba-76a531af2dfa-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:07 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-e43edc50-c380-480b-8862-e9c8b1a9d824 tempest-ProjectMemberTests-1544704132 None] Created volume successfully.
Nov 06 17:24:07 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e2db25ef-bae8-43a6-9e7d-4f4dbcb8b1c9 tempest-ProjectReaderTests-1615857228 None] Lock "cinder-7f8d3170-62e8-4191-90ba-76a531af2dfa-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:07 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e2db25ef-bae8-43a6-9e7d-4f4dbcb8b1c9 tempest-ProjectReaderTests-1615857228 None] Acquiring lock "cinder-quobyte-7f8d3170-62e8-4191-90ba-76a531af2dfa" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:07 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e2db25ef-bae8-43a6-9e7d-4f4dbcb8b1c9 tempest-ProjectReaderTests-1615857228 None] Lock "cinder-quobyte-7f8d3170-62e8-4191-90ba-76a531af2dfa" acquired by "delete_volume" :: waited 0.015s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:07 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[43eb8bf9-3fe4-4e91-86d5-b23ac54d2cec]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:24:07 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e2db25ef-bae8-43a6-9e7d-4f4dbcb8b1c9 tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:07 devstack sudo[105912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa
Nov 06 17:24:07 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2d793c28-cd9a-4e30-8719-a6bc0ff260e5 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:24:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2d793c28-cd9a-4e30-8719-a6bc0ff260e5 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:24:08 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-2d793c28-cd9a-4e30-8719-a6bc0ff260e5 tempest-ProjectMemberTests-1544704132 None] Creating offline snapshot 0a159194-d261-42b7-a911-97bd1cde22a6 of volume c367c83a-5135-4693-86f6-2ea156275ebc {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:24:08 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1a46f4-03b3-47ad-baad-0374e54c9499]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:24:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2d793c28-cd9a-4e30-8719-a6bc0ff260e5 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:08 devstack sudo[105914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc
Nov 06 17:24:08 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:08 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e2db25ef-bae8-43a6-9e7d-4f4dbcb8b1c9 tempest-ProjectReaderTests-1615857228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa" returned: 0 in 0.378s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e2db25ef-bae8-43a6-9e7d-4f4dbcb8b1c9 tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:08 devstack sudo[105919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa
Nov 06 17:24:08 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:08 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:08 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e2db25ef-bae8-43a6-9e7d-4f4dbcb8b1c9 tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-7f8d3170-62e8-4191-90ba-76a531af2dfa" returned: 0 in 0.241s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2d793c28-cd9a-4e30-8719-a6bc0ff260e5 tempest-ProjectMemberTests-1544704132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc" returned: 0 in 0.380s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2d793c28-cd9a-4e30-8719-a6bc0ff260e5 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc.0a159194-d261-42b7-a911-97bd1cde22a6 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:08 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e2db25ef-bae8-43a6-9e7d-4f4dbcb8b1c9 tempest-ProjectReaderTests-1615857228 None] Lock "cinder-quobyte-7f8d3170-62e8-4191-90ba-76a531af2dfa" released by "delete_volume" :: held 0.694s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:08 devstack sudo[105925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc.0a159194-d261-42b7-a911-97bd1cde22a6 1G
Nov 06 17:24:08 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:08 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-e2db25ef-bae8-43a6-9e7d-4f4dbcb8b1c9 tempest-ProjectReaderTests-1615857228 None] Created reservations ['7d2f4173-d737-4a0b-b8cf-2535b2ec0c4f', 'b0acef60-3ad2-469d-9b68-21399623aac5', 'ba0f8e0c-ee63-4f39-b0ff-2d0665112acd', 'cac41c60-a473-45c9-bd8f-65ac913dd7f2'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:24:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e2db25ef-bae8-43a6-9e7d-4f4dbcb8b1c9 tempest-ProjectReaderTests-1615857228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:24:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e2db25ef-bae8-43a6-9e7d-4f4dbcb8b1c9 tempest-ProjectReaderTests-1615857228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:24:08 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e2db25ef-bae8-43a6-9e7d-4f4dbcb8b1c9 tempest-ProjectReaderTests-1615857228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:24:08 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-e2db25ef-bae8-43a6-9e7d-4f4dbcb8b1c9 tempest-ProjectReaderTests-1615857228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:24:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e2db25ef-bae8-43a6-9e7d-4f4dbcb8b1c9 tempest-ProjectReaderTests-1615857228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:24:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e2db25ef-bae8-43a6-9e7d-4f4dbcb8b1c9 tempest-ProjectReaderTests-1615857228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:08 devstack sudo[105927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:24:08 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:08 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e2db25ef-bae8-43a6-9e7d-4f4dbcb8b1c9 tempest-ProjectReaderTests-1615857228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.260s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:08 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-e2db25ef-bae8-43a6-9e7d-4f4dbcb8b1c9 tempest-ProjectReaderTests-1615857228 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:24:08 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-e2db25ef-bae8-43a6-9e7d-4f4dbcb8b1c9 tempest-ProjectReaderTests-1615857228 None] Deleted volume successfully.
Nov 06 17:24:08 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-e2db25ef-bae8-43a6-9e7d-4f4dbcb8b1c9 tempest-ProjectReaderTests-1615857228 None] Lock "cinder-7f8d3170-62e8-4191-90ba-76a531af2dfa-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:08 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2d793c28-cd9a-4e30-8719-a6bc0ff260e5 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc.0a159194-d261-42b7-a911-97bd1cde22a6 1G" returned: 0 in 0.441s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:08 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2d793c28-cd9a-4e30-8719-a6bc0ff260e5 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c367c83a-5135-4693-86f6-2ea156275ebc -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc.0a159194-d261-42b7-a911-97bd1cde22a6 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:08 devstack sudo[105934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c367c83a-5135-4693-86f6-2ea156275ebc -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc.0a159194-d261-42b7-a911-97bd1cde22a6
Nov 06 17:24:08 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:09 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2d793c28-cd9a-4e30-8719-a6bc0ff260e5 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c367c83a-5135-4693-86f6-2ea156275ebc -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc.0a159194-d261-42b7-a911-97bd1cde22a6" returned: 0 in 0.330s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:09 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-2d793c28-cd9a-4e30-8719-a6bc0ff260e5 tempest-ProjectMemberTests-1544704132 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc.0a159194-d261-42b7-a911-97bd1cde22a6 is being set with open permissions: ugo+rw
Nov 06 17:24:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2d793c28-cd9a-4e30-8719-a6bc0ff260e5 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc.0a159194-d261-42b7-a911-97bd1cde22a6 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:09 devstack sudo[105939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc.0a159194-d261-42b7-a911-97bd1cde22a6
Nov 06 17:24:09 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:09 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2d793c28-cd9a-4e30-8719-a6bc0ff260e5 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc.0a159194-d261-42b7-a911-97bd1cde22a6" returned: 0 in 0.244s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2d793c28-cd9a-4e30-8719-a6bc0ff260e5 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:09 devstack sudo[105942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc.info
Nov 06 17:24:09 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:09 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2d793c28-cd9a-4e30-8719-a6bc0ff260e5 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc.info" returned: 0 in 0.267s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:09 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-2d793c28-cd9a-4e30-8719-a6bc0ff260e5 tempest-ProjectMemberTests-1544704132 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc.info is being set with open permissions: ugo+rw
Nov 06 17:24:09 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2d793c28-cd9a-4e30-8719-a6bc0ff260e5 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:09 devstack sudo[105945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc.info
Nov 06 17:24:09 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:10 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-2d793c28-cd9a-4e30-8719-a6bc0ff260e5 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc.info" returned: 0 in 0.310s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:10 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-2d793c28-cd9a-4e30-8719-a6bc0ff260e5 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.070s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:24:10 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-2d793c28-cd9a-4e30-8719-a6bc0ff260e5 tempest-ProjectMemberTests-1544704132 None] Create snapshot completed successfully
Nov 06 17:24:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-afadc4d7-1edd-4303-ae97-c5d32cecfe50 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-0a159194-d261-42b7-a911-97bd1cde22a6-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-afadc4d7-1edd-4303-ae97-c5d32cecfe50 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-0a159194-d261-42b7-a911-97bd1cde22a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-afadc4d7-1edd-4303-ae97-c5d32cecfe50 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-quobyte-c367c83a-5135-4693-86f6-2ea156275ebc" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-afadc4d7-1edd-4303-ae97-c5d32cecfe50 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-c367c83a-5135-4693-86f6-2ea156275ebc" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-afadc4d7-1edd-4303-ae97-c5d32cecfe50 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-quobyte-0a159194-d261-42b7-a911-97bd1cde22a6" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:11 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-afadc4d7-1edd-4303-ae97-c5d32cecfe50 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-0a159194-d261-42b7-a911-97bd1cde22a6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:11 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-afadc4d7-1edd-4303-ae97-c5d32cecfe50 tempest-ProjectMemberTests-1544704132 None] Deleting offline snapshot 0a159194-d261-42b7-a911-97bd1cde22a6 of volume c367c83a-5135-4693-86f6-2ea156275ebc {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:24:11 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-afadc4d7-1edd-4303-ae97-c5d32cecfe50 tempest-ProjectMemberTests-1544704132 None] snapshot_file for this snap is: volume-c367c83a-5135-4693-86f6-2ea156275ebc.0a159194-d261-42b7-a911-97bd1cde22a6 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:24:11 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2680c6-5d26-4417-9e98-174c7a21221c]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:24:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-afadc4d7-1edd-4303-ae97-c5d32cecfe50 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc.0a159194-d261-42b7-a911-97bd1cde22a6 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:11 devstack sudo[105949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc.0a159194-d261-42b7-a911-97bd1cde22a6
Nov 06 17:24:11 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:11 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-afadc4d7-1edd-4303-ae97-c5d32cecfe50 tempest-ProjectMemberTests-1544704132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc.0a159194-d261-42b7-a911-97bd1cde22a6" returned: 0 in 0.426s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:11 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-afadc4d7-1edd-4303-ae97-c5d32cecfe50 tempest-ProjectMemberTests-1544704132 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c367c83a-5135-4693-86f6-2ea156275ebc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:24:11 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7820f5f-c31f-4b23-85c0-b4589cba15a4]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:24:11 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-afadc4d7-1edd-4303-ae97-c5d32cecfe50 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:11 devstack sudo[105955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc
Nov 06 17:24:11 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:12 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-afadc4d7-1edd-4303-ae97-c5d32cecfe50 tempest-ProjectMemberTests-1544704132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc" returned: 0 in 0.377s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-afadc4d7-1edd-4303-ae97-c5d32cecfe50 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc.0a159194-d261-42b7-a911-97bd1cde22a6 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:12 devstack sudo[105960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc.0a159194-d261-42b7-a911-97bd1cde22a6
Nov 06 17:24:12 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:12 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-afadc4d7-1edd-4303-ae97-c5d32cecfe50 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc.0a159194-d261-42b7-a911-97bd1cde22a6" returned: 0 in 0.394s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-afadc4d7-1edd-4303-ae97-c5d32cecfe50 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc.0a159194-d261-42b7-a911-97bd1cde22a6 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:12 devstack sudo[105966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc.0a159194-d261-42b7-a911-97bd1cde22a6
Nov 06 17:24:12 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:12 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:12 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-afadc4d7-1edd-4303-ae97-c5d32cecfe50 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc.0a159194-d261-42b7-a911-97bd1cde22a6" returned: 0 in 0.266s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:12 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=179,cinder:DELETE=17,cinder:INSERT=60,cinder:UPDATE=248 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:24:12 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=184,cinder:INSERT=64,cinder:UPDATE=222,cinder:DELETE=23 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:24:12 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-afadc4d7-1edd-4303-ae97-c5d32cecfe50 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-0a159194-d261-42b7-a911-97bd1cde22a6" released by "_delete_snapshot" :: held 1.601s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:12 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-afadc4d7-1edd-4303-ae97-c5d32cecfe50 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-c367c83a-5135-4693-86f6-2ea156275ebc" released by "delete_snapshot" :: held 1.636s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:12 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-afadc4d7-1edd-4303-ae97-c5d32cecfe50 tempest-ProjectMemberTests-1544704132 None] Created reservations ['0dbf14ab-9208-44c4-a52e-f74762a3edb4', 'd4ca0273-9b1d-4830-b935-95a8d2344022', '0b09ea44-347c-41f6-a633-c88901d02383', 'e8730c2e-cac1-467b-af82-5032d96a13e6'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:24:13 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-afadc4d7-1edd-4303-ae97-c5d32cecfe50 tempest-ProjectMemberTests-1544704132 None] Delete snapshot completed successfully.
Nov 06 17:24:13 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-afadc4d7-1edd-4303-ae97-c5d32cecfe50 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-0a159194-d261-42b7-a911-97bd1cde22a6-delete_snapshot" released by "delete_snapshot" :: held 1.806s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:13 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-74ebcf34-8d2f-411e-98fd-fbe143543556 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-c367c83a-5135-4693-86f6-2ea156275ebc-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:13 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-74ebcf34-8d2f-411e-98fd-fbe143543556 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-c367c83a-5135-4693-86f6-2ea156275ebc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:13 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-74ebcf34-8d2f-411e-98fd-fbe143543556 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-quobyte-c367c83a-5135-4693-86f6-2ea156275ebc" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:13 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-74ebcf34-8d2f-411e-98fd-fbe143543556 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-c367c83a-5135-4693-86f6-2ea156275ebc" acquired by "delete_volume" :: waited 0.016s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:13 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ad0311-bd32-42d8-a372-3ec6be152936]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:24:13 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-74ebcf34-8d2f-411e-98fd-fbe143543556 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:13 devstack sudo[105969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc
Nov 06 17:24:13 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:14 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-74ebcf34-8d2f-411e-98fd-fbe143543556 tempest-ProjectMemberTests-1544704132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc" returned: 0 in 0.378s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-74ebcf34-8d2f-411e-98fd-fbe143543556 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:14 devstack sudo[105974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc
Nov 06 17:24:14 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:14 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-74ebcf34-8d2f-411e-98fd-fbe143543556 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-c367c83a-5135-4693-86f6-2ea156275ebc" returned: 0 in 0.262s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:14 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-74ebcf34-8d2f-411e-98fd-fbe143543556 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-c367c83a-5135-4693-86f6-2ea156275ebc" released by "delete_volume" :: held 0.714s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:14 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-74ebcf34-8d2f-411e-98fd-fbe143543556 tempest-ProjectMemberTests-1544704132 None] Created reservations ['3c580874-7d9d-459c-a91a-c80365687782', '2b4a93ae-2fc8-4612-820b-ab37331aa1ec', '7169bf71-c853-4ab6-821e-928603625e0b', '53070018-529e-4a72-8ece-993b1c671ab4'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:24:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-74ebcf34-8d2f-411e-98fd-fbe143543556 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:24:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-74ebcf34-8d2f-411e-98fd-fbe143543556 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:24:14 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-74ebcf34-8d2f-411e-98fd-fbe143543556 tempest-ProjectMemberTests-1544704132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:24:14 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-74ebcf34-8d2f-411e-98fd-fbe143543556 tempest-ProjectMemberTests-1544704132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:24:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-74ebcf34-8d2f-411e-98fd-fbe143543556 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:24:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-74ebcf34-8d2f-411e-98fd-fbe143543556 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:14 devstack sudo[105977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:24:14 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:14 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:14 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-74ebcf34-8d2f-411e-98fd-fbe143543556 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.281s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:14 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-74ebcf34-8d2f-411e-98fd-fbe143543556 tempest-ProjectMemberTests-1544704132 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:24:14 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-74ebcf34-8d2f-411e-98fd-fbe143543556 tempest-ProjectMemberTests-1544704132 None] Deleted volume successfully.
Nov 06 17:24:14 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-74ebcf34-8d2f-411e-98fd-fbe143543556 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-c367c83a-5135-4693-86f6-2ea156275ebc-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:15 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b5c310b-1778-4a94-a8f1-b521c24d039b tempest-ProjectMemberTests-1544704132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:24:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0b5c310b-1778-4a94-a8f1-b521c24d039b tempest-ProjectMemberTests-1544704132 None] Flow 'volume_create_manager' (6354f9b4-70e6-4705-83cc-7d80f181b94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:24:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0b5c310b-1778-4a94-a8f1-b521c24d039b tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cbc3405-efbe-4676-b4d5-e8f47329bcf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0b5c310b-1778-4a94-a8f1-b521c24d039b tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cbc3405-efbe-4676-b4d5-e8f47329bcf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2026722756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f41c150-5aeb-4dda-b9c5-de1f86f10088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95db90b8146744d19b5f094536ef20c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:24:15Z,use_quota=True,user_id='b0a2c8c9eeea4d8e90c8a6fcb89970cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0b5c310b-1778-4a94-a8f1-b521c24d039b tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b02abc02-a578-43f8-b183-c54074db5ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0b5c310b-1778-4a94-a8f1-b521c24d039b tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b02abc02-a578-43f8-b183-c54074db5ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0b5c310b-1778-4a94-a8f1-b521c24d039b tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59acbc01-bc2a-4f03-b647-8340f21e0d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0b5c310b-1778-4a94-a8f1-b521c24d039b tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59acbc01-bc2a-4f03-b647-8340f21e0d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f41c150-5aeb-4dda-b9c5-de1f86f10088', 'volume_name': 'volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0b5c310b-1778-4a94-a8f1-b521c24d039b tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99d5b4c8-f66d-4ad4-9477-ad984b088132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0b5c310b-1778-4a94-a8f1-b521c24d039b tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99d5b4c8-f66d-4ad4-9477-ad984b088132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:15 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0b5c310b-1778-4a94-a8f1-b521c24d039b tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34b028ea-54cc-4b4c-9f8d-061ebbe5d967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:15 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-0b5c310b-1778-4a94-a8f1-b521c24d039b tempest-ProjectMemberTests-1544704132 None] Volume 2f41c150-5aeb-4dda-b9c5-de1f86f10088: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088', 'volume_size': 1}
Nov 06 17:24:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0b5c310b-1778-4a94-a8f1-b521c24d039b tempest-ProjectMemberTests-1544704132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:24:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0b5c310b-1778-4a94-a8f1-b521c24d039b tempest-ProjectMemberTests-1544704132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:24:15 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0b5c310b-1778-4a94-a8f1-b521c24d039b tempest-ProjectMemberTests-1544704132 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2026722756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f41c150-5aeb-4dda-b9c5-de1f86f10088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95db90b8146744d19b5f094536ef20c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:24:15Z,use_quota=True,user_id='b0a2c8c9eeea4d8e90c8a6fcb89970cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:24:15 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-0b5c310b-1778-4a94-a8f1-b521c24d039b tempest-ProjectMemberTests-1544704132 None] Creating volume 2f41c150-5aeb-4dda-b9c5-de1f86f10088 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:24:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0b5c310b-1778-4a94-a8f1-b521c24d039b tempest-ProjectMemberTests-1544704132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:24:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0b5c310b-1778-4a94-a8f1-b521c24d039b tempest-ProjectMemberTests-1544704132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:24:15 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0b5c310b-1778-4a94-a8f1-b521c24d039b tempest-ProjectMemberTests-1544704132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:24:15 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0b5c310b-1778-4a94-a8f1-b521c24d039b tempest-ProjectMemberTests-1544704132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:24:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0b5c310b-1778-4a94-a8f1-b521c24d039b tempest-ProjectMemberTests-1544704132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:24:15 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0b5c310b-1778-4a94-a8f1-b521c24d039b tempest-ProjectMemberTests-1544704132 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:24:15 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-0b5c310b-1778-4a94-a8f1-b521c24d039b tempest-ProjectMemberTests-1544704132 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:24:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0b5c310b-1778-4a94-a8f1-b521c24d039b tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:15 devstack sudo[105980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088 1073741824
Nov 06 17:24:15 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:15 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:15 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0b5c310b-1778-4a94-a8f1-b521c24d039b tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088 1073741824" returned: 0 in 0.418s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0b5c310b-1778-4a94-a8f1-b521c24d039b tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:16 devstack sudo[105985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088
Nov 06 17:24:16 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:16 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0b5c310b-1778-4a94-a8f1-b521c24d039b tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088" returned: 0 in 0.238s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:16 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0b5c310b-1778-4a94-a8f1-b521c24d039b tempest-ProjectMemberTests-1544704132 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:24:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0b5c310b-1778-4a94-a8f1-b521c24d039b tempest-ProjectMemberTests-1544704132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:24:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0b5c310b-1778-4a94-a8f1-b521c24d039b tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34b028ea-54cc-4b4c-9f8d-061ebbe5d967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0b5c310b-1778-4a94-a8f1-b521c24d039b tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ea1308d-3086-46e8-a374-19c184e1cfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:16 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-0b5c310b-1778-4a94-a8f1-b521c24d039b tempest-ProjectMemberTests-1544704132 None] Volume volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088 (2f41c150-5aeb-4dda-b9c5-de1f86f10088): created successfully
Nov 06 17:24:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0b5c310b-1778-4a94-a8f1-b521c24d039b tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ea1308d-3086-46e8-a374-19c184e1cfc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:16 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0b5c310b-1778-4a94-a8f1-b521c24d039b tempest-ProjectMemberTests-1544704132 None] Flow 'volume_create_manager' (6354f9b4-70e6-4705-83cc-7d80f181b94e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:24:16 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-0b5c310b-1778-4a94-a8f1-b521c24d039b tempest-ProjectMemberTests-1544704132 None] Created volume successfully.
Nov 06 17:24:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-deadddbe-bd82-4281-a7d3-1c3d5c40a776 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:24:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-deadddbe-bd82-4281-a7d3-1c3d5c40a776 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:24:16 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-deadddbe-bd82-4281-a7d3-1c3d5c40a776 tempest-ProjectMemberTests-1544704132 None] Creating offline snapshot 3bc00019-13bb-492f-ade7-2c5dd731a18f of volume 2f41c150-5aeb-4dda-b9c5-de1f86f10088 {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:24:16 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafb9b50-0f15-468d-8814-6f6fc2522502]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:24:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-deadddbe-bd82-4281-a7d3-1c3d5c40a776 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:16 devstack sudo[105988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088
Nov 06 17:24:16 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:16 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-deadddbe-bd82-4281-a7d3-1c3d5c40a776 tempest-ProjectMemberTests-1544704132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088" returned: 0 in 0.351s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:16 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-deadddbe-bd82-4281-a7d3-1c3d5c40a776 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088.3bc00019-13bb-492f-ade7-2c5dd731a18f 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:16 devstack sudo[105993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088.3bc00019-13bb-492f-ade7-2c5dd731a18f 1G
Nov 06 17:24:16 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:17 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-deadddbe-bd82-4281-a7d3-1c3d5c40a776 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088.3bc00019-13bb-492f-ade7-2c5dd731a18f 1G" returned: 0 in 0.379s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-deadddbe-bd82-4281-a7d3-1c3d5c40a776 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088.3bc00019-13bb-492f-ade7-2c5dd731a18f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:17 devstack sudo[105998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088.3bc00019-13bb-492f-ade7-2c5dd731a18f
Nov 06 17:24:17 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:17 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-deadddbe-bd82-4281-a7d3-1c3d5c40a776 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088.3bc00019-13bb-492f-ade7-2c5dd731a18f" returned: 0 in 0.303s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:17 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-deadddbe-bd82-4281-a7d3-1c3d5c40a776 tempest-ProjectMemberTests-1544704132 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088.3bc00019-13bb-492f-ade7-2c5dd731a18f is being set with open permissions: ugo+rw
Nov 06 17:24:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-deadddbe-bd82-4281-a7d3-1c3d5c40a776 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088.3bc00019-13bb-492f-ade7-2c5dd731a18f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:17 devstack sudo[106003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088.3bc00019-13bb-492f-ade7-2c5dd731a18f
Nov 06 17:24:17 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:17 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-deadddbe-bd82-4281-a7d3-1c3d5c40a776 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088.3bc00019-13bb-492f-ade7-2c5dd731a18f" returned: 0 in 0.259s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:17 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-deadddbe-bd82-4281-a7d3-1c3d5c40a776 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:17 devstack sudo[106006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088.info
Nov 06 17:24:17 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:18 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-deadddbe-bd82-4281-a7d3-1c3d5c40a776 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088.info" returned: 0 in 0.251s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:18 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-deadddbe-bd82-4281-a7d3-1c3d5c40a776 tempest-ProjectMemberTests-1544704132 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088.info is being set with open permissions: ugo+rw
Nov 06 17:24:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-deadddbe-bd82-4281-a7d3-1c3d5c40a776 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:18 devstack sudo[106009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088.info
Nov 06 17:24:18 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:18 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-deadddbe-bd82-4281-a7d3-1c3d5c40a776 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088.info" returned: 0 in 0.245s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-deadddbe-bd82-4281-a7d3-1c3d5c40a776 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.874s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:24:18 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-deadddbe-bd82-4281-a7d3-1c3d5c40a776 tempest-ProjectMemberTests-1544704132 None] Create snapshot completed successfully
Nov 06 17:24:18 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ae4859b3-3d03-40fa-b158-90278a0eb7ea tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-3bc00019-13bb-492f-ade7-2c5dd731a18f-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:18 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ae4859b3-3d03-40fa-b158-90278a0eb7ea tempest-ProjectMemberTests-1544704132 None] Lock "cinder-3bc00019-13bb-492f-ade7-2c5dd731a18f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:18 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ae4859b3-3d03-40fa-b158-90278a0eb7ea tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-quobyte-2f41c150-5aeb-4dda-b9c5-de1f86f10088" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:18 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ae4859b3-3d03-40fa-b158-90278a0eb7ea tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-2f41c150-5aeb-4dda-b9c5-de1f86f10088" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:18 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ae4859b3-3d03-40fa-b158-90278a0eb7ea tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-quobyte-3bc00019-13bb-492f-ade7-2c5dd731a18f" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:18 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ae4859b3-3d03-40fa-b158-90278a0eb7ea tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-3bc00019-13bb-492f-ade7-2c5dd731a18f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:18 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-ae4859b3-3d03-40fa-b158-90278a0eb7ea tempest-ProjectMemberTests-1544704132 None] Deleting offline snapshot 3bc00019-13bb-492f-ade7-2c5dd731a18f of volume 2f41c150-5aeb-4dda-b9c5-de1f86f10088 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:24:18 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-ae4859b3-3d03-40fa-b158-90278a0eb7ea tempest-ProjectMemberTests-1544704132 None] snapshot_file for this snap is: volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088.3bc00019-13bb-492f-ade7-2c5dd731a18f {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:24:18 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[95da6466-1fa4-4ab8-81bf-3d1c5cae88d4]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:24:18 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ae4859b3-3d03-40fa-b158-90278a0eb7ea tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088.3bc00019-13bb-492f-ade7-2c5dd731a18f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:18 devstack sudo[106012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088.3bc00019-13bb-492f-ade7-2c5dd731a18f
Nov 06 17:24:18 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:19 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ae4859b3-3d03-40fa-b158-90278a0eb7ea tempest-ProjectMemberTests-1544704132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088.3bc00019-13bb-492f-ade7-2c5dd731a18f" returned: 0 in 0.363s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:19 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-ae4859b3-3d03-40fa-b158-90278a0eb7ea tempest-ProjectMemberTests-1544704132 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:24:19 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f98215-9682-446a-8d89-a1816080e8bd]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:24:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ae4859b3-3d03-40fa-b158-90278a0eb7ea tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:19 devstack sudo[106017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088
Nov 06 17:24:19 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:19 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ae4859b3-3d03-40fa-b158-90278a0eb7ea tempest-ProjectMemberTests-1544704132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088" returned: 0 in 0.355s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ae4859b3-3d03-40fa-b158-90278a0eb7ea tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088.3bc00019-13bb-492f-ade7-2c5dd731a18f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:19 devstack sudo[106022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088.3bc00019-13bb-492f-ade7-2c5dd731a18f
Nov 06 17:24:19 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:19 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ae4859b3-3d03-40fa-b158-90278a0eb7ea tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088.3bc00019-13bb-492f-ade7-2c5dd731a18f" returned: 0 in 0.330s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:19 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ae4859b3-3d03-40fa-b158-90278a0eb7ea tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088.3bc00019-13bb-492f-ade7-2c5dd731a18f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:19 devstack sudo[106027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088.3bc00019-13bb-492f-ade7-2c5dd731a18f
Nov 06 17:24:19 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:20 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:20 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ae4859b3-3d03-40fa-b158-90278a0eb7ea tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088.3bc00019-13bb-492f-ade7-2c5dd731a18f" returned: 0 in 0.245s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:20 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ae4859b3-3d03-40fa-b158-90278a0eb7ea tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-3bc00019-13bb-492f-ade7-2c5dd731a18f" released by "_delete_snapshot" :: held 1.389s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:20 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ae4859b3-3d03-40fa-b158-90278a0eb7ea tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-2f41c150-5aeb-4dda-b9c5-de1f86f10088" released by "delete_snapshot" :: held 1.411s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:20 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-ae4859b3-3d03-40fa-b158-90278a0eb7ea tempest-ProjectMemberTests-1544704132 None] Created reservations ['8eb22bdd-4146-445d-9582-0df6936c588f', '503553b2-f46a-476f-a14a-163839af5a61', '0653b74e-f07d-4b34-a5da-2e71367ad700', '5fe260f5-58a9-40f6-bb8c-4b855c877224'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:24:20 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-ae4859b3-3d03-40fa-b158-90278a0eb7ea tempest-ProjectMemberTests-1544704132 None] Delete snapshot completed successfully.
Nov 06 17:24:20 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-ae4859b3-3d03-40fa-b158-90278a0eb7ea tempest-ProjectMemberTests-1544704132 None] Lock "cinder-3bc00019-13bb-492f-ade7-2c5dd731a18f-delete_snapshot" released by "delete_snapshot" :: held 1.657s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:20 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-16c30e82-8685-4552-bfdf-b622f716489e tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-2f41c150-5aeb-4dda-b9c5-de1f86f10088-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:20 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-16c30e82-8685-4552-bfdf-b622f716489e tempest-ProjectMemberTests-1544704132 None] Lock "cinder-2f41c150-5aeb-4dda-b9c5-de1f86f10088-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:20 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-16c30e82-8685-4552-bfdf-b622f716489e tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-quobyte-2f41c150-5aeb-4dda-b9c5-de1f86f10088" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:20 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-16c30e82-8685-4552-bfdf-b622f716489e tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-2f41c150-5aeb-4dda-b9c5-de1f86f10088" acquired by "delete_volume" :: waited 0.013s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:21 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[29cfb450-0221-40a3-8fc7-2b48638dd776]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:24:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-16c30e82-8685-4552-bfdf-b622f716489e tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:21 devstack sudo[106030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088
Nov 06 17:24:21 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:21 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-16c30e82-8685-4552-bfdf-b622f716489e tempest-ProjectMemberTests-1544704132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088" returned: 0 in 0.356s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-16c30e82-8685-4552-bfdf-b622f716489e tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:21 devstack sudo[106035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088
Nov 06 17:24:21 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:21 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-16c30e82-8685-4552-bfdf-b622f716489e tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-2f41c150-5aeb-4dda-b9c5-de1f86f10088" returned: 0 in 0.241s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:21 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-16c30e82-8685-4552-bfdf-b622f716489e tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-2f41c150-5aeb-4dda-b9c5-de1f86f10088" released by "delete_volume" :: held 0.660s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:21 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-16c30e82-8685-4552-bfdf-b622f716489e tempest-ProjectMemberTests-1544704132 None] Created reservations ['b7d18ac2-f874-4df3-8371-07f03ba1b425', 'ed4a382b-5696-4184-ad82-5ae85ddaa5c8', '2c9ff682-26c0-4eb8-8f54-0896ed9f30c1', '731227cc-2bd7-49d3-b2f7-8113a762185b'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:24:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-16c30e82-8685-4552-bfdf-b622f716489e tempest-ProjectMemberTests-1544704132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:24:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-16c30e82-8685-4552-bfdf-b622f716489e tempest-ProjectMemberTests-1544704132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:24:21 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-16c30e82-8685-4552-bfdf-b622f716489e tempest-ProjectMemberTests-1544704132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:24:21 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-16c30e82-8685-4552-bfdf-b622f716489e tempest-ProjectMemberTests-1544704132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:24:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-16c30e82-8685-4552-bfdf-b622f716489e tempest-ProjectMemberTests-1544704132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:24:21 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-16c30e82-8685-4552-bfdf-b622f716489e tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:21 devstack sudo[106039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:24:21 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:22 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-16c30e82-8685-4552-bfdf-b622f716489e tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.255s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:22 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-16c30e82-8685-4552-bfdf-b622f716489e tempest-ProjectMemberTests-1544704132 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:24:22 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-16c30e82-8685-4552-bfdf-b622f716489e tempest-ProjectMemberTests-1544704132 None] Deleted volume successfully.
Nov 06 17:24:22 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-16c30e82-8685-4552-bfdf-b622f716489e tempest-ProjectMemberTests-1544704132 None] Lock "cinder-2f41c150-5aeb-4dda-b9c5-de1f86f10088-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:22 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a2a2eb8-1d49-4cbc-bba7-f2b31210cfc3 tempest-ProjectMemberTests-1544704132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:24:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0a2a2eb8-1d49-4cbc-bba7-f2b31210cfc3 tempest-ProjectMemberTests-1544704132 None] Flow 'volume_create_manager' (c521f433-5242-4fe2-ab23-96480e3f1fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:24:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0a2a2eb8-1d49-4cbc-bba7-f2b31210cfc3 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9add4909-3320-4b6f-9963-a3731b6c9a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0a2a2eb8-1d49-4cbc-bba7-f2b31210cfc3 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9add4909-3320-4b6f-9963-a3731b6c9a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-94955601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdb4af92-d983-435d-b927-2437c1e66092,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95db90b8146744d19b5f094536ef20c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:24:22Z,use_quota=True,user_id='b0a2c8c9eeea4d8e90c8a6fcb89970cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0a2a2eb8-1d49-4cbc-bba7-f2b31210cfc3 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e527cc0c-344a-4c68-957b-8de72c2d2c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0a2a2eb8-1d49-4cbc-bba7-f2b31210cfc3 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e527cc0c-344a-4c68-957b-8de72c2d2c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0a2a2eb8-1d49-4cbc-bba7-f2b31210cfc3 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b6bd36-1612-4835-9060-d4e8613b435e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0a2a2eb8-1d49-4cbc-bba7-f2b31210cfc3 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b6bd36-1612-4835-9060-d4e8613b435e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdb4af92-d983-435d-b927-2437c1e66092', 'volume_name': 'volume-bdb4af92-d983-435d-b927-2437c1e66092', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0a2a2eb8-1d49-4cbc-bba7-f2b31210cfc3 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e048bc0c-0854-4c5a-86c4-b2b8ba978d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0a2a2eb8-1d49-4cbc-bba7-f2b31210cfc3 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e048bc0c-0854-4c5a-86c4-b2b8ba978d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:22 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0a2a2eb8-1d49-4cbc-bba7-f2b31210cfc3 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (497c6a2b-bcce-4524-9c51-b0ea206ca57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:22 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-0a2a2eb8-1d49-4cbc-bba7-f2b31210cfc3 tempest-ProjectMemberTests-1544704132 None] Volume bdb4af92-d983-435d-b927-2437c1e66092: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdb4af92-d983-435d-b927-2437c1e66092', 'volume_size': 1}
Nov 06 17:24:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0a2a2eb8-1d49-4cbc-bba7-f2b31210cfc3 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:24:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0a2a2eb8-1d49-4cbc-bba7-f2b31210cfc3 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:24:22 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0a2a2eb8-1d49-4cbc-bba7-f2b31210cfc3 tempest-ProjectMemberTests-1544704132 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-94955601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdb4af92-d983-435d-b927-2437c1e66092,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95db90b8146744d19b5f094536ef20c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:24:22Z,use_quota=True,user_id='b0a2c8c9eeea4d8e90c8a6fcb89970cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:24:22 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-0a2a2eb8-1d49-4cbc-bba7-f2b31210cfc3 tempest-ProjectMemberTests-1544704132 None] Creating volume bdb4af92-d983-435d-b927-2437c1e66092 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:24:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0a2a2eb8-1d49-4cbc-bba7-f2b31210cfc3 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:24:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0a2a2eb8-1d49-4cbc-bba7-f2b31210cfc3 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:24:22 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0a2a2eb8-1d49-4cbc-bba7-f2b31210cfc3 tempest-ProjectMemberTests-1544704132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:24:22 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0a2a2eb8-1d49-4cbc-bba7-f2b31210cfc3 tempest-ProjectMemberTests-1544704132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:24:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0a2a2eb8-1d49-4cbc-bba7-f2b31210cfc3 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:24:22 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0a2a2eb8-1d49-4cbc-bba7-f2b31210cfc3 tempest-ProjectMemberTests-1544704132 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:24:22 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-0a2a2eb8-1d49-4cbc-bba7-f2b31210cfc3 tempest-ProjectMemberTests-1544704132 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:24:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0a2a2eb8-1d49-4cbc-bba7-f2b31210cfc3 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:22 devstack sudo[106042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092 1073741824
Nov 06 17:24:22 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:22 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:22 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0a2a2eb8-1d49-4cbc-bba7-f2b31210cfc3 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092 1073741824" returned: 0 in 0.401s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0a2a2eb8-1d49-4cbc-bba7-f2b31210cfc3 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:23 devstack sudo[106047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092
Nov 06 17:24:23 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:23 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0a2a2eb8-1d49-4cbc-bba7-f2b31210cfc3 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092" returned: 0 in 0.253s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:23 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-0a2a2eb8-1d49-4cbc-bba7-f2b31210cfc3 tempest-ProjectMemberTests-1544704132 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:24:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-0a2a2eb8-1d49-4cbc-bba7-f2b31210cfc3 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:24:23 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0a2a2eb8-1d49-4cbc-bba7-f2b31210cfc3 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (497c6a2b-bcce-4524-9c51-b0ea206ca57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdb4af92-d983-435d-b927-2437c1e66092', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:23 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0a2a2eb8-1d49-4cbc-bba7-f2b31210cfc3 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (861abea3-c80f-488d-82b3-5a24e8d3009a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:23 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-0a2a2eb8-1d49-4cbc-bba7-f2b31210cfc3 tempest-ProjectMemberTests-1544704132 None] Volume volume-bdb4af92-d983-435d-b927-2437c1e66092 (bdb4af92-d983-435d-b927-2437c1e66092): created successfully
Nov 06 17:24:23 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0a2a2eb8-1d49-4cbc-bba7-f2b31210cfc3 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (861abea3-c80f-488d-82b3-5a24e8d3009a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:23 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-0a2a2eb8-1d49-4cbc-bba7-f2b31210cfc3 tempest-ProjectMemberTests-1544704132 None] Flow 'volume_create_manager' (c521f433-5242-4fe2-ab23-96480e3f1fe9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:24:23 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-0a2a2eb8-1d49-4cbc-bba7-f2b31210cfc3 tempest-ProjectMemberTests-1544704132 None] Created volume successfully.
Nov 06 17:24:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-853946b2-70e9-4003-aabc-983b23dd59d7 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:24:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-853946b2-70e9-4003-aabc-983b23dd59d7 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:24:23 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-853946b2-70e9-4003-aabc-983b23dd59d7 tempest-ProjectMemberTests-1544704132 None] Creating offline snapshot 58f74ba0-bafc-4b56-b937-c9921e45badb of volume bdb4af92-d983-435d-b927-2437c1e66092 {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:24:23 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34a39a4-7d0a-4df6-9c5f-f7d0a28b30b5]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:24:23 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-853946b2-70e9-4003-aabc-983b23dd59d7 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:23 devstack sudo[106050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092
Nov 06 17:24:23 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:24 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-853946b2-70e9-4003-aabc-983b23dd59d7 tempest-ProjectMemberTests-1544704132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092" returned: 0 in 0.350s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-853946b2-70e9-4003-aabc-983b23dd59d7 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092.58f74ba0-bafc-4b56-b937-c9921e45badb 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:24 devstack sudo[106055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092.58f74ba0-bafc-4b56-b937-c9921e45badb 1G
Nov 06 17:24:24 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:24 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-853946b2-70e9-4003-aabc-983b23dd59d7 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092.58f74ba0-bafc-4b56-b937-c9921e45badb 1G" returned: 0 in 0.388s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-853946b2-70e9-4003-aabc-983b23dd59d7 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdb4af92-d983-435d-b927-2437c1e66092 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092.58f74ba0-bafc-4b56-b937-c9921e45badb {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:24 devstack sudo[106060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdb4af92-d983-435d-b927-2437c1e66092 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092.58f74ba0-bafc-4b56-b937-c9921e45badb
Nov 06 17:24:24 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:24 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-853946b2-70e9-4003-aabc-983b23dd59d7 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdb4af92-d983-435d-b927-2437c1e66092 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092.58f74ba0-bafc-4b56-b937-c9921e45badb" returned: 0 in 0.289s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:24 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-853946b2-70e9-4003-aabc-983b23dd59d7 tempest-ProjectMemberTests-1544704132 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092.58f74ba0-bafc-4b56-b937-c9921e45badb is being set with open permissions: ugo+rw
Nov 06 17:24:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-853946b2-70e9-4003-aabc-983b23dd59d7 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092.58f74ba0-bafc-4b56-b937-c9921e45badb {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:24 devstack sudo[106065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092.58f74ba0-bafc-4b56-b937-c9921e45badb
Nov 06 17:24:24 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:24 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-853946b2-70e9-4003-aabc-983b23dd59d7 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092.58f74ba0-bafc-4b56-b937-c9921e45badb" returned: 0 in 0.242s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:24 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-853946b2-70e9-4003-aabc-983b23dd59d7 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:24 devstack sudo[106068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092.info
Nov 06 17:24:24 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:25 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-853946b2-70e9-4003-aabc-983b23dd59d7 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092.info" returned: 0 in 0.248s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:25 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-853946b2-70e9-4003-aabc-983b23dd59d7 tempest-ProjectMemberTests-1544704132 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092.info is being set with open permissions: ugo+rw
Nov 06 17:24:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-853946b2-70e9-4003-aabc-983b23dd59d7 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:25 devstack sudo[106071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092.info
Nov 06 17:24:25 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:25 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-853946b2-70e9-4003-aabc-983b23dd59d7 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092.info" returned: 0 in 0.241s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-853946b2-70e9-4003-aabc-983b23dd59d7 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.849s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:24:25 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-853946b2-70e9-4003-aabc-983b23dd59d7 tempest-ProjectMemberTests-1544704132 None] Create snapshot completed successfully
Nov 06 17:24:25 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-def41b50-7fcf-4993-8c2b-71eb530d5ec6 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-58f74ba0-bafc-4b56-b937-c9921e45badb-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:25 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-def41b50-7fcf-4993-8c2b-71eb530d5ec6 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-58f74ba0-bafc-4b56-b937-c9921e45badb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:25 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-def41b50-7fcf-4993-8c2b-71eb530d5ec6 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-quobyte-bdb4af92-d983-435d-b927-2437c1e66092" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:25 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-def41b50-7fcf-4993-8c2b-71eb530d5ec6 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-bdb4af92-d983-435d-b927-2437c1e66092" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:25 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-def41b50-7fcf-4993-8c2b-71eb530d5ec6 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-quobyte-58f74ba0-bafc-4b56-b937-c9921e45badb" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:25 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-def41b50-7fcf-4993-8c2b-71eb530d5ec6 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-58f74ba0-bafc-4b56-b937-c9921e45badb" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:25 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-def41b50-7fcf-4993-8c2b-71eb530d5ec6 tempest-ProjectMemberTests-1544704132 None] Deleting offline snapshot 58f74ba0-bafc-4b56-b937-c9921e45badb of volume bdb4af92-d983-435d-b927-2437c1e66092 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:24:25 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-def41b50-7fcf-4993-8c2b-71eb530d5ec6 tempest-ProjectMemberTests-1544704132 None] snapshot_file for this snap is: volume-bdb4af92-d983-435d-b927-2437c1e66092.58f74ba0-bafc-4b56-b937-c9921e45badb {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:24:25 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[38aa6eb5-354e-44cc-81f8-390d55e7bf90]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:24:25 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-def41b50-7fcf-4993-8c2b-71eb530d5ec6 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092.58f74ba0-bafc-4b56-b937-c9921e45badb {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:25 devstack sudo[106074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092.58f74ba0-bafc-4b56-b937-c9921e45badb
Nov 06 17:24:25 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:26 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-def41b50-7fcf-4993-8c2b-71eb530d5ec6 tempest-ProjectMemberTests-1544704132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092.58f74ba0-bafc-4b56-b937-c9921e45badb" returned: 0 in 0.349s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:26 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-def41b50-7fcf-4993-8c2b-71eb530d5ec6 tempest-ProjectMemberTests-1544704132 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdb4af92-d983-435d-b927-2437c1e66092(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:24:26 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5870c0-c54b-425e-922f-aad37c99a8ba]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:24:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-def41b50-7fcf-4993-8c2b-71eb530d5ec6 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:26 devstack sudo[106079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092
Nov 06 17:24:26 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:26 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-def41b50-7fcf-4993-8c2b-71eb530d5ec6 tempest-ProjectMemberTests-1544704132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092" returned: 0 in 0.345s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-def41b50-7fcf-4993-8c2b-71eb530d5ec6 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092.58f74ba0-bafc-4b56-b937-c9921e45badb {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:26 devstack sudo[106084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092.58f74ba0-bafc-4b56-b937-c9921e45badb
Nov 06 17:24:26 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:26 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-def41b50-7fcf-4993-8c2b-71eb530d5ec6 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092.58f74ba0-bafc-4b56-b937-c9921e45badb" returned: 0 in 0.324s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:26 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-def41b50-7fcf-4993-8c2b-71eb530d5ec6 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092.58f74ba0-bafc-4b56-b937-c9921e45badb {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:26 devstack sudo[106089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092.58f74ba0-bafc-4b56-b937-c9921e45badb
Nov 06 17:24:26 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:27 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:27 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-def41b50-7fcf-4993-8c2b-71eb530d5ec6 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092.58f74ba0-bafc-4b56-b937-c9921e45badb" returned: 0 in 0.255s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:27 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-def41b50-7fcf-4993-8c2b-71eb530d5ec6 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-58f74ba0-bafc-4b56-b937-c9921e45badb" released by "_delete_snapshot" :: held 1.366s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:27 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-def41b50-7fcf-4993-8c2b-71eb530d5ec6 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-bdb4af92-d983-435d-b927-2437c1e66092" released by "delete_snapshot" :: held 1.387s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:27 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-def41b50-7fcf-4993-8c2b-71eb530d5ec6 tempest-ProjectMemberTests-1544704132 None] Created reservations ['f1b19730-b2d1-46f9-9f34-28d1658a8beb', '40ed1d64-5e85-4705-9828-1bb8683b1869', '4a27d1ae-bda2-47b8-8604-b2ecb59f4be9', '59139cba-6085-4fde-a5a2-f30928cf8154'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:24:27 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-def41b50-7fcf-4993-8c2b-71eb530d5ec6 tempest-ProjectMemberTests-1544704132 None] Delete snapshot completed successfully.
Nov 06 17:24:27 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-def41b50-7fcf-4993-8c2b-71eb530d5ec6 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-58f74ba0-bafc-4b56-b937-c9921e45badb-delete_snapshot" released by "delete_snapshot" :: held 1.511s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:27 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a2245347-d944-4b14-9be3-6cc402448ba5 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-bdb4af92-d983-435d-b927-2437c1e66092-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:27 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a2245347-d944-4b14-9be3-6cc402448ba5 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-bdb4af92-d983-435d-b927-2437c1e66092-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:27 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a2245347-d944-4b14-9be3-6cc402448ba5 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-quobyte-bdb4af92-d983-435d-b927-2437c1e66092" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:27 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a2245347-d944-4b14-9be3-6cc402448ba5 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-bdb4af92-d983-435d-b927-2437c1e66092" acquired by "delete_volume" :: waited 0.017s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:28 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8f3dea-d66f-42c0-9ecf-4c1b6269d7a3]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:24:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a2245347-d944-4b14-9be3-6cc402448ba5 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:28 devstack sudo[106093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092
Nov 06 17:24:28 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:28 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a2245347-d944-4b14-9be3-6cc402448ba5 tempest-ProjectMemberTests-1544704132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092" returned: 0 in 0.345s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a2245347-d944-4b14-9be3-6cc402448ba5 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:28 devstack sudo[106098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092
Nov 06 17:24:28 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:28 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a2245347-d944-4b14-9be3-6cc402448ba5 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-bdb4af92-d983-435d-b927-2437c1e66092" returned: 0 in 0.240s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:28 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a2245347-d944-4b14-9be3-6cc402448ba5 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-bdb4af92-d983-435d-b927-2437c1e66092" released by "delete_volume" :: held 0.648s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:28 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-a2245347-d944-4b14-9be3-6cc402448ba5 tempest-ProjectMemberTests-1544704132 None] Created reservations ['0b6a7c47-3079-438e-9569-5aa44c4808f5', 'c5cc2f21-5935-45f1-9fe0-943f0c05ba73', '39ae252f-ec4e-4d19-9323-5888e4d1cc18', '7d51f8c5-62f7-4071-948f-13532920134b'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:24:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a2245347-d944-4b14-9be3-6cc402448ba5 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:24:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a2245347-d944-4b14-9be3-6cc402448ba5 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:24:28 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a2245347-d944-4b14-9be3-6cc402448ba5 tempest-ProjectMemberTests-1544704132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:24:28 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-a2245347-d944-4b14-9be3-6cc402448ba5 tempest-ProjectMemberTests-1544704132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:24:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-a2245347-d944-4b14-9be3-6cc402448ba5 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:24:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a2245347-d944-4b14-9be3-6cc402448ba5 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:28 devstack sudo[106101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:24:28 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:28 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:28 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-a2245347-d944-4b14-9be3-6cc402448ba5 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.237s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:28 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-a2245347-d944-4b14-9be3-6cc402448ba5 tempest-ProjectMemberTests-1544704132 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:24:28 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-a2245347-d944-4b14-9be3-6cc402448ba5 tempest-ProjectMemberTests-1544704132 None] Deleted volume successfully.
Nov 06 17:24:29 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-a2245347-d944-4b14-9be3-6cc402448ba5 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-bdb4af92-d983-435d-b927-2437c1e66092-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:29 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f3b6573-de39-44a5-ba7a-3200a1175f95 tempest-ProjectMemberTests-1544704132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:24:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f3b6573-de39-44a5-ba7a-3200a1175f95 tempest-ProjectMemberTests-1544704132 None] Flow 'volume_create_manager' (32615f30-adcc-46e5-834c-fd8a8641c406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:24:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f3b6573-de39-44a5-ba7a-3200a1175f95 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fd1ffcf-0143-43a0-b5cb-c17cb39a5c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f3b6573-de39-44a5-ba7a-3200a1175f95 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fd1ffcf-0143-43a0-b5cb-c17cb39a5c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1055134471',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a3e2c94-930a-4c1e-b80f-afac3c8bda05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95db90b8146744d19b5f094536ef20c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:24:29Z,use_quota=True,user_id='b0a2c8c9eeea4d8e90c8a6fcb89970cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f3b6573-de39-44a5-ba7a-3200a1175f95 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0330c5b8-9b89-4049-ab81-4fb47121d7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f3b6573-de39-44a5-ba7a-3200a1175f95 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0330c5b8-9b89-4049-ab81-4fb47121d7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f3b6573-de39-44a5-ba7a-3200a1175f95 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1b3ea30-3137-4483-b791-9ef4bd5d348d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f3b6573-de39-44a5-ba7a-3200a1175f95 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1b3ea30-3137-4483-b791-9ef4bd5d348d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a3e2c94-930a-4c1e-b80f-afac3c8bda05', 'volume_name': 'volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f3b6573-de39-44a5-ba7a-3200a1175f95 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d71d52c-4cf3-4743-b7b3-47e2c88c2fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f3b6573-de39-44a5-ba7a-3200a1175f95 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d71d52c-4cf3-4743-b7b3-47e2c88c2fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:29 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f3b6573-de39-44a5-ba7a-3200a1175f95 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d224278-be5d-4efb-9c9a-d727bbdd4193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:29 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-4f3b6573-de39-44a5-ba7a-3200a1175f95 tempest-ProjectMemberTests-1544704132 None] Volume 5a3e2c94-930a-4c1e-b80f-afac3c8bda05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05', 'volume_size': 1}
Nov 06 17:24:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f3b6573-de39-44a5-ba7a-3200a1175f95 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:24:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f3b6573-de39-44a5-ba7a-3200a1175f95 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:24:29 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f3b6573-de39-44a5-ba7a-3200a1175f95 tempest-ProjectMemberTests-1544704132 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1055134471',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a3e2c94-930a-4c1e-b80f-afac3c8bda05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95db90b8146744d19b5f094536ef20c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:24:29Z,use_quota=True,user_id='b0a2c8c9eeea4d8e90c8a6fcb89970cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:24:29 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-4f3b6573-de39-44a5-ba7a-3200a1175f95 tempest-ProjectMemberTests-1544704132 None] Creating volume 5a3e2c94-930a-4c1e-b80f-afac3c8bda05 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:24:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f3b6573-de39-44a5-ba7a-3200a1175f95 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:24:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f3b6573-de39-44a5-ba7a-3200a1175f95 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:24:29 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f3b6573-de39-44a5-ba7a-3200a1175f95 tempest-ProjectMemberTests-1544704132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:24:29 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f3b6573-de39-44a5-ba7a-3200a1175f95 tempest-ProjectMemberTests-1544704132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:24:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f3b6573-de39-44a5-ba7a-3200a1175f95 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:24:29 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f3b6573-de39-44a5-ba7a-3200a1175f95 tempest-ProjectMemberTests-1544704132 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:24:29 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-4f3b6573-de39-44a5-ba7a-3200a1175f95 tempest-ProjectMemberTests-1544704132 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:24:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f3b6573-de39-44a5-ba7a-3200a1175f95 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:29 devstack sudo[106104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05 1073741824
Nov 06 17:24:29 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:29 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:29 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f3b6573-de39-44a5-ba7a-3200a1175f95 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05 1073741824" returned: 0 in 0.424s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f3b6573-de39-44a5-ba7a-3200a1175f95 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:30 devstack sudo[106111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05
Nov 06 17:24:30 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:30 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f3b6573-de39-44a5-ba7a-3200a1175f95 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05" returned: 0 in 0.248s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:30 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f3b6573-de39-44a5-ba7a-3200a1175f95 tempest-ProjectMemberTests-1544704132 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:24:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f3b6573-de39-44a5-ba7a-3200a1175f95 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:24:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f3b6573-de39-44a5-ba7a-3200a1175f95 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d224278-be5d-4efb-9c9a-d727bbdd4193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f3b6573-de39-44a5-ba7a-3200a1175f95 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8086445-7d0d-4160-887f-74608906377a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:30 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-4f3b6573-de39-44a5-ba7a-3200a1175f95 tempest-ProjectMemberTests-1544704132 None] Volume volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05 (5a3e2c94-930a-4c1e-b80f-afac3c8bda05): created successfully
Nov 06 17:24:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f3b6573-de39-44a5-ba7a-3200a1175f95 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8086445-7d0d-4160-887f-74608906377a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:30 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f3b6573-de39-44a5-ba7a-3200a1175f95 tempest-ProjectMemberTests-1544704132 None] Flow 'volume_create_manager' (32615f30-adcc-46e5-834c-fd8a8641c406) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:24:30 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-4f3b6573-de39-44a5-ba7a-3200a1175f95 tempest-ProjectMemberTests-1544704132 None] Created volume successfully.
Nov 06 17:24:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ab5bb134-7d66-453e-a0ad-a5c884669244 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:24:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ab5bb134-7d66-453e-a0ad-a5c884669244 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:24:30 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-ab5bb134-7d66-453e-a0ad-a5c884669244 tempest-ProjectMemberTests-1544704132 None] Creating offline snapshot 492b3d37-94ea-4759-8efa-e320ffd145d5 of volume 5a3e2c94-930a-4c1e-b80f-afac3c8bda05 {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:24:30 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cd6b7f-a28e-4e5c-9bde-ea8db61d244d]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:24:30 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab5bb134-7d66-453e-a0ad-a5c884669244 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:30 devstack sudo[106114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05
Nov 06 17:24:30 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:31 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab5bb134-7d66-453e-a0ad-a5c884669244 tempest-ProjectMemberTests-1544704132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05" returned: 0 in 0.355s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab5bb134-7d66-453e-a0ad-a5c884669244 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05.492b3d37-94ea-4759-8efa-e320ffd145d5 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:31 devstack sudo[106119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05.492b3d37-94ea-4759-8efa-e320ffd145d5 1G
Nov 06 17:24:31 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:31 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab5bb134-7d66-453e-a0ad-a5c884669244 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05.492b3d37-94ea-4759-8efa-e320ffd145d5 1G" returned: 0 in 0.384s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab5bb134-7d66-453e-a0ad-a5c884669244 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05.492b3d37-94ea-4759-8efa-e320ffd145d5 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:31 devstack sudo[106125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05.492b3d37-94ea-4759-8efa-e320ffd145d5
Nov 06 17:24:31 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:31 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab5bb134-7d66-453e-a0ad-a5c884669244 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05.492b3d37-94ea-4759-8efa-e320ffd145d5" returned: 0 in 0.293s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:31 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-ab5bb134-7d66-453e-a0ad-a5c884669244 tempest-ProjectMemberTests-1544704132 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05.492b3d37-94ea-4759-8efa-e320ffd145d5 is being set with open permissions: ugo+rw
Nov 06 17:24:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab5bb134-7d66-453e-a0ad-a5c884669244 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05.492b3d37-94ea-4759-8efa-e320ffd145d5 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:31 devstack sudo[106131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05.492b3d37-94ea-4759-8efa-e320ffd145d5
Nov 06 17:24:31 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:31 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab5bb134-7d66-453e-a0ad-a5c884669244 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05.492b3d37-94ea-4759-8efa-e320ffd145d5" returned: 0 in 0.236s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:31 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab5bb134-7d66-453e-a0ad-a5c884669244 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:32 devstack sudo[106134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05.info
Nov 06 17:24:32 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:32 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab5bb134-7d66-453e-a0ad-a5c884669244 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05.info" returned: 0 in 0.252s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:32 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-ab5bb134-7d66-453e-a0ad-a5c884669244 tempest-ProjectMemberTests-1544704132 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05.info is being set with open permissions: ugo+rw
Nov 06 17:24:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab5bb134-7d66-453e-a0ad-a5c884669244 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:32 devstack sudo[106137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05.info
Nov 06 17:24:32 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:32 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-ab5bb134-7d66-453e-a0ad-a5c884669244 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05.info" returned: 0 in 0.236s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-ab5bb134-7d66-453e-a0ad-a5c884669244 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.834s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:24:32 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-ab5bb134-7d66-453e-a0ad-a5c884669244 tempest-ProjectMemberTests-1544704132 None] Create snapshot completed successfully
Nov 06 17:24:32 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-b3a22979-284d-46b4-b604-d69fba373401 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-492b3d37-94ea-4759-8efa-e320ffd145d5-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:32 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-b3a22979-284d-46b4-b604-d69fba373401 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-492b3d37-94ea-4759-8efa-e320ffd145d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:32 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-b3a22979-284d-46b4-b604-d69fba373401 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-quobyte-5a3e2c94-930a-4c1e-b80f-afac3c8bda05" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:32 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-b3a22979-284d-46b4-b604-d69fba373401 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-5a3e2c94-930a-4c1e-b80f-afac3c8bda05" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:32 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-b3a22979-284d-46b4-b604-d69fba373401 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-quobyte-492b3d37-94ea-4759-8efa-e320ffd145d5" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:32 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-b3a22979-284d-46b4-b604-d69fba373401 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-492b3d37-94ea-4759-8efa-e320ffd145d5" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:32 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-b3a22979-284d-46b4-b604-d69fba373401 tempest-ProjectMemberTests-1544704132 None] Deleting offline snapshot 492b3d37-94ea-4759-8efa-e320ffd145d5 of volume 5a3e2c94-930a-4c1e-b80f-afac3c8bda05 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:24:32 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-b3a22979-284d-46b4-b604-d69fba373401 tempest-ProjectMemberTests-1544704132 None] snapshot_file for this snap is: volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05.492b3d37-94ea-4759-8efa-e320ffd145d5 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:24:32 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a023ea-30b7-4a90-8db1-7bac3b67f854]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:24:32 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b3a22979-284d-46b4-b604-d69fba373401 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05.492b3d37-94ea-4759-8efa-e320ffd145d5 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:32 devstack sudo[106140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05.492b3d37-94ea-4759-8efa-e320ffd145d5
Nov 06 17:24:32 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:33 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b3a22979-284d-46b4-b604-d69fba373401 tempest-ProjectMemberTests-1544704132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05.492b3d37-94ea-4759-8efa-e320ffd145d5" returned: 0 in 0.360s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:33 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-b3a22979-284d-46b4-b604-d69fba373401 tempest-ProjectMemberTests-1544704132 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:24:33 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad21ad8-e7b3-4905-b7af-54240394925f]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:24:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b3a22979-284d-46b4-b604-d69fba373401 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:33 devstack sudo[106145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05
Nov 06 17:24:33 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:33 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b3a22979-284d-46b4-b604-d69fba373401 tempest-ProjectMemberTests-1544704132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05" returned: 0 in 0.352s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b3a22979-284d-46b4-b604-d69fba373401 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05.492b3d37-94ea-4759-8efa-e320ffd145d5 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:33 devstack sudo[106150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05.492b3d37-94ea-4759-8efa-e320ffd145d5
Nov 06 17:24:33 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:33 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b3a22979-284d-46b4-b604-d69fba373401 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05.492b3d37-94ea-4759-8efa-e320ffd145d5" returned: 0 in 0.346s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:33 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b3a22979-284d-46b4-b604-d69fba373401 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05.492b3d37-94ea-4759-8efa-e320ffd145d5 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:33 devstack sudo[106155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05.492b3d37-94ea-4759-8efa-e320ffd145d5
Nov 06 17:24:33 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:34 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:34 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-b3a22979-284d-46b4-b604-d69fba373401 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05.492b3d37-94ea-4759-8efa-e320ffd145d5" returned: 0 in 0.254s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:34 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-b3a22979-284d-46b4-b604-d69fba373401 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-492b3d37-94ea-4759-8efa-e320ffd145d5" released by "_delete_snapshot" :: held 1.406s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:34 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-b3a22979-284d-46b4-b604-d69fba373401 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-5a3e2c94-930a-4c1e-b80f-afac3c8bda05" released by "delete_snapshot" :: held 1.426s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:34 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-b3a22979-284d-46b4-b604-d69fba373401 tempest-ProjectMemberTests-1544704132 None] Created reservations ['5641aa51-5b5f-4d4f-8218-1d861867d019', '7d8ca411-5fcd-410f-92bd-9501efe90004', 'ec52f3b5-b496-4d1c-9e92-4ac32eac6f85', '239ac9ab-d27e-4763-8e65-4321073d4bb5'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:24:34 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-b3a22979-284d-46b4-b604-d69fba373401 tempest-ProjectMemberTests-1544704132 None] Delete snapshot completed successfully.
Nov 06 17:24:34 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-b3a22979-284d-46b4-b604-d69fba373401 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-492b3d37-94ea-4759-8efa-e320ffd145d5-delete_snapshot" released by "delete_snapshot" :: held 1.544s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:34 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5b866d4b-55a3-4454-8bce-1c20de74b424 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-5a3e2c94-930a-4c1e-b80f-afac3c8bda05-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:34 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5b866d4b-55a3-4454-8bce-1c20de74b424 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-5a3e2c94-930a-4c1e-b80f-afac3c8bda05-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:34 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5b866d4b-55a3-4454-8bce-1c20de74b424 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-quobyte-5a3e2c94-930a-4c1e-b80f-afac3c8bda05" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:35 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5b866d4b-55a3-4454-8bce-1c20de74b424 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-5a3e2c94-930a-4c1e-b80f-afac3c8bda05" acquired by "delete_volume" :: waited 0.014s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:35 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a0cd2d-31ea-4b80-a0ed-0fcb98728b89]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:24:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5b866d4b-55a3-4454-8bce-1c20de74b424 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:35 devstack sudo[106158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05
Nov 06 17:24:35 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:35 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5b866d4b-55a3-4454-8bce-1c20de74b424 tempest-ProjectMemberTests-1544704132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05" returned: 0 in 0.360s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5b866d4b-55a3-4454-8bce-1c20de74b424 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:35 devstack sudo[106163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05
Nov 06 17:24:35 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:35 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5b866d4b-55a3-4454-8bce-1c20de74b424 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5a3e2c94-930a-4c1e-b80f-afac3c8bda05" returned: 0 in 0.249s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:35 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5b866d4b-55a3-4454-8bce-1c20de74b424 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-5a3e2c94-930a-4c1e-b80f-afac3c8bda05" released by "delete_volume" :: held 0.671s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:35 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-5b866d4b-55a3-4454-8bce-1c20de74b424 tempest-ProjectMemberTests-1544704132 None] Created reservations ['c9bfdea6-0b8f-48ee-8bb8-efea629f7d2d', '97e927c9-6184-480b-83f1-880fe9bcb1d4', 'de256731-a0c4-4967-8f24-c385b4e3e311', '7f709bdd-b35d-4b63-8ada-ed51c04717ae'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:24:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5b866d4b-55a3-4454-8bce-1c20de74b424 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:24:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5b866d4b-55a3-4454-8bce-1c20de74b424 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:24:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5b866d4b-55a3-4454-8bce-1c20de74b424 tempest-ProjectMemberTests-1544704132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:24:35 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5b866d4b-55a3-4454-8bce-1c20de74b424 tempest-ProjectMemberTests-1544704132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:24:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5b866d4b-55a3-4454-8bce-1c20de74b424 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:24:35 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5b866d4b-55a3-4454-8bce-1c20de74b424 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:35 devstack sudo[106166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:24:35 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:36 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5b866d4b-55a3-4454-8bce-1c20de74b424 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.236s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:36 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-5b866d4b-55a3-4454-8bce-1c20de74b424 tempest-ProjectMemberTests-1544704132 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:24:36 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-5b866d4b-55a3-4454-8bce-1c20de74b424 tempest-ProjectMemberTests-1544704132 None] Deleted volume successfully.
Nov 06 17:24:36 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5b866d4b-55a3-4454-8bce-1c20de74b424 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-5a3e2c94-930a-4c1e-b80f-afac3c8bda05-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:36 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c8d1d2f-a95c-44e1-8721-30bf62689868 tempest-ProjectMemberTests-1544704132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:24:36 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5c8d1d2f-a95c-44e1-8721-30bf62689868 tempest-ProjectMemberTests-1544704132 None] Flow 'volume_create_manager' (d28d1fd1-5134-4581-b673-3693afbcb92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:24:36 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5c8d1d2f-a95c-44e1-8721-30bf62689868 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc609e02-fc78-463b-8aa5-4802107fca8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:36 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5c8d1d2f-a95c-44e1-8721-30bf62689868 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc609e02-fc78-463b-8aa5-4802107fca8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1784718248',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95db90b8146744d19b5f094536ef20c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:24:36Z,use_quota=True,user_id='b0a2c8c9eeea4d8e90c8a6fcb89970cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:36 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5c8d1d2f-a95c-44e1-8721-30bf62689868 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed6fccf-540e-4654-8263-aa45ec8e532c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:36 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5c8d1d2f-a95c-44e1-8721-30bf62689868 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed6fccf-540e-4654-8263-aa45ec8e532c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:36 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5c8d1d2f-a95c-44e1-8721-30bf62689868 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (371598ed-eef9-402a-9f86-d513ae13ef7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:36 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5c8d1d2f-a95c-44e1-8721-30bf62689868 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (371598ed-eef9-402a-9f86-d513ae13ef7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85', 'volume_name': 'volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:36 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5c8d1d2f-a95c-44e1-8721-30bf62689868 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (025f8ba3-59b8-4410-86a3-de7f97347c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:36 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5c8d1d2f-a95c-44e1-8721-30bf62689868 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (025f8ba3-59b8-4410-86a3-de7f97347c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:36 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5c8d1d2f-a95c-44e1-8721-30bf62689868 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aa81c29-48f0-4b1b-b5dc-089b5a875b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:36 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-5c8d1d2f-a95c-44e1-8721-30bf62689868 tempest-ProjectMemberTests-1544704132 None] Volume cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85', 'volume_size': 1}
Nov 06 17:24:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5c8d1d2f-a95c-44e1-8721-30bf62689868 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:24:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5c8d1d2f-a95c-44e1-8721-30bf62689868 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:24:36 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5c8d1d2f-a95c-44e1-8721-30bf62689868 tempest-ProjectMemberTests-1544704132 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1784718248',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95db90b8146744d19b5f094536ef20c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:24:36Z,use_quota=True,user_id='b0a2c8c9eeea4d8e90c8a6fcb89970cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:24:36 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-5c8d1d2f-a95c-44e1-8721-30bf62689868 tempest-ProjectMemberTests-1544704132 None] Creating volume cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:24:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5c8d1d2f-a95c-44e1-8721-30bf62689868 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:24:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5c8d1d2f-a95c-44e1-8721-30bf62689868 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:24:36 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5c8d1d2f-a95c-44e1-8721-30bf62689868 tempest-ProjectMemberTests-1544704132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:24:36 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5c8d1d2f-a95c-44e1-8721-30bf62689868 tempest-ProjectMemberTests-1544704132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:24:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5c8d1d2f-a95c-44e1-8721-30bf62689868 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:24:36 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5c8d1d2f-a95c-44e1-8721-30bf62689868 tempest-ProjectMemberTests-1544704132 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:24:36 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-5c8d1d2f-a95c-44e1-8721-30bf62689868 tempest-ProjectMemberTests-1544704132 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:24:36 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5c8d1d2f-a95c-44e1-8721-30bf62689868 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:36 devstack sudo[106169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85 1073741824
Nov 06 17:24:36 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:37 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5c8d1d2f-a95c-44e1-8721-30bf62689868 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85 1073741824" returned: 0 in 0.415s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5c8d1d2f-a95c-44e1-8721-30bf62689868 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:37 devstack sudo[106175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85
Nov 06 17:24:37 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:37 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5c8d1d2f-a95c-44e1-8721-30bf62689868 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85" returned: 0 in 0.246s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:37 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-5c8d1d2f-a95c-44e1-8721-30bf62689868 tempest-ProjectMemberTests-1544704132 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:24:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-5c8d1d2f-a95c-44e1-8721-30bf62689868 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:24:37 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5c8d1d2f-a95c-44e1-8721-30bf62689868 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aa81c29-48f0-4b1b-b5dc-089b5a875b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:37 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5c8d1d2f-a95c-44e1-8721-30bf62689868 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee990844-425f-42d3-b0ec-7e6b1c92ea8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:37 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-5c8d1d2f-a95c-44e1-8721-30bf62689868 tempest-ProjectMemberTests-1544704132 None] Volume volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85 (cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85): created successfully
Nov 06 17:24:37 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5c8d1d2f-a95c-44e1-8721-30bf62689868 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee990844-425f-42d3-b0ec-7e6b1c92ea8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:37 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-5c8d1d2f-a95c-44e1-8721-30bf62689868 tempest-ProjectMemberTests-1544704132 None] Flow 'volume_create_manager' (d28d1fd1-5134-4581-b673-3693afbcb92d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:24:37 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-5c8d1d2f-a95c-44e1-8721-30bf62689868 tempest-ProjectMemberTests-1544704132 None] Created volume successfully.
Nov 06 17:24:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-11140ea3-673b-4a80-b181-d19ec039d913 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:24:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-11140ea3-673b-4a80-b181-d19ec039d913 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:24:37 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-11140ea3-673b-4a80-b181-d19ec039d913 tempest-ProjectMemberTests-1544704132 None] Creating offline snapshot 4250e8eb-c243-4af9-ae77-f5553aa491bc of volume cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85 {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:24:37 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd374a28-1ce7-4146-a1ca-2c5cb43fff0b]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:24:37 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-11140ea3-673b-4a80-b181-d19ec039d913 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:37 devstack sudo[106178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85
Nov 06 17:24:37 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:38 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-11140ea3-673b-4a80-b181-d19ec039d913 tempest-ProjectMemberTests-1544704132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85" returned: 0 in 0.358s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-11140ea3-673b-4a80-b181-d19ec039d913 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85.4250e8eb-c243-4af9-ae77-f5553aa491bc 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:38 devstack sudo[106183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85.4250e8eb-c243-4af9-ae77-f5553aa491bc 1G
Nov 06 17:24:38 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:38 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-11140ea3-673b-4a80-b181-d19ec039d913 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85.4250e8eb-c243-4af9-ae77-f5553aa491bc 1G" returned: 0 in 0.381s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-11140ea3-673b-4a80-b181-d19ec039d913 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85.4250e8eb-c243-4af9-ae77-f5553aa491bc {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:38 devstack sudo[106188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85.4250e8eb-c243-4af9-ae77-f5553aa491bc
Nov 06 17:24:38 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:38 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-11140ea3-673b-4a80-b181-d19ec039d913 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85.4250e8eb-c243-4af9-ae77-f5553aa491bc" returned: 0 in 0.288s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:38 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-11140ea3-673b-4a80-b181-d19ec039d913 tempest-ProjectMemberTests-1544704132 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85.4250e8eb-c243-4af9-ae77-f5553aa491bc is being set with open permissions: ugo+rw
Nov 06 17:24:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-11140ea3-673b-4a80-b181-d19ec039d913 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85.4250e8eb-c243-4af9-ae77-f5553aa491bc {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:38 devstack sudo[106193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85.4250e8eb-c243-4af9-ae77-f5553aa491bc
Nov 06 17:24:38 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:38 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-11140ea3-673b-4a80-b181-d19ec039d913 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85.4250e8eb-c243-4af9-ae77-f5553aa491bc" returned: 0 in 0.233s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:38 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-11140ea3-673b-4a80-b181-d19ec039d913 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:39 devstack sudo[106196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85.info
Nov 06 17:24:39 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:39 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-11140ea3-673b-4a80-b181-d19ec039d913 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85.info" returned: 0 in 0.253s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:39 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-11140ea3-673b-4a80-b181-d19ec039d913 tempest-ProjectMemberTests-1544704132 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85.info is being set with open permissions: ugo+rw
Nov 06 17:24:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-11140ea3-673b-4a80-b181-d19ec039d913 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:39 devstack sudo[106199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85.info
Nov 06 17:24:39 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:39 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-11140ea3-673b-4a80-b181-d19ec039d913 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85.info" returned: 0 in 0.238s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-11140ea3-673b-4a80-b181-d19ec039d913 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.834s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:24:39 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-11140ea3-673b-4a80-b181-d19ec039d913 tempest-ProjectMemberTests-1544704132 None] Create snapshot completed successfully
Nov 06 17:24:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-04a256e3-98c4-43e8-8b44-f7aeeaaef702 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-4250e8eb-c243-4af9-ae77-f5553aa491bc-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-04a256e3-98c4-43e8-8b44-f7aeeaaef702 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-4250e8eb-c243-4af9-ae77-f5553aa491bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-04a256e3-98c4-43e8-8b44-f7aeeaaef702 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-quobyte-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-04a256e3-98c4-43e8-8b44-f7aeeaaef702 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-04a256e3-98c4-43e8-8b44-f7aeeaaef702 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-quobyte-4250e8eb-c243-4af9-ae77-f5553aa491bc" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:39 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-04a256e3-98c4-43e8-8b44-f7aeeaaef702 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-4250e8eb-c243-4af9-ae77-f5553aa491bc" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:39 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-04a256e3-98c4-43e8-8b44-f7aeeaaef702 tempest-ProjectMemberTests-1544704132 None] Deleting offline snapshot 4250e8eb-c243-4af9-ae77-f5553aa491bc of volume cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:24:39 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-04a256e3-98c4-43e8-8b44-f7aeeaaef702 tempest-ProjectMemberTests-1544704132 None] snapshot_file for this snap is: volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85.4250e8eb-c243-4af9-ae77-f5553aa491bc {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:24:39 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1cfe12-197c-42f6-9a28-6cf13ea267b3]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:24:39 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-04a256e3-98c4-43e8-8b44-f7aeeaaef702 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85.4250e8eb-c243-4af9-ae77-f5553aa491bc {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:39 devstack sudo[106202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85.4250e8eb-c243-4af9-ae77-f5553aa491bc
Nov 06 17:24:39 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:40 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-04a256e3-98c4-43e8-8b44-f7aeeaaef702 tempest-ProjectMemberTests-1544704132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85.4250e8eb-c243-4af9-ae77-f5553aa491bc" returned: 0 in 0.352s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:40 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-04a256e3-98c4-43e8-8b44-f7aeeaaef702 tempest-ProjectMemberTests-1544704132 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:24:40 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[b556367a-3aca-4cac-bf26-b58f0550e486]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:24:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-04a256e3-98c4-43e8-8b44-f7aeeaaef702 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:40 devstack sudo[106207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85
Nov 06 17:24:40 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:40 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-04a256e3-98c4-43e8-8b44-f7aeeaaef702 tempest-ProjectMemberTests-1544704132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85" returned: 0 in 0.364s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-04a256e3-98c4-43e8-8b44-f7aeeaaef702 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85.4250e8eb-c243-4af9-ae77-f5553aa491bc {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:40 devstack sudo[106212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85.4250e8eb-c243-4af9-ae77-f5553aa491bc
Nov 06 17:24:40 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:40 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-04a256e3-98c4-43e8-8b44-f7aeeaaef702 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85.4250e8eb-c243-4af9-ae77-f5553aa491bc" returned: 0 in 0.330s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:40 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-04a256e3-98c4-43e8-8b44-f7aeeaaef702 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85.4250e8eb-c243-4af9-ae77-f5553aa491bc {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:40 devstack sudo[106217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85.4250e8eb-c243-4af9-ae77-f5553aa491bc
Nov 06 17:24:40 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:41 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:41 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-04a256e3-98c4-43e8-8b44-f7aeeaaef702 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85.4250e8eb-c243-4af9-ae77-f5553aa491bc" returned: 0 in 0.246s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:41 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-04a256e3-98c4-43e8-8b44-f7aeeaaef702 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-4250e8eb-c243-4af9-ae77-f5553aa491bc" released by "_delete_snapshot" :: held 1.389s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:41 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-04a256e3-98c4-43e8-8b44-f7aeeaaef702 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85" released by "delete_snapshot" :: held 1.408s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:41 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-04a256e3-98c4-43e8-8b44-f7aeeaaef702 tempest-ProjectMemberTests-1544704132 None] Created reservations ['69e7993c-3210-4a22-b76d-7b998755856a', 'e75a518d-2b4d-4575-8025-cf26ed12275d', '1ffdf827-6ec2-41d6-b822-61cef6fb4da8', '0aea4598-2558-4110-bdec-06b80d6c47cf'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:24:41 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-04a256e3-98c4-43e8-8b44-f7aeeaaef702 tempest-ProjectMemberTests-1544704132 None] Delete snapshot completed successfully.
Nov 06 17:24:41 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-04a256e3-98c4-43e8-8b44-f7aeeaaef702 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-4250e8eb-c243-4af9-ae77-f5553aa491bc-delete_snapshot" released by "delete_snapshot" :: held 1.535s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:41 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c67ca6ad-bc92-46da-bd53-fe36ebafdef9 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:41 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c67ca6ad-bc92-46da-bd53-fe36ebafdef9 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:41 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c67ca6ad-bc92-46da-bd53-fe36ebafdef9 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-quobyte-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:41 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c67ca6ad-bc92-46da-bd53-fe36ebafdef9 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85" acquired by "delete_volume" :: waited 0.013s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:42 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[167c6532-c22e-46c4-aa33-a35d3236b45a]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:24:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c67ca6ad-bc92-46da-bd53-fe36ebafdef9 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:42 devstack sudo[106221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85
Nov 06 17:24:42 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:42 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c67ca6ad-bc92-46da-bd53-fe36ebafdef9 tempest-ProjectMemberTests-1544704132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85" returned: 0 in 0.352s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c67ca6ad-bc92-46da-bd53-fe36ebafdef9 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:42 devstack sudo[106226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85
Nov 06 17:24:42 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:42 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:24:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:24:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:24:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:24:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:24:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:24:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:42 devstack sudo[106228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:24:42 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:42 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c67ca6ad-bc92-46da-bd53-fe36ebafdef9 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85" returned: 0 in 0.250s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:42 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c67ca6ad-bc92-46da-bd53-fe36ebafdef9 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85" released by "delete_volume" :: held 0.668s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:42 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-c67ca6ad-bc92-46da-bd53-fe36ebafdef9 tempest-ProjectMemberTests-1544704132 None] Created reservations ['d7a177fc-aabc-419d-9f25-8e91c0ff5bd8', '96843d25-c2c7-4da1-b541-61b0b319f7fd', '381b5359-cbcd-4c04-bc72-1b816c6c35f7', '1f6a621e-f0fd-4a1b-9a98-9ef0d3bde640'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:24:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c67ca6ad-bc92-46da-bd53-fe36ebafdef9 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:24:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c67ca6ad-bc92-46da-bd53-fe36ebafdef9 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:24:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c67ca6ad-bc92-46da-bd53-fe36ebafdef9 tempest-ProjectMemberTests-1544704132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:24:42 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:42 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-c67ca6ad-bc92-46da-bd53-fe36ebafdef9 tempest-ProjectMemberTests-1544704132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:24:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-c67ca6ad-bc92-46da-bd53-fe36ebafdef9 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:24:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c67ca6ad-bc92-46da-bd53-fe36ebafdef9 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:42 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.274s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:42 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:24:42 devstack cinder-volume[86856]: DEBUG oslo_service.periodic_task [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] Running periodic task VolumeManager._thread_info {{(pid=86856) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 17:24:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread count: 28 {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 17:24:42 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-4f21e946-05af-46eb-9af9-52d22bde6c35 None None] thread info: [<_MainThread(MainThread, started 125183137599616)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125183027608256)>, <Thread(Thread-3 (stat_writer), started daemon 125183025243776)>, <Thread(Rabbit-heartbeat, started daemon 125183023512896)>, <Thread(Thread-5 (_runner), started daemon 125183023357120)>, <Thread(Thread-7 (_runner), started daemon 125183021306496)>, <Thread(fd_logger, started daemon 125183018711616)>, <Thread(privsep_reader, started daemon 125183017484224)>, <Thread(tpool_thread_0, started daemon 125183013742272)>, <Thread(tpool_thread_1, started daemon 125183005349568)>, <Thread(tpool_thread_2, started daemon 125182996956864)>, <Thread(tpool_thread_3, started daemon 125182988564160)>, <Thread(tpool_thread_4, started daemon 125182980171456)>, <Thread(tpool_thread_5, started daemon 125182971778752)>, <Thread(tpool_thread_6, started daemon 125182963386048)>, <Thread(tpool_thread_7, started daemon 125182954993344)>, <Thread(tpool_thread_8, started daemon 125182946600640)>, <Thread(tpool_thread_9, started daemon 125182938207936)>, <Thread(tpool_thread_10, started daemon 125182929815232)>, <Thread(tpool_thread_11, started daemon 125182921422528)>, <Thread(tpool_thread_12, started daemon 125182913013440)>, <Thread(tpool_thread_13, started daemon 125182904604352)>, <Thread(tpool_thread_14, started daemon 125182896195264)>, <Thread(tpool_thread_15, started daemon 125182887786176)>, <Thread(tpool_thread_16, started daemon 125182879377088)>, <Thread(tpool_thread_17, started daemon 125182870968000)>, <Thread(tpool_thread_18, started daemon 125182862558912)>, <Thread(tpool_thread_19, started daemon 125182854149824)>] {{(pid=86856) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 17:24:42 devstack sudo[106232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:24:42 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:43 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-c67ca6ad-bc92-46da-bd53-fe36ebafdef9 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.257s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:43 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-c67ca6ad-bc92-46da-bd53-fe36ebafdef9 tempest-ProjectMemberTests-1544704132 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:24:43 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-c67ca6ad-bc92-46da-bd53-fe36ebafdef9 tempest-ProjectMemberTests-1544704132 None] Deleted volume successfully.
Nov 06 17:24:43 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-c67ca6ad-bc92-46da-bd53-fe36ebafdef9 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-cbaac4b2-d0b2-4f0d-947e-00f2a6acfe85-delete_volume" released by "delete_volume" :: held 1.121s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:43 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-44db6923-f4a5-4a7b-84d9-ee5f192c5b22 tempest-ProjectMemberTests-1544704132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:24:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-44db6923-f4a5-4a7b-84d9-ee5f192c5b22 tempest-ProjectMemberTests-1544704132 None] Flow 'volume_create_manager' (17a06598-d4fe-4856-8a8d-5cd94ed5aebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:24:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-44db6923-f4a5-4a7b-84d9-ee5f192c5b22 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9870d17e-9fc6-436e-b6d6-136bfa3ee0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-44db6923-f4a5-4a7b-84d9-ee5f192c5b22 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9870d17e-9fc6-436e-b6d6-136bfa3ee0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-286501366',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0df4229-a306-43eb-8131-d0f396c69757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95db90b8146744d19b5f094536ef20c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:24:43Z,use_quota=True,user_id='b0a2c8c9eeea4d8e90c8a6fcb89970cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-44db6923-f4a5-4a7b-84d9-ee5f192c5b22 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b4ae4c6-b5b5-43c8-8a58-cb2721c366df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-44db6923-f4a5-4a7b-84d9-ee5f192c5b22 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b4ae4c6-b5b5-43c8-8a58-cb2721c366df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-44db6923-f4a5-4a7b-84d9-ee5f192c5b22 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de41e1cb-08e1-4718-9309-ef1c671e3eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-44db6923-f4a5-4a7b-84d9-ee5f192c5b22 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de41e1cb-08e1-4718-9309-ef1c671e3eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0df4229-a306-43eb-8131-d0f396c69757', 'volume_name': 'volume-e0df4229-a306-43eb-8131-d0f396c69757', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-44db6923-f4a5-4a7b-84d9-ee5f192c5b22 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a57ce194-5fdd-42c1-9920-8bbca342bc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-44db6923-f4a5-4a7b-84d9-ee5f192c5b22 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a57ce194-5fdd-42c1-9920-8bbca342bc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:43 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-44db6923-f4a5-4a7b-84d9-ee5f192c5b22 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7417445f-0c1b-45f9-9845-015442051c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:43 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-44db6923-f4a5-4a7b-84d9-ee5f192c5b22 tempest-ProjectMemberTests-1544704132 None] Volume e0df4229-a306-43eb-8131-d0f396c69757: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0df4229-a306-43eb-8131-d0f396c69757', 'volume_size': 1}
Nov 06 17:24:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-44db6923-f4a5-4a7b-84d9-ee5f192c5b22 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:24:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-44db6923-f4a5-4a7b-84d9-ee5f192c5b22 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:24:43 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-44db6923-f4a5-4a7b-84d9-ee5f192c5b22 tempest-ProjectMemberTests-1544704132 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-286501366',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0df4229-a306-43eb-8131-d0f396c69757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95db90b8146744d19b5f094536ef20c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:24:43Z,use_quota=True,user_id='b0a2c8c9eeea4d8e90c8a6fcb89970cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:24:43 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-44db6923-f4a5-4a7b-84d9-ee5f192c5b22 tempest-ProjectMemberTests-1544704132 None] Creating volume e0df4229-a306-43eb-8131-d0f396c69757 {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:24:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-44db6923-f4a5-4a7b-84d9-ee5f192c5b22 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:24:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-44db6923-f4a5-4a7b-84d9-ee5f192c5b22 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:24:43 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-44db6923-f4a5-4a7b-84d9-ee5f192c5b22 tempest-ProjectMemberTests-1544704132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:24:43 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-44db6923-f4a5-4a7b-84d9-ee5f192c5b22 tempest-ProjectMemberTests-1544704132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:24:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-44db6923-f4a5-4a7b-84d9-ee5f192c5b22 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:24:43 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-44db6923-f4a5-4a7b-84d9-ee5f192c5b22 tempest-ProjectMemberTests-1544704132 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:24:43 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-44db6923-f4a5-4a7b-84d9-ee5f192c5b22 tempest-ProjectMemberTests-1544704132 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:24:43 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-44db6923-f4a5-4a7b-84d9-ee5f192c5b22 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:43 devstack sudo[106235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757 1073741824
Nov 06 17:24:43 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:44 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-44db6923-f4a5-4a7b-84d9-ee5f192c5b22 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757 1073741824" returned: 0 in 0.418s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-44db6923-f4a5-4a7b-84d9-ee5f192c5b22 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:44 devstack sudo[106240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757
Nov 06 17:24:44 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:44 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-44db6923-f4a5-4a7b-84d9-ee5f192c5b22 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757" returned: 0 in 0.246s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:44 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-44db6923-f4a5-4a7b-84d9-ee5f192c5b22 tempest-ProjectMemberTests-1544704132 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:24:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-44db6923-f4a5-4a7b-84d9-ee5f192c5b22 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:24:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-44db6923-f4a5-4a7b-84d9-ee5f192c5b22 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7417445f-0c1b-45f9-9845-015442051c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0df4229-a306-43eb-8131-d0f396c69757', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-44db6923-f4a5-4a7b-84d9-ee5f192c5b22 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f702154-b0fa-4ad1-b459-fd8603d07e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:44 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-44db6923-f4a5-4a7b-84d9-ee5f192c5b22 tempest-ProjectMemberTests-1544704132 None] Volume volume-e0df4229-a306-43eb-8131-d0f396c69757 (e0df4229-a306-43eb-8131-d0f396c69757): created successfully
Nov 06 17:24:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-44db6923-f4a5-4a7b-84d9-ee5f192c5b22 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f702154-b0fa-4ad1-b459-fd8603d07e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:44 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-44db6923-f4a5-4a7b-84d9-ee5f192c5b22 tempest-ProjectMemberTests-1544704132 None] Flow 'volume_create_manager' (17a06598-d4fe-4856-8a8d-5cd94ed5aebc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:24:44 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-44db6923-f4a5-4a7b-84d9-ee5f192c5b22 tempest-ProjectMemberTests-1544704132 None] Created volume successfully.
Nov 06 17:24:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-080778ad-bb48-457e-bf62-da24e85fb65a tempest-ProjectMemberTests-1544704132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:24:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-080778ad-bb48-457e-bf62-da24e85fb65a tempest-ProjectMemberTests-1544704132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:24:44 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-080778ad-bb48-457e-bf62-da24e85fb65a tempest-ProjectMemberTests-1544704132 None] Creating offline snapshot c6655cbb-2af6-4dcc-beb5-230de7f90e11 of volume e0df4229-a306-43eb-8131-d0f396c69757 {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:24:44 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8451d6-33dc-4476-99eb-d7df5271630a]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:24:44 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-080778ad-bb48-457e-bf62-da24e85fb65a tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:44 devstack sudo[106243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757
Nov 06 17:24:44 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:45 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-080778ad-bb48-457e-bf62-da24e85fb65a tempest-ProjectMemberTests-1544704132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757" returned: 0 in 0.350s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-080778ad-bb48-457e-bf62-da24e85fb65a tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757.c6655cbb-2af6-4dcc-beb5-230de7f90e11 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:45 devstack sudo[106248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757.c6655cbb-2af6-4dcc-beb5-230de7f90e11 1G
Nov 06 17:24:45 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:45 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-080778ad-bb48-457e-bf62-da24e85fb65a tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757.c6655cbb-2af6-4dcc-beb5-230de7f90e11 1G" returned: 0 in 0.420s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-080778ad-bb48-457e-bf62-da24e85fb65a tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0df4229-a306-43eb-8131-d0f396c69757 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757.c6655cbb-2af6-4dcc-beb5-230de7f90e11 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:45 devstack sudo[106253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0df4229-a306-43eb-8131-d0f396c69757 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757.c6655cbb-2af6-4dcc-beb5-230de7f90e11
Nov 06 17:24:45 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:45 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-080778ad-bb48-457e-bf62-da24e85fb65a tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0df4229-a306-43eb-8131-d0f396c69757 -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757.c6655cbb-2af6-4dcc-beb5-230de7f90e11" returned: 0 in 0.285s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:45 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-080778ad-bb48-457e-bf62-da24e85fb65a tempest-ProjectMemberTests-1544704132 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757.c6655cbb-2af6-4dcc-beb5-230de7f90e11 is being set with open permissions: ugo+rw
Nov 06 17:24:45 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-080778ad-bb48-457e-bf62-da24e85fb65a tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757.c6655cbb-2af6-4dcc-beb5-230de7f90e11 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:45 devstack sudo[106261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757.c6655cbb-2af6-4dcc-beb5-230de7f90e11
Nov 06 17:24:45 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:46 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-080778ad-bb48-457e-bf62-da24e85fb65a tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757.c6655cbb-2af6-4dcc-beb5-230de7f90e11" returned: 0 in 0.262s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-080778ad-bb48-457e-bf62-da24e85fb65a tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:46 devstack sudo[106267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757.info
Nov 06 17:24:46 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:46 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-080778ad-bb48-457e-bf62-da24e85fb65a tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757.info" returned: 0 in 0.248s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:46 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-080778ad-bb48-457e-bf62-da24e85fb65a tempest-ProjectMemberTests-1544704132 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757.info is being set with open permissions: ugo+rw
Nov 06 17:24:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-080778ad-bb48-457e-bf62-da24e85fb65a tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:46 devstack sudo[106270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757.info
Nov 06 17:24:46 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:46 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-080778ad-bb48-457e-bf62-da24e85fb65a tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757.info" returned: 0 in 0.243s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-080778ad-bb48-457e-bf62-da24e85fb65a tempest-ProjectMemberTests-1544704132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.885s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:24:46 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-080778ad-bb48-457e-bf62-da24e85fb65a tempest-ProjectMemberTests-1544704132 None] Create snapshot completed successfully
Nov 06 17:24:46 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-cc84f9c8-bc3f-40e4-9929-05dfa11a2e25 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-c6655cbb-2af6-4dcc-beb5-230de7f90e11-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:46 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-cc84f9c8-bc3f-40e4-9929-05dfa11a2e25 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-c6655cbb-2af6-4dcc-beb5-230de7f90e11-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:46 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-cc84f9c8-bc3f-40e4-9929-05dfa11a2e25 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-quobyte-e0df4229-a306-43eb-8131-d0f396c69757" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:46 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-cc84f9c8-bc3f-40e4-9929-05dfa11a2e25 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-e0df4229-a306-43eb-8131-d0f396c69757" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:46 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-cc84f9c8-bc3f-40e4-9929-05dfa11a2e25 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-quobyte-c6655cbb-2af6-4dcc-beb5-230de7f90e11" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:46 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-cc84f9c8-bc3f-40e4-9929-05dfa11a2e25 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-c6655cbb-2af6-4dcc-beb5-230de7f90e11" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:46 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-cc84f9c8-bc3f-40e4-9929-05dfa11a2e25 tempest-ProjectMemberTests-1544704132 None] Deleting offline snapshot c6655cbb-2af6-4dcc-beb5-230de7f90e11 of volume e0df4229-a306-43eb-8131-d0f396c69757 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:24:46 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-cc84f9c8-bc3f-40e4-9929-05dfa11a2e25 tempest-ProjectMemberTests-1544704132 None] snapshot_file for this snap is: volume-e0df4229-a306-43eb-8131-d0f396c69757.c6655cbb-2af6-4dcc-beb5-230de7f90e11 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:24:46 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[32236dac-3c27-43bd-9a02-a8f039a11570]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:24:46 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cc84f9c8-bc3f-40e4-9929-05dfa11a2e25 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757.c6655cbb-2af6-4dcc-beb5-230de7f90e11 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:46 devstack sudo[106273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757.c6655cbb-2af6-4dcc-beb5-230de7f90e11
Nov 06 17:24:46 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:47 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cc84f9c8-bc3f-40e4-9929-05dfa11a2e25 tempest-ProjectMemberTests-1544704132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757.c6655cbb-2af6-4dcc-beb5-230de7f90e11" returned: 0 in 0.362s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:47 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-cc84f9c8-bc3f-40e4-9929-05dfa11a2e25 tempest-ProjectMemberTests-1544704132 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0df4229-a306-43eb-8131-d0f396c69757(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:24:47 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[991e0394-2498-498c-8e15-708f853decf8]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:24:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cc84f9c8-bc3f-40e4-9929-05dfa11a2e25 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:47 devstack sudo[106278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757
Nov 06 17:24:47 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:47 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cc84f9c8-bc3f-40e4-9929-05dfa11a2e25 tempest-ProjectMemberTests-1544704132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757" returned: 0 in 0.352s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cc84f9c8-bc3f-40e4-9929-05dfa11a2e25 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757.c6655cbb-2af6-4dcc-beb5-230de7f90e11 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:47 devstack sudo[106283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757.c6655cbb-2af6-4dcc-beb5-230de7f90e11
Nov 06 17:24:47 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:47 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cc84f9c8-bc3f-40e4-9929-05dfa11a2e25 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757.c6655cbb-2af6-4dcc-beb5-230de7f90e11" returned: 0 in 0.317s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:47 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cc84f9c8-bc3f-40e4-9929-05dfa11a2e25 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757.c6655cbb-2af6-4dcc-beb5-230de7f90e11 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:47 devstack sudo[106288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757.c6655cbb-2af6-4dcc-beb5-230de7f90e11
Nov 06 17:24:47 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:48 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:48 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-cc84f9c8-bc3f-40e4-9929-05dfa11a2e25 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757.c6655cbb-2af6-4dcc-beb5-230de7f90e11" returned: 0 in 0.235s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:48 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-cc84f9c8-bc3f-40e4-9929-05dfa11a2e25 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-c6655cbb-2af6-4dcc-beb5-230de7f90e11" released by "_delete_snapshot" :: held 1.364s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:48 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-cc84f9c8-bc3f-40e4-9929-05dfa11a2e25 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-e0df4229-a306-43eb-8131-d0f396c69757" released by "delete_snapshot" :: held 1.386s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:48 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-cc84f9c8-bc3f-40e4-9929-05dfa11a2e25 tempest-ProjectMemberTests-1544704132 None] Created reservations ['0174f5e3-e46b-4806-867c-909fd5e090a5', 'e16e47a8-779d-4c5b-9861-6ab52573adf5', '75bb26c5-22d8-4289-8496-4d4deb5ef36e', 'ce299472-c6d8-4587-8a30-2020ce7a9efe'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:24:48 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-cc84f9c8-bc3f-40e4-9929-05dfa11a2e25 tempest-ProjectMemberTests-1544704132 None] Delete snapshot completed successfully.
Nov 06 17:24:48 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-cc84f9c8-bc3f-40e4-9929-05dfa11a2e25 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-c6655cbb-2af6-4dcc-beb5-230de7f90e11-delete_snapshot" released by "delete_snapshot" :: held 1.511s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:48 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-60890a98-1017-45dc-80a2-295b4a57bbad tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-e0df4229-a306-43eb-8131-d0f396c69757-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:48 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-60890a98-1017-45dc-80a2-295b4a57bbad tempest-ProjectMemberTests-1544704132 None] Lock "cinder-e0df4229-a306-43eb-8131-d0f396c69757-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:49 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-60890a98-1017-45dc-80a2-295b4a57bbad tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-quobyte-e0df4229-a306-43eb-8131-d0f396c69757" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:49 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-60890a98-1017-45dc-80a2-295b4a57bbad tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-e0df4229-a306-43eb-8131-d0f396c69757" acquired by "delete_volume" :: waited 0.015s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:49 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3b7b52-15ab-4c6c-8f4b-70a378131481]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:24:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-60890a98-1017-45dc-80a2-295b4a57bbad tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:49 devstack sudo[106291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757
Nov 06 17:24:49 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:49 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-60890a98-1017-45dc-80a2-295b4a57bbad tempest-ProjectMemberTests-1544704132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757" returned: 0 in 0.356s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-60890a98-1017-45dc-80a2-295b4a57bbad tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:49 devstack sudo[106296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757
Nov 06 17:24:49 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:49 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-60890a98-1017-45dc-80a2-295b4a57bbad tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-e0df4229-a306-43eb-8131-d0f396c69757" returned: 0 in 0.243s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:49 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-60890a98-1017-45dc-80a2-295b4a57bbad tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-e0df4229-a306-43eb-8131-d0f396c69757" released by "delete_volume" :: held 0.660s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:49 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-60890a98-1017-45dc-80a2-295b4a57bbad tempest-ProjectMemberTests-1544704132 None] Created reservations ['5d1c9a9b-03a7-4099-a3cf-9331cb21955e', '4cc60f60-2ca1-4c26-a433-4b9a015d93b7', '6d73ff77-6dde-4f09-bbf3-5911151a2e64', '75cc7914-3d27-42f2-84e0-dffc9b6be9ea'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:24:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-60890a98-1017-45dc-80a2-295b4a57bbad tempest-ProjectMemberTests-1544704132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:24:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-60890a98-1017-45dc-80a2-295b4a57bbad tempest-ProjectMemberTests-1544704132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:24:49 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-60890a98-1017-45dc-80a2-295b4a57bbad tempest-ProjectMemberTests-1544704132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:24:49 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-60890a98-1017-45dc-80a2-295b4a57bbad tempest-ProjectMemberTests-1544704132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:24:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-60890a98-1017-45dc-80a2-295b4a57bbad tempest-ProjectMemberTests-1544704132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:24:49 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-60890a98-1017-45dc-80a2-295b4a57bbad tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:49 devstack sudo[106299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:24:49 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:50 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-60890a98-1017-45dc-80a2-295b4a57bbad tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.246s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:50 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-60890a98-1017-45dc-80a2-295b4a57bbad tempest-ProjectMemberTests-1544704132 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:24:50 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-60890a98-1017-45dc-80a2-295b4a57bbad tempest-ProjectMemberTests-1544704132 None] Deleted volume successfully.
Nov 06 17:24:50 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-60890a98-1017-45dc-80a2-295b4a57bbad tempest-ProjectMemberTests-1544704132 None] Lock "cinder-e0df4229-a306-43eb-8131-d0f396c69757-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:50 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-18409603-72d9-408f-8ce8-7b42bbf5f43c tempest-ProjectMemberTests-1544704132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:24:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-18409603-72d9-408f-8ce8-7b42bbf5f43c tempest-ProjectMemberTests-1544704132 None] Flow 'volume_create_manager' (b1432564-fb8b-40b4-8488-afacb9606539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:24:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-18409603-72d9-408f-8ce8-7b42bbf5f43c tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7036f2e-b20f-423f-94ce-708276caf710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-18409603-72d9-408f-8ce8-7b42bbf5f43c tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7036f2e-b20f-423f-94ce-708276caf710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1866742790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d151113-c427-4512-89bf-9d2d8581712a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95db90b8146744d19b5f094536ef20c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:24:50Z,use_quota=True,user_id='b0a2c8c9eeea4d8e90c8a6fcb89970cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-18409603-72d9-408f-8ce8-7b42bbf5f43c tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45aba25e-0203-4d63-bfdc-37acf482220b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-18409603-72d9-408f-8ce8-7b42bbf5f43c tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45aba25e-0203-4d63-bfdc-37acf482220b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-18409603-72d9-408f-8ce8-7b42bbf5f43c tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05fcb20c-a3fc-4998-847c-d49d09cb7690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-18409603-72d9-408f-8ce8-7b42bbf5f43c tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05fcb20c-a3fc-4998-847c-d49d09cb7690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d151113-c427-4512-89bf-9d2d8581712a', 'volume_name': 'volume-5d151113-c427-4512-89bf-9d2d8581712a', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-18409603-72d9-408f-8ce8-7b42bbf5f43c tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (416b43ab-c447-41cd-86e9-15c9b3969c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-18409603-72d9-408f-8ce8-7b42bbf5f43c tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (416b43ab-c447-41cd-86e9-15c9b3969c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:50 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-18409603-72d9-408f-8ce8-7b42bbf5f43c tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c8fadfb-7569-46a8-8a1d-e4302f5d52b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:50 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-18409603-72d9-408f-8ce8-7b42bbf5f43c tempest-ProjectMemberTests-1544704132 None] Volume 5d151113-c427-4512-89bf-9d2d8581712a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d151113-c427-4512-89bf-9d2d8581712a', 'volume_size': 1}
Nov 06 17:24:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-18409603-72d9-408f-8ce8-7b42bbf5f43c tempest-ProjectMemberTests-1544704132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:24:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-18409603-72d9-408f-8ce8-7b42bbf5f43c tempest-ProjectMemberTests-1544704132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:24:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-18409603-72d9-408f-8ce8-7b42bbf5f43c tempest-ProjectMemberTests-1544704132 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1866742790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d151113-c427-4512-89bf-9d2d8581712a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95db90b8146744d19b5f094536ef20c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:24:50Z,use_quota=True,user_id='b0a2c8c9eeea4d8e90c8a6fcb89970cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:24:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-18409603-72d9-408f-8ce8-7b42bbf5f43c tempest-ProjectMemberTests-1544704132 None] Creating volume 5d151113-c427-4512-89bf-9d2d8581712a {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:24:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-18409603-72d9-408f-8ce8-7b42bbf5f43c tempest-ProjectMemberTests-1544704132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:24:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-18409603-72d9-408f-8ce8-7b42bbf5f43c tempest-ProjectMemberTests-1544704132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:24:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-18409603-72d9-408f-8ce8-7b42bbf5f43c tempest-ProjectMemberTests-1544704132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:24:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-18409603-72d9-408f-8ce8-7b42bbf5f43c tempest-ProjectMemberTests-1544704132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:24:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-18409603-72d9-408f-8ce8-7b42bbf5f43c tempest-ProjectMemberTests-1544704132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:24:50 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-18409603-72d9-408f-8ce8-7b42bbf5f43c tempest-ProjectMemberTests-1544704132 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:24:50 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-18409603-72d9-408f-8ce8-7b42bbf5f43c tempest-ProjectMemberTests-1544704132 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:24:50 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-18409603-72d9-408f-8ce8-7b42bbf5f43c tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:50 devstack sudo[106302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a 1073741824
Nov 06 17:24:50 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:51 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-18409603-72d9-408f-8ce8-7b42bbf5f43c tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a 1073741824" returned: 0 in 0.404s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-18409603-72d9-408f-8ce8-7b42bbf5f43c tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:51 devstack sudo[106308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a
Nov 06 17:24:51 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:51 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-18409603-72d9-408f-8ce8-7b42bbf5f43c tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a" returned: 0 in 0.238s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:51 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-18409603-72d9-408f-8ce8-7b42bbf5f43c tempest-ProjectMemberTests-1544704132 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:24:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-18409603-72d9-408f-8ce8-7b42bbf5f43c tempest-ProjectMemberTests-1544704132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:24:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-18409603-72d9-408f-8ce8-7b42bbf5f43c tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c8fadfb-7569-46a8-8a1d-e4302f5d52b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d151113-c427-4512-89bf-9d2d8581712a', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-18409603-72d9-408f-8ce8-7b42bbf5f43c tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29c18071-ce12-4d4e-b46a-6ad2a6196470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:51 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-18409603-72d9-408f-8ce8-7b42bbf5f43c tempest-ProjectMemberTests-1544704132 None] Volume volume-5d151113-c427-4512-89bf-9d2d8581712a (5d151113-c427-4512-89bf-9d2d8581712a): created successfully
Nov 06 17:24:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-18409603-72d9-408f-8ce8-7b42bbf5f43c tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29c18071-ce12-4d4e-b46a-6ad2a6196470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:51 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-18409603-72d9-408f-8ce8-7b42bbf5f43c tempest-ProjectMemberTests-1544704132 None] Flow 'volume_create_manager' (b1432564-fb8b-40b4-8488-afacb9606539) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:24:51 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-18409603-72d9-408f-8ce8-7b42bbf5f43c tempest-ProjectMemberTests-1544704132 None] Created volume successfully.
Nov 06 17:24:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-912a0ad6-fc80-4532-ad06-b657d18c359a tempest-ProjectMemberTests-1544704132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:24:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-912a0ad6-fc80-4532-ad06-b657d18c359a tempest-ProjectMemberTests-1544704132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:24:51 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-912a0ad6-fc80-4532-ad06-b657d18c359a tempest-ProjectMemberTests-1544704132 None] Creating offline snapshot 19865a2e-2ce6-47ac-851c-b45e52e24b0c of volume 5d151113-c427-4512-89bf-9d2d8581712a {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:24:51 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c2c627-ae80-42e8-b5cc-f0a2bf251089]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:24:51 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-912a0ad6-fc80-4532-ad06-b657d18c359a tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:51 devstack sudo[106322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a
Nov 06 17:24:51 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:52 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-912a0ad6-fc80-4532-ad06-b657d18c359a tempest-ProjectMemberTests-1544704132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a" returned: 0 in 0.370s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-912a0ad6-fc80-4532-ad06-b657d18c359a tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a.19865a2e-2ce6-47ac-851c-b45e52e24b0c 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:52 devstack sudo[106353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a.19865a2e-2ce6-47ac-851c-b45e52e24b0c 1G
Nov 06 17:24:52 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:52 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-912a0ad6-fc80-4532-ad06-b657d18c359a tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a.19865a2e-2ce6-47ac-851c-b45e52e24b0c 1G" returned: 0 in 0.388s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-912a0ad6-fc80-4532-ad06-b657d18c359a tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d151113-c427-4512-89bf-9d2d8581712a -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a.19865a2e-2ce6-47ac-851c-b45e52e24b0c {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:52 devstack sudo[106359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d151113-c427-4512-89bf-9d2d8581712a -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a.19865a2e-2ce6-47ac-851c-b45e52e24b0c
Nov 06 17:24:52 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:52 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-912a0ad6-fc80-4532-ad06-b657d18c359a tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d151113-c427-4512-89bf-9d2d8581712a -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a.19865a2e-2ce6-47ac-851c-b45e52e24b0c" returned: 0 in 0.286s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:52 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-912a0ad6-fc80-4532-ad06-b657d18c359a tempest-ProjectMemberTests-1544704132 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a.19865a2e-2ce6-47ac-851c-b45e52e24b0c is being set with open permissions: ugo+rw
Nov 06 17:24:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-912a0ad6-fc80-4532-ad06-b657d18c359a tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a.19865a2e-2ce6-47ac-851c-b45e52e24b0c {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:52 devstack sudo[106364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a.19865a2e-2ce6-47ac-851c-b45e52e24b0c
Nov 06 17:24:52 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:52 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:52 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-912a0ad6-fc80-4532-ad06-b657d18c359a tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a.19865a2e-2ce6-47ac-851c-b45e52e24b0c" returned: 0 in 0.236s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-912a0ad6-fc80-4532-ad06-b657d18c359a tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:53 devstack sudo[106367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a.info
Nov 06 17:24:53 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:53 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-912a0ad6-fc80-4532-ad06-b657d18c359a tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a.info" returned: 0 in 0.247s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:53 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-912a0ad6-fc80-4532-ad06-b657d18c359a tempest-ProjectMemberTests-1544704132 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a.info is being set with open permissions: ugo+rw
Nov 06 17:24:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-912a0ad6-fc80-4532-ad06-b657d18c359a tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:53 devstack sudo[106370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a.info
Nov 06 17:24:53 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:53 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-912a0ad6-fc80-4532-ad06-b657d18c359a tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a.info" returned: 0 in 0.236s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-912a0ad6-fc80-4532-ad06-b657d18c359a tempest-ProjectMemberTests-1544704132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.847s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:24:53 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-912a0ad6-fc80-4532-ad06-b657d18c359a tempest-ProjectMemberTests-1544704132 None] Create snapshot completed successfully
Nov 06 17:24:53 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-0ed8969d-c5ef-4318-b8bf-689a433debd3 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-19865a2e-2ce6-47ac-851c-b45e52e24b0c-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:53 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-0ed8969d-c5ef-4318-b8bf-689a433debd3 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-19865a2e-2ce6-47ac-851c-b45e52e24b0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:53 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-0ed8969d-c5ef-4318-b8bf-689a433debd3 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-quobyte-5d151113-c427-4512-89bf-9d2d8581712a" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:53 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-0ed8969d-c5ef-4318-b8bf-689a433debd3 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-5d151113-c427-4512-89bf-9d2d8581712a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:53 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-0ed8969d-c5ef-4318-b8bf-689a433debd3 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-quobyte-19865a2e-2ce6-47ac-851c-b45e52e24b0c" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:53 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-0ed8969d-c5ef-4318-b8bf-689a433debd3 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-19865a2e-2ce6-47ac-851c-b45e52e24b0c" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:53 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-0ed8969d-c5ef-4318-b8bf-689a433debd3 tempest-ProjectMemberTests-1544704132 None] Deleting offline snapshot 19865a2e-2ce6-47ac-851c-b45e52e24b0c of volume 5d151113-c427-4512-89bf-9d2d8581712a {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:24:53 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-0ed8969d-c5ef-4318-b8bf-689a433debd3 tempest-ProjectMemberTests-1544704132 None] snapshot_file for this snap is: volume-5d151113-c427-4512-89bf-9d2d8581712a.19865a2e-2ce6-47ac-851c-b45e52e24b0c {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:24:53 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4c44df-799c-45a8-b760-c0f71d83098f]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:24:53 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0ed8969d-c5ef-4318-b8bf-689a433debd3 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a.19865a2e-2ce6-47ac-851c-b45e52e24b0c {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:54 devstack sudo[106373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a.19865a2e-2ce6-47ac-851c-b45e52e24b0c
Nov 06 17:24:54 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:54 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0ed8969d-c5ef-4318-b8bf-689a433debd3 tempest-ProjectMemberTests-1544704132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a.19865a2e-2ce6-47ac-851c-b45e52e24b0c" returned: 0 in 0.359s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:54 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-0ed8969d-c5ef-4318-b8bf-689a433debd3 tempest-ProjectMemberTests-1544704132 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d151113-c427-4512-89bf-9d2d8581712a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:24:54 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91676f1-2683-4dd8-bb10-365979589467]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:24:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0ed8969d-c5ef-4318-b8bf-689a433debd3 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:54 devstack sudo[106378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a
Nov 06 17:24:54 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:54 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0ed8969d-c5ef-4318-b8bf-689a433debd3 tempest-ProjectMemberTests-1544704132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a" returned: 0 in 0.344s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0ed8969d-c5ef-4318-b8bf-689a433debd3 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a.19865a2e-2ce6-47ac-851c-b45e52e24b0c {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:54 devstack sudo[106383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a.19865a2e-2ce6-47ac-851c-b45e52e24b0c
Nov 06 17:24:54 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:54 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0ed8969d-c5ef-4318-b8bf-689a433debd3 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a.19865a2e-2ce6-47ac-851c-b45e52e24b0c" returned: 0 in 0.336s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:54 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0ed8969d-c5ef-4318-b8bf-689a433debd3 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a.19865a2e-2ce6-47ac-851c-b45e52e24b0c {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:54 devstack sudo[106388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a.19865a2e-2ce6-47ac-851c-b45e52e24b0c
Nov 06 17:24:54 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:55 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:55 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-0ed8969d-c5ef-4318-b8bf-689a433debd3 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a.19865a2e-2ce6-47ac-851c-b45e52e24b0c" returned: 0 in 0.262s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:55 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-0ed8969d-c5ef-4318-b8bf-689a433debd3 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-19865a2e-2ce6-47ac-851c-b45e52e24b0c" released by "_delete_snapshot" :: held 1.396s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:55 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-0ed8969d-c5ef-4318-b8bf-689a433debd3 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-5d151113-c427-4512-89bf-9d2d8581712a" released by "delete_snapshot" :: held 1.416s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:55 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-0ed8969d-c5ef-4318-b8bf-689a433debd3 tempest-ProjectMemberTests-1544704132 None] Created reservations ['e9d83272-2edf-4063-a4dd-fb7809448f54', '0d299554-d4f4-412e-a126-fee70700ef34', 'bbe4f9a4-6a08-49af-8f06-e21c24b95be0', '488f1d6b-ba12-4c88-ab5f-e2a6067c2c91'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:24:55 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-0ed8969d-c5ef-4318-b8bf-689a433debd3 tempest-ProjectMemberTests-1544704132 None] Delete snapshot completed successfully.
Nov 06 17:24:55 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-0ed8969d-c5ef-4318-b8bf-689a433debd3 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-19865a2e-2ce6-47ac-851c-b45e52e24b0c-delete_snapshot" released by "delete_snapshot" :: held 1.542s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:55 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7fdcf9ed-0a17-4511-aa5c-ab5a8f02c92f tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-5d151113-c427-4512-89bf-9d2d8581712a-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:55 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7fdcf9ed-0a17-4511-aa5c-ab5a8f02c92f tempest-ProjectMemberTests-1544704132 None] Lock "cinder-5d151113-c427-4512-89bf-9d2d8581712a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:56 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7fdcf9ed-0a17-4511-aa5c-ab5a8f02c92f tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-quobyte-5d151113-c427-4512-89bf-9d2d8581712a" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:24:56 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7fdcf9ed-0a17-4511-aa5c-ab5a8f02c92f tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-5d151113-c427-4512-89bf-9d2d8581712a" acquired by "delete_volume" :: waited 0.015s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:24:56 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed78e0e-aa8c-45a9-8747-f8eb4b0fdfae]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:24:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7fdcf9ed-0a17-4511-aa5c-ab5a8f02c92f tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:56 devstack sudo[106392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a
Nov 06 17:24:56 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:56 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7fdcf9ed-0a17-4511-aa5c-ab5a8f02c92f tempest-ProjectMemberTests-1544704132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a" returned: 0 in 0.356s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7fdcf9ed-0a17-4511-aa5c-ab5a8f02c92f tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:56 devstack sudo[106397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a
Nov 06 17:24:56 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:56 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7fdcf9ed-0a17-4511-aa5c-ab5a8f02c92f tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-5d151113-c427-4512-89bf-9d2d8581712a" returned: 0 in 0.246s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:56 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7fdcf9ed-0a17-4511-aa5c-ab5a8f02c92f tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-5d151113-c427-4512-89bf-9d2d8581712a" released by "delete_volume" :: held 0.666s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:56 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-7fdcf9ed-0a17-4511-aa5c-ab5a8f02c92f tempest-ProjectMemberTests-1544704132 None] Created reservations ['20654a63-4763-45b5-8be9-1972540cf81a', '232bdfd6-46dd-4617-8557-478d6b668f1c', '08883058-1007-47d6-8911-cb64fa4ef304', '468a71b8-b6c8-448b-9cc2-35ca39f94aeb'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:24:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7fdcf9ed-0a17-4511-aa5c-ab5a8f02c92f tempest-ProjectMemberTests-1544704132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:24:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7fdcf9ed-0a17-4511-aa5c-ab5a8f02c92f tempest-ProjectMemberTests-1544704132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:24:56 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7fdcf9ed-0a17-4511-aa5c-ab5a8f02c92f tempest-ProjectMemberTests-1544704132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:24:56 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-7fdcf9ed-0a17-4511-aa5c-ab5a8f02c92f tempest-ProjectMemberTests-1544704132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:24:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-7fdcf9ed-0a17-4511-aa5c-ab5a8f02c92f tempest-ProjectMemberTests-1544704132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:24:56 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7fdcf9ed-0a17-4511-aa5c-ab5a8f02c92f tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:56 devstack sudo[106400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:24:56 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:57 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-7fdcf9ed-0a17-4511-aa5c-ab5a8f02c92f tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.248s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:57 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-7fdcf9ed-0a17-4511-aa5c-ab5a8f02c92f tempest-ProjectMemberTests-1544704132 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:24:57 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-7fdcf9ed-0a17-4511-aa5c-ab5a8f02c92f tempest-ProjectMemberTests-1544704132 None] Deleted volume successfully.
Nov 06 17:24:57 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-7fdcf9ed-0a17-4511-aa5c-ab5a8f02c92f tempest-ProjectMemberTests-1544704132 None] Lock "cinder-5d151113-c427-4512-89bf-9d2d8581712a-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:24:57 devstack cinder-volume[86856]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa93ed17-4ea7-463c-81c1-d745295de9c8 tempest-ProjectMemberTests-1544704132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86856) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 17:24:57 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fa93ed17-4ea7-463c-81c1-d745295de9c8 tempest-ProjectMemberTests-1544704132 None] Flow 'volume_create_manager' (09bd7c41-ee77-4980-b504-fb9546f0d99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:24:57 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fa93ed17-4ea7-463c-81c1-d745295de9c8 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b68e893-744a-4ff6-b4cb-d4401464894e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:57 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fa93ed17-4ea7-463c-81c1-d745295de9c8 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b68e893-744a-4ff6-b4cb-d4401464894e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-351011544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d549342-22cd-4949-ab18-88416a85b52a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95db90b8146744d19b5f094536ef20c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:24:57Z,use_quota=True,user_id='b0a2c8c9eeea4d8e90c8a6fcb89970cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:57 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fa93ed17-4ea7-463c-81c1-d745295de9c8 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53b9faf7-7423-47ab-bc19-9c86bcf69a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:57 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fa93ed17-4ea7-463c-81c1-d745295de9c8 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53b9faf7-7423-47ab-bc19-9c86bcf69a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:57 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fa93ed17-4ea7-463c-81c1-d745295de9c8 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb397a46-f17c-41eb-bbb4-2a63e56f44a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:57 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fa93ed17-4ea7-463c-81c1-d745295de9c8 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb397a46-f17c-41eb-bbb4-2a63e56f44a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d549342-22cd-4949-ab18-88416a85b52a', 'volume_name': 'volume-1d549342-22cd-4949-ab18-88416a85b52a', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:57 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fa93ed17-4ea7-463c-81c1-d745295de9c8 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee14f99-3394-4d78-90aa-a7a944e74805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:57 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fa93ed17-4ea7-463c-81c1-d745295de9c8 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee14f99-3394-4d78-90aa-a7a944e74805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:57 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fa93ed17-4ea7-463c-81c1-d745295de9c8 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4bf6e05-6459-4eba-90c8-b20dbe5c6a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:57 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-fa93ed17-4ea7-463c-81c1-d745295de9c8 tempest-ProjectMemberTests-1544704132 None] Volume 1d549342-22cd-4949-ab18-88416a85b52a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d549342-22cd-4949-ab18-88416a85b52a', 'volume_size': 1}
Nov 06 17:24:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-fa93ed17-4ea7-463c-81c1-d745295de9c8 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:24:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-fa93ed17-4ea7-463c-81c1-d745295de9c8 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:24:57 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-fa93ed17-4ea7-463c-81c1-d745295de9c8 tempest-ProjectMemberTests-1544704132 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x71da7318c1a0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T16:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-351011544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d549342-22cd-4949-ab18-88416a85b52a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95db90b8146744d19b5f094536ef20c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:24:57Z,use_quota=True,user_id='b0a2c8c9eeea4d8e90c8a6fcb89970cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc845a1-928d-4f3d-82fd-6c71498ffefe),volume_type_id=7fc845a1-928d-4f3d-82fd-6c71498ffefe)}" {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 17:24:57 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-fa93ed17-4ea7-463c-81c1-d745295de9c8 tempest-ProjectMemberTests-1544704132 None] Creating volume 1d549342-22cd-4949-ab18-88416a85b52a {{(pid=86856) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 17:24:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-fa93ed17-4ea7-463c-81c1-d745295de9c8 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:24:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-fa93ed17-4ea7-463c-81c1-d745295de9c8 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:24:57 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-fa93ed17-4ea7-463c-81c1-d745295de9c8 tempest-ProjectMemberTests-1544704132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:24:57 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-fa93ed17-4ea7-463c-81c1-d745295de9c8 tempest-ProjectMemberTests-1544704132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:24:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-fa93ed17-4ea7-463c-81c1-d745295de9c8 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:24:57 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-fa93ed17-4ea7-463c-81c1-d745295de9c8 tempest-ProjectMemberTests-1544704132 None] Selected osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316 as target Quobyte volume. {{(pid=86856) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 17:24:57 devstack cinder-volume[86856]: INFO cinder.volume.drivers.remotefs [None req-fa93ed17-4ea7-463c-81c1-d745295de9c8 tempest-ProjectMemberTests-1544704132 None] casted to osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316
Nov 06 17:24:57 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fa93ed17-4ea7-463c-81c1-d745295de9c8 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a 1073741824 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:57 devstack sudo[106403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a 1073741824
Nov 06 17:24:57 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:58 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fa93ed17-4ea7-463c-81c1-d745295de9c8 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a 1073741824" returned: 0 in 0.413s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fa93ed17-4ea7-463c-81c1-d745295de9c8 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:58 devstack sudo[106408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a
Nov 06 17:24:58 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:58 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-fa93ed17-4ea7-463c-81c1-d745295de9c8 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a" returned: 0 in 0.245s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:58 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-fa93ed17-4ea7-463c-81c1-d745295de9c8 tempest-ProjectMemberTests-1544704132 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'} {{(pid=86856) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 17:24:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-fa93ed17-4ea7-463c-81c1-d745295de9c8 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:24:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fa93ed17-4ea7-463c-81c1-d745295de9c8 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4bf6e05-6459-4eba-90c8-b20dbe5c6a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d549342-22cd-4949-ab18-88416a85b52a', 'volume_size': 1}' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fa93ed17-4ea7-463c-81c1-d745295de9c8 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dca5bd19-0d15-43c3-b093-34124161e2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 17:24:58 devstack cinder-volume[86856]: INFO cinder.volume.flows.manager.create_volume [None req-fa93ed17-4ea7-463c-81c1-d745295de9c8 tempest-ProjectMemberTests-1544704132 None] Volume volume-1d549342-22cd-4949-ab18-88416a85b52a (1d549342-22cd-4949-ab18-88416a85b52a): created successfully
Nov 06 17:24:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fa93ed17-4ea7-463c-81c1-d745295de9c8 tempest-ProjectMemberTests-1544704132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dca5bd19-0d15-43c3-b093-34124161e2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86856) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 17:24:58 devstack cinder-volume[86856]: DEBUG cinder.volume.manager [None req-fa93ed17-4ea7-463c-81c1-d745295de9c8 tempest-ProjectMemberTests-1544704132 None] Flow 'volume_create_manager' (09bd7c41-ee77-4980-b504-fb9546f0d99a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86856) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 17:24:58 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-fa93ed17-4ea7-463c-81c1-d745295de9c8 tempest-ProjectMemberTests-1544704132 None] Created volume successfully.
Nov 06 17:24:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e3cea4d2-d7d2-493c-956c-d7ec24665c01 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:24:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e3cea4d2-d7d2-493c-956c-d7ec24665c01 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:24:58 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-e3cea4d2-d7d2-493c-956c-d7ec24665c01 tempest-ProjectMemberTests-1544704132 None] Creating offline snapshot bce0b0f6-7f1b-4412-bc88-fc29aa26b625 of volume 1d549342-22cd-4949-ab18-88416a85b52a {{(pid=86856) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 17:24:58 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4a910d-07d6-49fa-acfe-e0f096929e30]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:24:58 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e3cea4d2-d7d2-493c-956c-d7ec24665c01 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:58 devstack sudo[106411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a
Nov 06 17:24:58 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:59 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e3cea4d2-d7d2-493c-956c-d7ec24665c01 tempest-ProjectMemberTests-1544704132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a" returned: 0 in 0.356s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e3cea4d2-d7d2-493c-956c-d7ec24665c01 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a.bce0b0f6-7f1b-4412-bc88-fc29aa26b625 1G {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:59 devstack sudo[106416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a.bce0b0f6-7f1b-4412-bc88-fc29aa26b625 1G
Nov 06 17:24:59 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:59 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e3cea4d2-d7d2-493c-956c-d7ec24665c01 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a.bce0b0f6-7f1b-4412-bc88-fc29aa26b625 1G" returned: 0 in 0.400s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e3cea4d2-d7d2-493c-956c-d7ec24665c01 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d549342-22cd-4949-ab18-88416a85b52a -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a.bce0b0f6-7f1b-4412-bc88-fc29aa26b625 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:59 devstack sudo[106422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d549342-22cd-4949-ab18-88416a85b52a -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a.bce0b0f6-7f1b-4412-bc88-fc29aa26b625
Nov 06 17:24:59 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:24:59 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root
Nov 06 17:24:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e3cea4d2-d7d2-493c-956c-d7ec24665c01 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d549342-22cd-4949-ab18-88416a85b52a -F qcow2 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a.bce0b0f6-7f1b-4412-bc88-fc29aa26b625" returned: 0 in 0.290s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:24:59 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-e3cea4d2-d7d2-493c-956c-d7ec24665c01 tempest-ProjectMemberTests-1544704132 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a.bce0b0f6-7f1b-4412-bc88-fc29aa26b625 is being set with open permissions: ugo+rw
Nov 06 17:24:59 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e3cea4d2-d7d2-493c-956c-d7ec24665c01 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a.bce0b0f6-7f1b-4412-bc88-fc29aa26b625 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:24:59 devstack sudo[106427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a.bce0b0f6-7f1b-4412-bc88-fc29aa26b625
Nov 06 17:24:59 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:25:00 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root
Nov 06 17:25:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e3cea4d2-d7d2-493c-956c-d7ec24665c01 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a.bce0b0f6-7f1b-4412-bc88-fc29aa26b625" returned: 0 in 0.235s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:25:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e3cea4d2-d7d2-493c-956c-d7ec24665c01 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:25:00 devstack sudo[106430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a.info
Nov 06 17:25:00 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:25:00 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root
Nov 06 17:25:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e3cea4d2-d7d2-493c-956c-d7ec24665c01 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a.info" returned: 0 in 0.258s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:25:00 devstack cinder-volume[86856]: WARNING cinder.volume.drivers.remotefs [None req-e3cea4d2-d7d2-493c-956c-d7ec24665c01 tempest-ProjectMemberTests-1544704132 None] /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a.info is being set with open permissions: ugo+rw
Nov 06 17:25:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e3cea4d2-d7d2-493c-956c-d7ec24665c01 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a.info {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:25:00 devstack sudo[106433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a.info
Nov 06 17:25:00 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:25:00 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root
Nov 06 17:25:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-e3cea4d2-d7d2-493c-956c-d7ec24665c01 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a.info" returned: 0 in 0.237s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:25:00 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-e3cea4d2-d7d2-493c-956c-d7ec24665c01 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.856s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:25:00 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-e3cea4d2-d7d2-493c-956c-d7ec24665c01 tempest-ProjectMemberTests-1544704132 None] Create snapshot completed successfully
Nov 06 17:25:00 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5e2a7289-80a0-42c0-a0d0-d80e783e249a tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-bce0b0f6-7f1b-4412-bc88-fc29aa26b625-delete_snapshot" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:25:00 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5e2a7289-80a0-42c0-a0d0-d80e783e249a tempest-ProjectMemberTests-1544704132 None] Lock "cinder-bce0b0f6-7f1b-4412-bc88-fc29aa26b625-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:25:00 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5e2a7289-80a0-42c0-a0d0-d80e783e249a tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-quobyte-1d549342-22cd-4949-ab18-88416a85b52a" by "delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:25:00 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5e2a7289-80a0-42c0-a0d0-d80e783e249a tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-1d549342-22cd-4949-ab18-88416a85b52a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:25:00 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5e2a7289-80a0-42c0-a0d0-d80e783e249a tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-quobyte-bce0b0f6-7f1b-4412-bc88-fc29aa26b625" by "_delete_snapshot" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:25:00 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5e2a7289-80a0-42c0-a0d0-d80e783e249a tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-bce0b0f6-7f1b-4412-bc88-fc29aa26b625" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:25:00 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-5e2a7289-80a0-42c0-a0d0-d80e783e249a tempest-ProjectMemberTests-1544704132 None] Deleting offline snapshot bce0b0f6-7f1b-4412-bc88-fc29aa26b625 of volume 1d549342-22cd-4949-ab18-88416a85b52a {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 17:25:01 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-5e2a7289-80a0-42c0-a0d0-d80e783e249a tempest-ProjectMemberTests-1544704132 None] snapshot_file for this snap is: volume-1d549342-22cd-4949-ab18-88416a85b52a.bce0b0f6-7f1b-4412-bc88-fc29aa26b625 {{(pid=86856) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 17:25:01 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4987b79-5f39-4790-abe0-aea1c3f29049]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:25:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5e2a7289-80a0-42c0-a0d0-d80e783e249a tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a.bce0b0f6-7f1b-4412-bc88-fc29aa26b625 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:25:01 devstack sudo[106436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a.bce0b0f6-7f1b-4412-bc88-fc29aa26b625
Nov 06 17:25:01 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:25:01 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root
Nov 06 17:25:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5e2a7289-80a0-42c0-a0d0-d80e783e249a tempest-ProjectMemberTests-1544704132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a.bce0b0f6-7f1b-4412-bc88-fc29aa26b625" returned: 0 in 0.352s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:25:01 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.remotefs [None req-5e2a7289-80a0-42c0-a0d0-d80e783e249a tempest-ProjectMemberTests-1544704132 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d549342-22cd-4949-ab18-88416a85b52a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86856) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 17:25:01 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad23a94-b60a-4610-b3f1-8bb0b3392cde]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:25:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5e2a7289-80a0-42c0-a0d0-d80e783e249a tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:25:01 devstack sudo[106444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a
Nov 06 17:25:01 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:25:01 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root
Nov 06 17:25:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5e2a7289-80a0-42c0-a0d0-d80e783e249a tempest-ProjectMemberTests-1544704132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a" returned: 0 in 0.357s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:25:01 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5e2a7289-80a0-42c0-a0d0-d80e783e249a tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a.bce0b0f6-7f1b-4412-bc88-fc29aa26b625 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:25:01 devstack sudo[106450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a.bce0b0f6-7f1b-4412-bc88-fc29aa26b625
Nov 06 17:25:01 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:25:02 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root
Nov 06 17:25:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5e2a7289-80a0-42c0-a0d0-d80e783e249a tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a.bce0b0f6-7f1b-4412-bc88-fc29aa26b625" returned: 0 in 0.327s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:25:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5e2a7289-80a0-42c0-a0d0-d80e783e249a tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a.bce0b0f6-7f1b-4412-bc88-fc29aa26b625 {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:25:02 devstack sudo[106455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a.bce0b0f6-7f1b-4412-bc88-fc29aa26b625
Nov 06 17:25:02 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:25:02 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root
Nov 06 17:25:02 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-5e2a7289-80a0-42c0-a0d0-d80e783e249a tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a.bce0b0f6-7f1b-4412-bc88-fc29aa26b625" returned: 0 in 0.245s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:25:02 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5e2a7289-80a0-42c0-a0d0-d80e783e249a tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-bce0b0f6-7f1b-4412-bc88-fc29aa26b625" released by "_delete_snapshot" :: held 1.377s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:25:02 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5e2a7289-80a0-42c0-a0d0-d80e783e249a tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-1d549342-22cd-4949-ab18-88416a85b52a" released by "delete_snapshot" :: held 1.398s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:25:02 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-5e2a7289-80a0-42c0-a0d0-d80e783e249a tempest-ProjectMemberTests-1544704132 None] Created reservations ['461eea30-d4b6-43cb-bf24-2287df221ddf', '727c0f99-30b6-446a-90d6-822abffb81d4', '807e9436-b30e-4519-aba9-9d7947a26c2d', 'dcb9d876-ae08-4c07-a1e6-91cff6e7c903'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:25:02 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-5e2a7289-80a0-42c0-a0d0-d80e783e249a tempest-ProjectMemberTests-1544704132 None] Delete snapshot completed successfully.
Nov 06 17:25:02 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-5e2a7289-80a0-42c0-a0d0-d80e783e249a tempest-ProjectMemberTests-1544704132 None] Lock "cinder-bce0b0f6-7f1b-4412-bc88-fc29aa26b625-delete_snapshot" released by "delete_snapshot" :: held 1.526s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:25:03 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-410db765-3578-4b4b-9026-8600724a1dc6 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-1d549342-22cd-4949-ab18-88416a85b52a-delete_volume" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:25:03 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-410db765-3578-4b4b-9026-8600724a1dc6 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-1d549342-22cd-4949-ab18-88416a85b52a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:25:03 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-410db765-3578-4b4b-9026-8600724a1dc6 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "cinder-quobyte-1d549342-22cd-4949-ab18-88416a85b52a" by "delete_volume" {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 17:25:03 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-410db765-3578-4b4b-9026-8600724a1dc6 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-1d549342-22cd-4949-ab18-88416a85b52a" acquired by "delete_volume" :: waited 0.017s {{(pid=86856) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 17:25:03 devstack cinder-volume[86856]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c30729-e29b-4942-b1b8-2064d70f73a5]: (4, 'qcow2') {{(pid=89335) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 17:25:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-410db765-3578-4b4b-9026-8600724a1dc6 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:25:03 devstack sudo[106458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a
Nov 06 17:25:03 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:25:03 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root
Nov 06 17:25:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-410db765-3578-4b4b-9026-8600724a1dc6 tempest-ProjectMemberTests-1544704132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a" returned: 0 in 0.354s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:25:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-410db765-3578-4b4b-9026-8600724a1dc6 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:25:03 devstack sudo[106463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a
Nov 06 17:25:03 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:25:03 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root
Nov 06 17:25:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-410db765-3578-4b4b-9026-8600724a1dc6 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f/volume-1d549342-22cd-4949-ab18-88416a85b52a" returned: 0 in 0.246s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:25:03 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-410db765-3578-4b4b-9026-8600724a1dc6 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-quobyte-1d549342-22cd-4949-ab18-88416a85b52a" released by "delete_volume" :: held 0.664s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:25:03 devstack cinder-volume[86856]: DEBUG cinder.quota [None req-410db765-3578-4b4b-9026-8600724a1dc6 tempest-ProjectMemberTests-1544704132 None] Created reservations ['feb7aeb6-3204-4de8-95f3-2baa55d7d105', '92729e4a-22b0-4c66-a07c-26115b4918ef', '52da0799-7359-43ae-82d7-70f99d2790b2', '0308fb5c-81c4-4179-9688-1509535919e0'] {{(pid=86856) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 17:25:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-410db765-3578-4b4b-9026-8600724a1dc6 tempest-ProjectMemberTests-1544704132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 17:25:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-410db765-3578-4b4b-9026-8600724a1dc6 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 17:25:03 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-410db765-3578-4b4b-9026-8600724a1dc6 tempest-ProjectMemberTests-1544704132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316': None} {{(pid=86856) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 17:25:03 devstack cinder-volume[86856]: DEBUG cinder.volume.drivers.quobyte [None req-410db765-3578-4b4b-9026-8600724a1dc6 tempest-ProjectMemberTests-1544704132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eda9f03a-9ec6-43cf-ab19-e14e5392d316'] {{(pid=86856) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 17:25:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.lockutils [None req-410db765-3578-4b4b-9026-8600724a1dc6 tempest-ProjectMemberTests-1544704132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86856) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 17:25:03 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-410db765-3578-4b4b-9026-8600724a1dc6 tempest-ProjectMemberTests-1544704132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 17:25:03 devstack sudo[106466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f
Nov 06 17:25:03 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 17:25:04 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root
Nov 06 17:25:04 devstack cinder-volume[86856]: DEBUG oslo_concurrency.processutils [None req-410db765-3578-4b4b-9026-8600724a1dc6 tempest-ProjectMemberTests-1544704132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b21acc913e7dbf7f65262bfa482f2c7f" returned: 0 in 0.244s {{(pid=86856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 17:25:04 devstack cinder-volume[86856]: DEBUG cinder.manager [None req-410db765-3578-4b4b-9026-8600724a1dc6 tempest-ProjectMemberTests-1544704132 None] Notifying Schedulers of capabilities ... {{(pid=86856) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 17:25:04 devstack cinder-volume[86856]: INFO cinder.volume.manager [None req-410db765-3578-4b4b-9026-8600724a1dc6 tempest-ProjectMemberTests-1544704132 None] Deleted volume successfully.
Nov 06 17:25:04 devstack cinder-volume[86856]: DEBUG cinder.coordination [None req-410db765-3578-4b4b-9026-8600724a1dc6 tempest-ProjectMemberTests-1544704132 None] Lock "cinder-1d549342-22cd-4949-ab18-88416a85b52a-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=86856) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 17:25:13 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=107,cinder:INSERT=41,cinder:UPDATE=133,cinder:DELETE=8 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 17:25:14 devstack cinder-volume[86856]: DEBUG dbcounter [-] [86856] Writing DB stats cinder:SELECT=108,cinder:INSERT=37,cinder:UPDATE=146,cinder:DELETE=14 {{(pid=86856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}